User-agent: * Disallow:/*/ Disallow:/*.go$ Allow: /*.aspx Allow: /*?$ Allow: /*.xml