# All robots will spider the domain go software standards ie User-agent: Googlebot User-agent: * Disallow: /ad-links/ Disallow: /acupuncture/ Disallow: /ashton/ Disallow: /baitrix-form/ Disallow: /cgi-bin/ Disallow: /crossbow/ Disallow: /davinora/ Disallow: /digitex/ Disallow: /englishlessonsforyou/ Disallow: /ewc.files/ Disallow: /flash/ Disallow: /form_backups/ Disallow: /gb020310/ Disallow: /gb021210/ Disallow: /gb032310/ Disallow: /davinora/ Disallow: /harrys_garden/ Disallow: /impact/ Disallow: /MapIcons/ Disallow: /precision_steel/ Disallow: /dtek.html Disallow: /robnat/ Disallow: /scripts/ Disallow: /sounds/ Disallow: /SpryAssets/ Disallow: /twindeer/ Disallow: /td-sales/ Disallow: /zebec/ Disallow: /seoexamples.html Disallow: /dragon.html Disallow: /kts_new/ #Disallow: /pricing.html Disallow: /ewcblog/ Disallow: /grovetelecom/ Disallow: /wavetrak/ Disallow: /qsdrentals/ Disallow: /edmonton-web-design/ Disallow: /crossbow-new/ User-agent: MSNbot Disallow: /twin_deer/ User-agent: Slurp Disallow: /twin_deer/