# robots.txt for http://www.halton.gov.uk # only allow those bots we want to trawl the site # allow google User-agent: Googlebot Disallow: # allow yahoo! User-agent: Slurp Disallow: # allow MSN User-agent: MSNbot Disallow: # allow site improve broken link check User-agent: LinkCheck by SiteImprove.com Disallow: # allow Open Objects for site search User-agent: Ultraseek Disallow: # stop any other bots that are not recognised or allowed # go away bad bot! User-agent: * Disallow: /