#**************************************************************************** # robots.txt # : Robots, spiders, and search engines use this file to detmine which # content they should *not* crawl while indexing your website. # : This system is called "The Robots Exclusion Standard." # : It is strongly encouraged to use a robots.txt validator to check # for valid syntax before any robots read it! # # Examples: # # Instruct all robots to stay out of the admin area. # : User-agent: * # : Disallow: /admin/ # # Restrict Google and MSN from indexing your images. # : User-agent: Googlebot # : Disallow: /images/ # : User-agent: MSNBot # : Disallow: /images/ #**************************************************************************** User-agent: * Disallow: /Arts/ Disallow: /archives/ Allow: /archives/entry/ Disallow: /artwork/ Disallow: /assets/ Disallow: /audio/ Disallow: /automin/ Disallow: /mint/ Disallow: /branford/ Disallow: /cache/ Disallow: /themes/ Disallow: /contact_NHI/ Disallow: /css/ Disallow: /dictionary/ Disallow: /e_test/ Disallow: /favorites/ Disallow: /feeder/ Disallow: /gc_links/ Disallow: /graphics/ Disallow: /index.php/health/ Disallow: /health/ Disallow: /HealthCare/ Disallow: /images/ Disallow: /nhi_Spellcheck_test/ Disallow: /mt/ Disallow: /parts/ Disallow: /php_speedy/ Disallow: /podcast/ Disallow: /public/ Disallow: /scripts/ Disallow: /slidepix/ Disallow: /sponsors/ Disallow: /temp/ Disallow: /templates_c/ Disallow: /tmp/ Disallow: /upload/ Disallow: /valleyindy/ Disallow: /valleyindy2/ Disallow: /index.php?offset= Disallow: *?offset= Disallow: *?altcast_code= Disallow: *?ACT= Disallow: */member/ User-Agent: bingbot Disallow: /