# /robots.txt file for all crawlers # source of code http://www.robotstxt.org/wc/faq.html#index User-agent: * Disallow: