#These folders should not be indexed by search engine spiders User-agent: * Disallow: /aspnet_client/ Disallow: /CGI-BIN/ Disallow: /CSS/ Disallow: /database/ Disallow: /Documents/ Disallow: /Scripts/ Disallow: /Templates/