# robots.txt - http://www.cm-aisne.fr User-agent: msnbot Crawl-delay: 15 User-agent: slurp Crawl-delay: 10 User-agent: * Disallow: /stats/ Disallow: /usages/ Disallow: /webalizer/ Disallow: /_include/