User-agent: Slurp Crawl-delay: 20 Disallow: /cgi-bin/ Disallow: /usage/ Disallow: /awstats/ Disallow: /server/ Disallow: /gallery/ User-agent: * Disallow: /cgi-bin/ Disallow: /usage/ Disallow: /awstats/ Disallow: /server/ Disallow: /gallery/ User-agent: msnbot Crawl-delay: 20 Disallow: /cgi-bin/ Disallow: /usage/ Disallow: /awstats/ Disallow: /server/ Disallow: /gallery/ User-agent: ConveraCrawler Crawl-delay: 20 Disallow: /cgi-bin/ Disallow: /usage/ Disallow: /awstats/ Disallow: /server/ Disallow: /gallery/ User-agent: YahooFeedSeeker Disallow: /lrbalt/blog/index.xml Disallow: /baby/blog/index.xml