User-agent: Baiduspider Disallow: / User-agent: Twiceler Disallow: / User-agent: DBLBot Disallow: / User-agent: * Crawl-delay: 4 Disallow: /cgi-bin/ Disallow: /image/ Disallow: /sound/ Disallow: /text/ Disallow: /temporary/ Sitemap: http://leanwood.com/sitemap.text # This robot exclusion protocol text file is semi-generic. # The Sitemap domain name must be customised, as well as the filename if that is different. # The leading whitespaces may cause problems, and may be removed.