# no pictures here to waste bandwidth on picture spiders User-agent: psbot Disallow: / # exclude spiders that do not understand relative links User-agent: Charlotte Disallow: / # exclude spiders used by no one that seek ancient or bad stuff User-agent: dotbot Disallow: / User-agent: * Disallow: /icons/ Disallow: /manual/ # spiders don't use authentication Disallow: /dcc/private/ Disallow: /dcc-demo-cgi-bin/