# # Disallowed robots # User-agent: ASPseek/1.2.10 Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: WebBandit Disallow: / User-agent: EmailWolf Disallow: / User-agent: WWW-Collector-E Disallow: / User-agent: humanlinks Disallow: / User-agent: LinkextractorPro Disallow: / User-agent: Offline Explorer Disallow: / User-agent: BackDoorBot/1.0 Disallow: / User-agent: psbot/0.1 Disallow: / user-agent: msnbot crawl-delay: 120 User-agent: * Disallow: