User-agent: * Disallow: /cgi-bin/ Disallow: /admin/ Disallow: /admin/editor/ Disallow: /admin/images/ Disallow: /intern/ Disallow: /tools/ User-agent: sistrix Disallow: / User-agent: URL_Spider_Pro Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: WebBandit Disallow: / User-agent: WebSauger Disallow: / User-agent: WebCopier Disallow: / User-agent: spanner Disallow: / User-agent: stalker Dissallow: / User-agent: The Intraformant Disallow: / User-agent: toCrawl/UrlDispatcher Disallow: /