User-agent: * Disallow: /cgi-bin/ Disallow: /guest/ Disallow: /stats/ Disallow: /stats_back/ Disallow: /wwwboard/ Disallow: /webstats/ Disallow: /Order/ Disallow: /orders/ Disallow: /ebay/ Disallow: /media/ Disallow: /ssimages/ Disallow: /draft/ Disallow: /test/ Disallow: /rent/ Disallow: /ticker.txt User-agent: Slurp Crawl-delay: 10 User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0 Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0) Fetch API Request Disallow: / User-agent: Crescent Disallow: / User-agent: Alexibot Disallow: / User-agent: ia_archiver Disallow: / User-agent: CherryPickerSE/1.0 Disallow: / User-agent: CherryPickerElite/1.0 Disallow: / User-agent: webbandit/4.45.0 Disallow: / User-agent: Microsoft URL Control - 6.00.8862 Disallow: / User-agent: EmailSiphon Disallow: / User-agent: Teleport Pro/1.29.1820 Disallow: / User-agent: Mozilla/2.0 (compatible; MS FrontPage 4.0) Disallow: / User-agent: Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98) Disallow: /