User-agent: Surfbot Disallow: / User-agent: Resume Robot Disallow: / User-agent: CACTVS Chemistry Spider Disallow: / User-agent: dlw3robot/x.y (in TclX by http://hplyot.obspm.fr/~dl/) Disallow: / User-agent: libWeb/clsHTTP Disallow: / User-agent: WWWWanderer v3.0 Disallow: / User-agent: Solbot/1.0 LWP/5.07 Disallow: / User-agent: Road Runner: ImageScape Robot (lim@cs.leidenuniv.nl) Disallow: / User-agent: Teleport Disallow: / User-agent: Hämähäkki/0.2 Disallow: / User-agent: ComputingSite Robi/1.0 (robi@computingsite.com) Disallow: / User-agent: Titan Disallow: / User-agent: TeleportPro Disallow: / User-agent: toCrawl/UrlDispatcher Disallow: / User-agent: HappyBot (gserver.kw.net) Disallow: / User-agent: Katipo/1.0 Disallow: / User-agent: Kenjin Spider Disallow: / User-agent: yes Disallow: / User-agent: Foobot Disallow: / User-agent: CherryPicker Disallow: / User-agent: ExtractorPro Disallow: /