User-agent: * Disallow: User-agent: Yandex Disallow: / User-agent: Yandex/1.01.001 Disallow: / User-agent: Yanga WorldSearch Bot v1.1 Disallow: / User-agent: Yanga WorldSearch Bot v1.1/beta Disallow: / User-agent: Yanga Disallow: / User-agent: DBLBot/1.0 Disallow: / User-agent: Speedy Spider Disallow: / User-agent: Baiduspider Disallow: / User-agent: Baiduspider+ Disallow: / User-agent: Charlotte Disallow: / User-agent: Java/1.6.0_04 Disallow: / User-agent: Java/1.6.0_11 Disallow: / User-agent: msnbot-media/1.0 Disallow: / User-agent: Twiceler-0.9 Disallow: / User-agent: Gigabot/3.0 Disallow: / User-agent: panscient.com Disallow: / User-agent: Exabot/3.0 Disallow: / User-agent: Sogou web spider Disallow: / User-agent: Sogou web spider/4.0 Disallow: / User-agent: MLBot Disallow: / User-agent: Mail.Ru/1.0 Disallow: / User-agent: Mail.Ru Disallow: / User-agent: DBLBot/1.0 Disallow: / User-agent: DBLBot Disallow: / User-agent: Speedy Spider Disallow: / User-agent: Twiceler-0.9 Disallow: / User-agent: Twiceler Disallow: / User-agent: Charlotte/1.1 Disallow: / User-agent: Charlotte Disallow: / User-agent: WebDataCentreBot/1.0 Disallow: / User-agent: WebDataCentreBot Disallow: / User-agent: Ask Jeeves/Teoma Disallow: / User-agent: NaverBot/1.0 Disallow: / User-agent: NaverBot Disallow: / User-agent: Busiversebot/v1.0 Disallow: / User-agent: Busiversebot Disallow: / User-agent: VoilaBot BETA 1.2 Disallow: / User-agent: VoilaBot Disallow: / User-agent: envolk/1.7 Disallow: / User-agent: envolk Disallow: / User-agent: Cityreview Robot Disallow: / User-agent: http://www.forumseek.net Disallow: / User-agent: BOT_2.1 Disallow: / User-agent: http://www.forumseek.net/ BOT_2.1 Disallow: / User-agent: Speedy Spider Disallow: / User-agent: ScoutJet Disallow: / User-agent: panscient.com Disallow: / User-agent: SurveyBot/2.3 (Whois Source) Disallow: / User-agent: SurveyBot/2.3 Disallow: / User-agent: SurveyBot Disallow: / User-agent: gonzo1[P] Disallow: / User-agent: NetSeer/Nutch-0.9 Disallow: / User-agent: NetSeer Disallow: / User-agent: POEGrubCrawler/0.01 Disallow: / User-agent: POEGrubCrawler Disallow: / User-agent: jobs.de-Robot Disallow: / User-agent: Jambot/0.1.1 Disallow: / User-agent: Jambot Disallow: / User-agent: Shelob (shelob@gmx.net) Disallow: /