User-agent: * Disallow: /mixo/ User-agent: 123People Disallow: / User-agent: 008 Disallow: / User-agent: 80bot Disallow: / User-agent: 360Spider Disallow: / User-agent: ActiveTouristBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: aiHitBot Disallow: / User-agent: ApptusBot Disallow: / User-agent: Banana Crawler Disallow: / User-agent: baypup Disallow: / User-agent: BecomeBot Disallow: / User-agent: BioSearch Disallow: / User-agent: BitComet Disallow: / User-agent: BoardReader Disallow: / User-agent: BoardTracker Disallow: / User-agent: BrightCrawler Disallow: / User-agent: CatchBot Disallow: / User-agent: ccbot Disallow: / User-agent: CentiverseBot Disallow: / User-agent: Comodo-Certificates-Spider Disallow: / User-agent: COMODOspider/Nutch-1.0 Disallow: / User-agent: CompSpyBot Disallow: / User-agent: ConveraCrawler Disallow: / User-agent: Digimarc CGIReader/*.* Disallow: / User-agent: Digimarc WebReader/*.* Disallow: / User-agent: DomainDB Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: EventGuruBot Disallow: / User-agent: Ezooms Disallow: / User-agent: Fasterfox Disallow: / User-agent: Fatbot Disallow: / User-agent: Feedtrace-bot Disallow: / User-agent: findestars Disallow: / User-agent: Flatlandbot Disallow: / User-agent: FyberSpider Disallow: / User-agent: Gaisbot Disallow: / User-agent: GeoHasher Disallow: / User-agent: GetRight Disallow: / User-agent: Gimmie60/5.0 Disallow: / User-agent: GingerCrawler Disallow: / User-agent: Gnomit Disallow: / User-agent: HTTP Fetcher Disallow: / User-agent: HTTrack Disallow: / User-agent: HTTrack 3.0 Disallow: / User-agent: htty Disallow: / User-agent: HuaweiSymantecSpider Disallow: / User-agent: ia_archiver Disallow: / User-agent: Indy Library Disallow: / User-agent: Influencebot Disallow: / User-agent: Jakarta Disallow: / User-agent: JikeSpider Disallow: / User-agent: Jorgee/1 Disallow: / User-agent: Jyxobot/1 Disallow: / User-agent: larbin Disallow: / User-agent: librabot Disallow: / User-agent: libwww-perl Disallow: / User-agent: ltbot Disallow: / User-agent: MJ12bot Disallow: / User-agent: MyOnID Disallow: / User-agent: Nachobot Disallow: / User-agent: Nutch Disallow: / User-agent: Nutch-0.9 Disallow: / User-agent: Nutch-1.0 Disallow: / User-agent: Nutch-1.1 Disallow: / User-agent: nxsCrawler-09 Disallow: / User-agent: OnTownsBot Disallow: / User-agent: OpenfosBot Disallow: / User-agent: PagesInventory Disallow: / User-agent: PageNest Disallow: / User-agent: peekyou Disallow: / User-agent: Pipl Disallow: / User-agent: plukkie Disallow: / User-agent: ProCogBot Disallow: / User-agent: psbot Disallow: / User-agent: ptd-crawler Disallow: / User-agent: PureBot Disallow: / User-agent: Python-urllib Disallow: / User-agent: rapleaf Disallow: / User-agent: robtexbot Disallow: / User-agent: ScoutJet Disallow: / User-agent: Scrapy Disallow: / User-agent: Scrubby/3.0 Disallow: / User-agent: search17 Disallow: / User-agent: SemrushBot Disallow: / User-agent: SiteBot Disallow: / User-agent: SmartViper Disallow: / User-agent: Snapbot Disallow: / User-agent: SnapPreviewBot Disallow: / User-agent: Snappy Disallow: / User-agent: snitch Disallow: / User-agent: spbot Disallow: / User-agent: Speedy Spider Disallow: / User-agent: Spinn3r Disallow: / User-agent: spock Disallow: / User-agent: Steeler Disallow: / User-agent: studybot/1.0 Disallow: / User-agent: SurveyBot Disallow: / User-agent: TechrigyBot Disallow: / User-agent: Teemer Disallow: / User-agent: TrueKnowledgeBot Disallow: / User-agent: tweepz Disallow: / User-agent: twiceler Crawl-delay: 20 User-agent: VadixBot Disallow: / User-agent: WebarooBot Disallow: / User-agent: webfetch Disallow: / User-agent: wink Disallow: / User-agent: XmarksFetch Disallow: / User-agent: Yasni Disallow: / User-agent: yoname Disallow: / User-agent: yourtraces Disallow: / User-agent: zibber Disallow: / User-agent: ZipppBot/Nutch-0.9 Disallow: / User-agent: zoominfo Disallow: /