User-agent: ia_archiver Disallow: / User-agent: archive.org_bot Disallow: / User-agent: ia_archiver/1.6 Disallow: / User-agent: AhrefsBot Disallow: / User-agent: AboutUsBot Disallow: / User-agent: Ezooms Disallow: / User-agent: Ezooms/1.0 Disallow: / User-agent: BLEXBot Disallow: / User-agent: DotBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: XoviBot Disallow: / User-agent: MegaIndex.ru Disallow: / User-agent: MegaIndex.ru/2.0 Disallow: / User-agent: SeznamBot Disallow: / User-agent: MaxPointCrawler Disallow: / User-agent: MaxPointCrawler/Nutch-1.10 Disallow: / User-agent: Gigabot/2.0 Disallow: /