# ----------------------------------------------------------------------------------------- # robots.txt fuer Suchmaschinen # ----------------------------------------------------------------------------------------- # @category robots.txt # @copyright 2019 gohunting.de # ----------------------------------------------------------------------------------------- User-agent: * Disallow: / User-agent: serpstatbot Disallow: / User-agent: serpstatbot Disallow: / User-agent: SemrushBot-SA Disallow: / User-agent: SemrushBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: MegaIndex Disallow: / User-agent: MegaIndex.ru Disallow: / User-agent: AhrefsBot Disallow: / User-agent: Dotbot Disallow: / # http://seocompany.store User-Agent: adscanner Disallow: / User-agent: TutorGig Disallow: / User-agent: twiceler Disallow: / User-agent: Ultraseek Disallow: / User-agent: URL Control Disallow: / User-agent: URL_Spider_Pro Disallow: / User-Agent: ZoominfoBot Disallow: / User-Agent: Barkrowler Disallow: / User-Agent: Adsbot Disallow: / User-agent: BLEXBot Disallow: / Sitemap: http://www.gohunting.de/sitemap_index.xml