User-agent: * Allow: / Disallow: /check Disallow: /csrf-token User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: PetalBot Disallow: / User-agent: Bytespider Disallow: / Sitemap: https://seekdom.com/sitemap.xml Sitemap: https://seekdom.com/sitemap-ai.xml