User-agent: AcademicBot Crawl-Delay: 5 User-agent: AhrefsBot Disallow: / User-agent: Amazonbot Crawl-Delay: 5 User-agent: Applebot Crawl-Delay: 5 User-agent: Bingbot Crawl-Delay: 5 User-agent: Brightbot Crawl-Delay: 5 User-agent: ChatGPT-User Crawl-Delay: 5 User-agent: ClaudeBot Crawl-Delay: 5 User-agent: DataForSeoBot Crawl-Delay: 5 User-agent: DotBot Crawl-Delay: 5 User-agent: Gensparkbot Crawl-Delay: 5 User-agent: GPTBot Crawl-Delay: 5 User-agent: Googlebot Crawl-Delay: 5 User-agent: MJ12bot Crawl-Delay: 5 User-agent: MojeekBot Crawl-Delay: 5 User-agent: OAI-SearchBot Crawl-Delay: 5 User-agent: PerplexityBot Crawl-Delay: 5 User-agent: PetalBot Crawl-Delay: 5 User-agent: PoeSearchBot Crawl-Delay: 5 User-agent: Qwantbot Crawl-Delay: 5 User-agent: SemanticScholarBot Crawl-Delay: 5 User-agent: SemrushBot Disallow: / User-agent: SeoCherryBot Crawl-Delay: 5 User-agent: SeznamBot Crawl-Delay: 5 User-agent: SiteAuditBot Crawl-Delay: 5 User-agent: Slackbot Crawl-Delay: 5 User-agent: YandexBot Disallow: / User-agent: YandexRenderResourcesBot Crawl-Delay: 5 User-agent: academicbot Crawl-Delay: 5 User-agent: amazonbot Crawl-Delay: 5 User-agent: applebot Crawl-Delay: 5 User-agent: bingbot Crawl-Delay: 5 User-agent: bitlybot Crawl-Delay: 5 User-agent: dotbot Crawl-Delay: 5 User-agent: gptbot Crawl-Delay: 5 User-agent: meta-externalagent Crawl-Delay: 5 User-agent: mj12bot Crawl-Delay: 5 User-agent: node-fetch Crawl-Delay: 5 User-agent: petalbot Crawl-Delay: 5 User-agent: searchbot Crawl-Delay: 5 User-agent: * Disallow: Disallow: /cgi-bin/ # START YOAST BLOCK # --------------------------- User-agent: * Disallow: Sitemap: https://www.mousephenotype.org/sitemap_index.xml # --------------------------- # END YOAST BLOCK