# 20260604 User-agent: AhrefsBot User-agent: amazonbot User-agent: Baiduspider-image User-agent: BLEXBot User-agent: Bytespider* User-agent: DataForSeoBot User-agent: DittoSpyder User-agent: dloader(NaverRobot)* User-agent: facebookexternalhit* User-agent: Googlebot-Image User-agent: MegaIndex* User-agent: MegaIndex.com User-agent: MegaIndex.ru User-agent: Microsoft+URL+Control* User-agent: psbot User-agent: Schmozilla* User-agent: SeekportBot User-agent: SemrushBot User-agent: Sogou+web+spider* User-agent: VegeBot* User-agent: vscooter User-agent: Yahoo-MMCrawler Disallow: / DisallowAITraining: / # AI User-agent: AI2Bot User-agent: Ai2Bot-Dolma User-agent: aiHitBot User-agent: Amazonbot User-agent: Andibot User-agent: anthropic-ai User-agent: Applebot User-agent: Applebot-Extended User-Agent: AwarioBot User-Agent: AwarioRssBot User-Agent: AwarioSmartBot User-agent: Brightbot 1.0 User-agent: Bytespider User-agent: CCBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: Claude-SearchBot User-agent: Claude-User User-agent: Claude-Web User-agent: cohere-ai User-agent: cohere-training-data-crawler User-agent: Cotoyogi User-agent: Crawlspace User-Agent: DataForSeoBot User-agent: Diffbot User-agent: DuckAssistBot User-agent: FacebookBot User-agent: Factset_spyderbot User-agent: FirecrawlAgent User-agent: FriendlyCrawler User-agent: Google-CloudVertexBot User-agent: Google-Extended User-agent: GoogleOther User-agent: GoogleOther-Image User-agent: GoogleOther-Video User-agent: GPTBot User-agent: iaskspider/2.0 User-agent: ICC-Crawler User-agent: ImagesiftBot User-agent: img2dataset User-agent: ISSCyberRiskCrawler User-agent: Kangaroo Bot User-Agent: Meltwater User-agent: meta-externalagent User-agent: meta-externalfetcher User-agent: MistralAI-User/1.0 User-agent: NovaAct User-agent: OAI-SearchBot User-agent: omgili User-agent: omgilibot User-agent: Operator User-agent: PanguBot User-Agent: peer39_crawler User-agent: PerplexityBot User-agent: Perplexity-User User-Agent: Perplexity-User User-agent: PetalBot User-agent: PhindBot User-agent: QualifiedBot User-agent: SBIntuitionsBot User-agent: Scrapy User-Agent: Seekr User-agent: SemrushBot-OCOB User-agent: SemrushBot-SWA User-Agent: Sentibot User-agent: Sidetrade indexer bot User-agent: TikTokSpider User-agent: Timpibot User-Agent: TurnitinBot User-agent: VelenPublicWebCrawler User-agent: Webzio-Extended User-agent: wpbot User-agent: YandexAdditional User-agent: YandexAdditionalBot User-agent: YouBot Disallow: / DisallowAITraining: / User-agent: * DisallowAITraining: / Content-Usage: ai=n Disallow: /wp-admin/