User-agent: * Disallow: /.mfa User-agent: Scrapy* Disallow: / User-agent: SemrushBot* Disallow: / User-agent: AwarioRssBot Disallow: / User-agent: AwarioSmartBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: SeekportBot Disallow: / User-agent: PetalBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: Moreover Disallow: / User-agent: ClaudeBot Disallow: /