mirror of
https://github.com/ai-robots-txt/ai.robots.txt.git
synced 2025-06-19 10:00:52 +00:00
parent
b35f9a31d7
commit
3efabc603d
6 changed files with 6 additions and 3 deletions
|
@ -52,6 +52,7 @@ User-agent: PerplexityBot
|
|||
User-agent: PetalBot
|
||||
User-agent: PhindBot
|
||||
User-agent: QualifiedBot
|
||||
User-agent: SBIntuitionsBot
|
||||
User-agent: Scrapy
|
||||
User-agent: SemrushBot-OCOB
|
||||
User-agent: SemrushBot-SWA
|
||||
|
|
Loading…
Add table
Add a link
Reference in a new issue