Commit graph

10 commits

Author SHA1 Message Date
ai.robots.txt
dd1ed174b7 Merge pull request from ai-robots-txt/google-cloudvertexbot
chore(robots.json): adds Google-CloudVertexBot
2025-05-16 11:35:15 +00:00
ai.robots.txt
1c470babbe Merge pull request from joehoyle/patch-1
Fix JSON syntax error
2025-05-15 16:12:30 +00:00
ai.robots.txt
c6c7f1748f Update from Dark Visitors 2025-04-26 00:55:12 +00:00
ai.robots.txt
4654e14e9c Merge pull request from maiavixen/main
Fixed meta-external* being titlecase, and removed period for consistency
2025-04-24 07:00:34 +00:00
ai.robots.txt
bbec639c14 Merge pull request from dennislee1/patch-1
AI bots to consider adding
2025-04-22 14:50:26 +00:00
ai.robots.txt
e0cdb278fb Update from Dark Visitors 2025-04-16 00:57:11 +00:00
ai.robots.txt
4a764bba18 Merge pull request from ai-robots-txt/imgproxy-bot
chore(robots.json): adds imgproxy crawler
2025-04-10 19:22:34 +00:00
Frederic Barthelemy
5f5a89c38c
Fix html-mangled hyphen in Perplexity-Users
Fixes: 
2025-04-04 17:34:14 -07:00
ai.robots.txt
6851413c52 Merge pull request from ThomasLeister/feature/implement-nginx-configuration-snippet-export
Implement Nginx configuration snippet export
2025-03-27 19:49:15 +00:00
Thomas Leister
4f3f4cd0dd
Add assembled version of nginx-block-ai-bots.conf file 2025-03-27 12:43:36 +01:00