mirror of
https://github.com/ai-robots-txt/ai.robots.txt.git
synced 2025-06-21 18:50:51 +00:00
Compare commits
No commits in common. "9659c88b0c8f58fdc860c95d52899fefb0f0bea3" and "9a9b1b41c08de96dd01eee3bc0063a2d9831d4e7" have entirely different histories.
9659c88b0c
...
9a9b1b41c0
1 changed files with 1 additions and 8 deletions
|
@ -35,14 +35,7 @@ Note that, as stated in the [httpd documentation](https://httpd.apache.org/docs/
|
|||
```
|
||||
(Note that the path of the `haproxy-block-ai-bots.txt` may be different in your environment.)
|
||||
|
||||
|
||||
[Bing uses the data it crawls for AI and training, you may opt out by adding a `meta` tag to the `head` of your site.](./docs/additional-steps/bing.md)
|
||||
|
||||
### Related
|
||||
|
||||
- [Robots.txt Traefik plugin](https://plugins.traefik.io/plugins/681b2f3fba3486128fc34fae/robots-txt-plugin):
|
||||
middleware plugin for [Traefik](https://traefik.io/traefik/) to automatically add rules of [robots.txt](./robots.txt)
|
||||
file on-the-fly.
|
||||
[Bing uses the data it crawls for AI and training, you may opt out by adding a `meta` tag to the `head` of your site.]((./docs/additional-steps/bing.md))
|
||||
|
||||
## Contributing
|
||||
|
||||
|
|
Loading…
Add table
Add a link
Reference in a new issue