cdransf/ai.robots.txt
cdransf/ai.robots.txt
1
1
Fork 0
mirror of https://github.com/ai-robots-txt/ai.robots.txt.git synced 2025-08-24 14:21:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions1
157 commits 3 branches 40 tags 1.8 MiB
Commit graph

157 commits

Author SHA1 Message Date
Chenghao Mou
fbebbbfefb restore files deleted by failed workflow 2024-08-07 12:02:50 +01:00
dark-visitors
6a275366be Daily update from Dark Visitors 2024-08-07 10:50:45 +00:00
Chenghao Mou
09c6b78b46 fix job dependency 2024-08-07 11:45:37 +01:00
ai.robots.txt
d4f34363ec Removing previously generated files 2024-08-07 10:40:50 +00:00
ai.robots.txt
30eaff1447 call main after update 2024-08-07 10:32:13 +00:00
ai.robots.txt
bd3eee7a30 Removing previously generated files 2024-08-07 10:32:12 +00:00
Chenghao Mou
944bee0f56 call main after update 2024-08-07 11:31:58 +01:00
dark-visitors
cebf809391 Daily update from Dark Visitors 2024-08-07 00:14:26 +00:00
ai.robots.txt
3d4bf2c3db restore original robots.json 2024-08-06 18:50:54 +00:00
ai.robots.txt
d6a5e8cd81 Removing previously generated files 2024-08-06 18:50:53 +00:00
Chenghao Mou
4cf82b703f restore original robots.json 2024-08-06 19:50:38 +01:00
Chenghao Mou
0b6eba8dd5 skip push if no change 2024-08-06 19:41:38 +01:00
Chenghao Mou
379c339f97 skip push if no change 2024-08-06 19:41:38 +01:00
Chenghao Mou
01edb6c78c
 		Merge branch 'ai-robots-txt:main' into main 2024-08-06 19:35:03 +01:00
Chenghao Mou
2a3685385c restrict scope 2024-08-06 19:33:49 +01:00
Cory Dransfeldt
85275e55b8
 		Merge pull request from glyn/addfaq 
Add FAQ
 2024-08-06 11:15:29 -07:00
Chenghao Mou
8c6482fb45 restore the cron 2024-08-06 18:12:41 +01:00
dark-visitors
63c7e742c3 Daily update from Dark Visitors 2024-08-06 16:54:29 +00:00
Chenghao Mou
55e92f4324 update existing ones 2024-08-06 17:48:06 +01:00
Chenghao Mou
52d54cf127 restore the cron 2024-08-06 17:28:07 +01:00
dark-visitors
fdd261dad4 Daily update from Dark Visitors 2024-08-06 16:27:02 +00:00
ai.robots.txt
6d2285f5e0 Add FAQ 2024-08-06 16:21:01 +00:00
ai.robots.txt
83d9397f17 Removing previously generated files 2024-08-06 16:21:00 +00:00
Glyn Normington
b4d25bf0cb Add FAQ 2024-08-06 17:20:26 +01:00
Chenghao Mou
8ab1e30a6c test workflow 2024-08-06 17:12:26 +01:00
Chenghao Mou
192bf67631 add dark visitor workflow 2024-08-06 17:02:23 +01:00
ai.robots.txt
e12ddc0f42 Merge pull request from jbowdre/dev 
only build on changes to robots.json
 2024-08-06 15:44:54 +00:00
ai.robots.txt
b54e274bbc Removing previously generated files 2024-08-06 15:44:53 +00:00
Cory Dransfeldt
3e91a84d11
 		Merge pull request from jbowdre/dev 
only build on changes to robots.json
 2024-08-04 16:04:59 -07:00
John Bowdre
b0a93aeb70 only build on changes to robots.json 2024-08-04 17:45:18 -05:00
ai.robots.txt
eb924b9856 Merge pull request from jsheard/patch-2 
Add Cloudflares first-party scraper blocking to FAQ
 2024-08-04 21:54:17 +00:00
ai.robots.txt
1cfc071498 Removing previously generated files 2024-08-04 21:54:16 +00:00
Cory Dransfeldt
24c3509a6e
 		Merge pull request from jsheard/patch-2 
Add Cloudflares first-party scraper blocking to FAQ
 2024-08-04 14:54:06 -07:00
ai.robots.txt
c2f177870f Merge pull request from jsheard/patch-1 
Fix Imagesift user agent
 2024-08-04 21:53:48 +00:00
ai.robots.txt
0072b8f5f0 Removing previously generated files 2024-08-04 21:53:47 +00:00
Cory Dransfeldt
9c7257e7cf
 		Merge pull request from jsheard/patch-1 
Fix Imagesift user agent
 2024-08-04 14:53:36 -07:00
Joshua Sheard
8dbbdbf44c
 		Add Cloudflares first-party scraper blocking to FAQ 2024-08-04 21:38:02 +01:00
Joshua Sheard
146fd4ffba
 		Fix Imagesift user agent 2024-08-04 21:33:04 +01:00
ai.robots.txt
c7b781034e chore: restore FriendlyCrawler + ImageSift 2024-08-04 19:29:01 +00:00
ai.robots.txt
9a8fa66772 Removing previously generated files 2024-08-04 19:29:00 +00:00
Cory Dransfeldt
1ca936ce11
 		chore: restore FriendlyCrawler + ImageSift 2024-08-04 12:28:48 -07:00
ai.robots.txt
8de5bc8e01 Merge pull request from mirium999/add_icc_crawler 
Add ICC-Crawler
 2024-08-04 01:21:56 +00:00
ai.robots.txt
8c632e1ba4 Removing previously generated files 2024-08-04 01:21:55 +00:00
Adam Newbold
8d4d52cdab
 		Merge pull request from mirium999/add_icc_crawler 
Add ICC-Crawler
 2024-08-03 21:21:45 -04:00
Mirium999
5826c18909 Add ICC-Crawler 2024-08-04 10:11:25 +09:00
ai.robots.txt
ffbad453f3 Merge pull request from nisbet-hubbard/patch-5 
Add last line of defence to FAQ
 2024-08-03 14:27:47 +00:00
ai.robots.txt
b1907d86be Removing previously generated files 2024-08-03 14:27:46 +00:00
Cory Dransfeldt
55c585e9e3
 		Merge pull request from nisbet-hubbard/patch-5 
Add last line of defence to FAQ
 2024-08-03 07:27:37 -07:00
nisbet-hubbard
2b56c72bac
 		Update FAQ.md 2024-08-03 14:27:25 +08:00
nisbet-hubbard
b24e5cb3bb
 		Update FAQ.md 2024-08-03 14:12:50 +08:00