[chore] More AI blocking (#3273)

This commit is contained in:
Daenney 2024-09-07 17:21:36 +02:00 committed by GitHub
parent 6ee540a503
commit 0e2ee857ac
No known key found for this signature in database
GPG key ID: B5690EEEBB952194

View file

@ -52,6 +52,7 @@ User-agent: GoogleOther
User-agent: GoogleOther-Image
User-agent: GoogleOther-Video
User-agent: GPTBot
User-agent: iaskspider/2.0
User-agent: ICC-Crawler
User-agent: ImagesiftBot
User-agent: img2dataset