Age | Commit message (Collapse) | Author | |
---|---|---|---|
2024-10-31 | robots.txt:Update for gptbot and google bard | Aaron Ball | |
2023-09-06 | robots:disallow all under /src | Aaron Ball | |
Seems they aren't paying attention... | |||
2023-09-06 | Make robots.txt a bit wider for git snapshots | Aaron Ball | |
2023-09-06 | Add robots.txt | Aaron Ball | |
This should stop amazonbot from trying to download every single snapshot of every single ref of every single repo hosted by cgit. :facepalm: |