Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
dredmorbius
on Jan 19, 2025
|
parent
|
context
|
favorite
| on:
Amazon's AI crawler is making my Git server unstab...
The most recent notice IA have blogged was in 2017, and there's no indication that the service has reversed course on robots.txt since.
<
https://blog.archive.org/?s=robots.txt
>
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
<https://blog.archive.org/?s=robots.txt>