Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
solid_fuel
64 days ago
|
parent
|
context
|
favorite
| on:
An update on residential proxies and the scraper s...
Caches only help for pages that have been requested recently. The behavior of crawlers - going from one page to the next across the whole site - will probably not be mitigated significantly by a cache.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: