Hacker News new | past | comments | ask | show | jobs | submit login

Off topic, but how does this work? How can the crawlers bypass the paywall?



They explicitly allow eg the Google crawler. Not sure about others.


Oh ok! Thx for explanation




Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: