Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Reading other comments I might just underestimate amount of crawlers that just scrape everything.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: