Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Scrapers still have an economic incentive to do what is easiest. Providing an alternative that is easier than fighting sysadmin blocks would likely cause them to take the easier route and make it less of a cat and mouse game for sysadmins.


Scrapers have an incentive to take all data.

If you put some data in a central repository, they will take it.

Then they will go and DDoS the rest of the Internet in order to take all the rest of the data.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: