Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Is it ethical to scrape from a scraper?


Is it ethical to scrape from a service you DO pay for, instead of using their API or other interface?


Ethical at least requires respecting robots.txt.


If robots.txt said to jump off a bridge, would your spider do it?


Who watches the watchmen?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: