Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

That's an amusing example.

You are aware that Google scrapes almost every page on the internet, without having any agreement with most of them, right?

Yes, you can add noindex and robots.txt to tell them you'd like to opt-out, but:

a) That only works so well, and b) they're default is to use your page without your permission.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: