Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

They absolutely are.




Of course they are. Had to block anything at work coming from one certain company because it wasn't respecting robots.txt and the bill was just getting silly.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: