Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Be careful with that. Users with screen readers may fall into your trap.


Could you have the content of the page explain that its a bot trap (so screen reader users know its not worth visiting) and only block if, say, an IP visits it multiple times in a short window?

Wouldn't block specialised scrapers as they would know to avoid that URL/link (though they'd probably work it out anyway), but would still limit more broad crawlers.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: