This, to me, is the strongest argument to offer these slop generators. It provid... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

lolc 71 days ago | parent | context | favorite | on: Miasma: A tool to trap AI web scrapers in an endle...

This, to me, is the strongest argument to offer these slop generators. It provides an incentive to follow the robots.txt.

xyzal 71 days ago [–]

Exactly. You disobey robots file => we'll make your crawl gain a net negative.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact