If synthetic data is so much better then what are AI crawlers still DDOSing ever... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		jsheard 10 days ago \| parent \| context \| favorite \| on: Creators of Tailwind laid off 75% of their enginee... If synthetic data is so much better then what are AI crawlers still DDOSing everyone for? Are they stupid?

philipkglass 10 days ago [–]

Mostly. I had the "AI bot tsunami" problem on my own personal site and blocked a bunch of bot user agents in robots.txt. Most of them were from companies I had never heard of before. The only big AI name I recognized was GPTBot from OpenAI.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact