This can never match the scale of organic training data

theappsecguy · 2026-01-07T18:02:44 1767808964

Or quality

jacooper · 2026-01-07T19:11:43 1767813103

Actually synthetic training dats is better, thats why the new models are all better at design.

jsheard · 2026-01-07T19:33:55 1767814435

If synthetic data is so much better then what are AI crawlers still DDOSing everyone for? Are they stupid?

philipkglass · 2026-01-07T23:11:33 1767827493

Mostly. I had the "AI bot tsunami" problem on my own personal site and blocked a bunch of bot user agents in robots.txt. Most of them were from companies I had never heard of before. The only big AI name I recognized was GPTBot from OpenAI.