People laugh, but it is impressive how often this has to be said, and how often it is ignored.
I'm still waiting for the media juggernauts to start beasting on the american hypescalers due to all the theft going around. I know for a fact that both Anthropic and OpenAI had access to some private github repos of mine in the past (due to clear artifacting in their training set). The thing is, they make so much money (allegedly), so they cannot be wrong (unlike the chinese). And this does not take into account all the hacking and system intrusion facilitated (and often perpetrated) by their systems!
It means some networked devices in there are being remotely piloted to tunnel network traffic to somewhere else. This scenario usually happens with more "unprofessional" ISPs, which sell bandwidth from their networked clients for people in need of such services.
Such as ignoring web scraping countermeasures, and DDoS.
The thing is one could argue most of the improvements were regressions to previous paradigms. Windows 10 was improved by being less like Windows 8 and more like the classic desktops of the 90s.
In other words, change for the sake of change does not an improvement make.
> I wonder how long it'll take people like you breathlessly chanting "this is the future!" before the slop bots hoover that up into their training data like narcissistic poison
This is a real risk. The copyright washing machine is an average of our collective "spoken consciousness", and in turn it influences the way we express ourselves, then it ends up inside the next training slopdate. Real organic human reasoning will eventually be as valuable as low-alpha steel was for a long time, at least till the background levels drop. AI businesses are raiding libraries for "sunken knowledge", the similarity is uncanny.
There's also that paper "DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression" which got released some time ago. My take is the breakthroughs got quickly implemented and helped drive the inference prices down.
reply