If you give me ANY idea of why you think my argument is stupid, we could actually discuss it?
My company is building an agentic layer in its product, google and the other hyperscalers do that too.
I already want to get rid of one person in my team because he was slow before but was able to contribute something, now I want to have his position as AI tokens.
you think 10% of the entire usa market is gonna go to anthropic and I'm supposed to somehow find a way with words for you to understand how stupid that sounds?
Prediction markets' business model is taking transaction fees from contracts between independent counterparties. Kalshi won't go bankrupt no matter how much you make there (though 'people' collectively will make negative [fees + taxes]).
I don't know why I seem to be the only one to wonder this but .. even if AI hypothetically can output smarter data to train a better AI, how do we know for sure this loop just goes on without eventually plateauing? What if what happens is just .. the data becomes more high definition, and then it's just the same iteration of the same "high" definition.
That is, however, the argument at its core. We don't know where RSI would lead. It could produce something roughly human-intelligent. It could produce something slightly smarter than a human. It could produce something radically, radically smarter than a human. We don't know. A lot of people suspect the correct scale would be a logarithmic one, which seems to conform to the pace of improvement being seen, but that's not something we know either.
It could also produce any of the above, but with a reasonably human architecture to the resulting intelligence, or an architecture radically divergent from ours. Although which of those is "better" or "worse" is a rather open question.
This is indeed part of the grand illusion in the field - that improvements in cognitive capabilities translate linearly into research progress. There are talks where experts report projections of RSI progress growing exponentially.
This is why AI companies use research in a deterministic and rigorous field (mathematics) as a benchmark - it creates the impression that humanity will achieve comparable progress in other fields.
Having said like, like for other fields (e.g. graphics), hardware capacity slowly increases, and new algorithms are devised, so there will hardly be a strict plateau.
I'm not implying that research progress will be necessarily very slow, but that it's severely misrepresented for sure.
It even seems to me that plateau-ing is an inevitability. Unless there is some way to reach AGI which you could deduce from a combination of ideas which already exist in the training dataset, but that seems rather unlikely.
The reality of "RSI" is just attempting to automate the jobs of people working on building/training LLMs - it's not about creating "smarter data". Much post-training nowadays doesn't even use data - it uses thousands of custom training environments for agents to attempt to do better in.
Digital eugenics, phrenology, etc. Humans constantly think they can identify a optimum fit function for humans in society. Because thats easier making a society optimum for everyone.
This is no different. Its like a single ant trying to redefine what a ant is. Typically with catastrophic results.
Yes, I'm quite confident that's what OpenAI is doing. These math proofs are just a side effect of them trying to create new data out of the blue for a better model. But that's still chasing a wild goose and hitting jackpots with 10,000 active agents, it doesn't necessarily prove RSI.
I think OpenAI's limitations are quickly verifiable results. 10,000 agents running in parallel aren't exactly talking to each other. They have a goal and one eventually hits the goal which can be automatically confirmed. This is why math is currently attacked, lean is easy to confirm A = B.
They aren't gonna create room temperature superconductors because they'll need a lab that can quickly, and verifiably, test superconductors at 10,000 per minute and that's just a physical limitation no matter how many datacenters you throw at it.
reply