It kind of reminds me of the solar power chart that one institute made where every year they predict that growth will definitely flatten from here on out and every year it fails to do so.
I don't have any reason to expect LLMs to be flattening or for the technology to be capped out. In fact, I have a lot of reasons to believe the opposite such as the plethora of papers and proposed techniques that haven't even been attempted at scale. (QuietSTaR my beloved, you will have your day.) It just doesn't look like a mature technology, rather the opposite. So my baseline assumption, on that evidential basis, is that number keeps going up, and if this prediction results in a strange-looking future then that says more about my taste than about the prediction.
The question though is the rate of growth. To get the kind of “end of scarcity AGI” advertised by Sam Altman probably requires continuous over year exponential growth. Will that happen in the normal course of LLM research? Or will it be more gradual, and the exponential growth will come from future paradigm shifts. I’m arguing the second.
I don't have any reason to expect LLMs to be flattening or for the technology to be capped out. In fact, I have a lot of reasons to believe the opposite such as the plethora of papers and proposed techniques that haven't even been attempted at scale. (QuietSTaR my beloved, you will have your day.) It just doesn't look like a mature technology, rather the opposite. So my baseline assumption, on that evidential basis, is that number keeps going up, and if this prediction results in a strange-looking future then that says more about my taste than about the prediction.