>We clearly won't reach AGI with the current LLM approaches, for example.
Have any evidence to back this up? Scaling laws seem to show we aren't near a plateau and it's not clear what kind of capability GPT-4,5 or 6 may have.
They’ve already been trained on orders of magnitude more text than a human being ever sees or hears in their entire life, without approaching human intelligence. What text is left to train them on?
> They’ve already been trained on orders of magnitude more text than a human being ever sees or hears in their entire life, without approaching human intelligence
Actually ChatGPT has an IQ of ~83, so that is quite close to average human intelligence.
Furthermore, it was trained only on digital text, arguably that would be it's only "sensory organ". It had no other senses with which to correlate terms and concepts it inferred from text, and look how amazing it is just from that.
As the other poster said, multimodal training is the next step and people are not going to be prepared for it.
How much visual, auditory, and sensory data have they been trained on? What "pain" have they experienced? There are a lot of input vectors that haven't been factored in yet, and a lot of external integration points that haven't been explored.
Have any evidence to back this up? Scaling laws seem to show we aren't near a plateau and it's not clear what kind of capability GPT-4,5 or 6 may have.