I find the distinction between AGI and ASI to be a red herring. In my mind, we humans already have enough intelligence to basically solve any problem given enough time and a 'scratch pad'. It's sort of like Turing-completeness but for intelligence.
Saying that a computer exhibits artificial-SUPER-intelligence feels a little like saying that one universal Turing machine is more expressive than another universal Turing machine. The thing that sets the two Turing machines apart is not how expressive they are but how quickly and efficiently they can arrive at the given output.
It's hard for me to imagine a task that ASI could complete which a human with enough time and determination couldn't also complete, although I can imagine such tasks for dogs which don't exhibit the same level of intelligence as humans. Maybe I'm too human-centric and naive. Maybe there are other tasks out there that are beyond human intelligence even given infinite time.
If, however, my view of intelligence is correct, then the distinction between ASI and AGI is illusory, and the real distinction that we would see between systems is just their speed, efficiency, determination, etc.
In my mind, once we achieve AGI, we immediately have ASI: just run that AGI on a faster computer, across many nodes, etc. Instead of having humans solve quantum gravity over the next 1000 years, just have AGI solve it over the next month.
Saying that a computer exhibits artificial-SUPER-intelligence feels a little like saying that one universal Turing machine is more expressive than another universal Turing machine. The thing that sets the two Turing machines apart is not how expressive they are but how quickly and efficiently they can arrive at the given output.
It's hard for me to imagine a task that ASI could complete which a human with enough time and determination couldn't also complete, although I can imagine such tasks for dogs which don't exhibit the same level of intelligence as humans. Maybe I'm too human-centric and naive. Maybe there are other tasks out there that are beyond human intelligence even given infinite time.
If, however, my view of intelligence is correct, then the distinction between ASI and AGI is illusory, and the real distinction that we would see between systems is just their speed, efficiency, determination, etc.
In my mind, once we achieve AGI, we immediately have ASI: just run that AGI on a faster computer, across many nodes, etc. Instead of having humans solve quantum gravity over the next 1000 years, just have AGI solve it over the next month.