There are a lot of metaphors and "thought experiments" in that article. It shows how empty this whole debate is. No one is even near anything that could be called AGI. There's just a bunch of corporate savvy tech types getting a lot of money to run expensive labs by impressing people with chatbots and rendering algos.
I don't understand how the destruction of humanity follows from AGI. It feels like I'm missing a lot of assumptions that everybody takes for granted. Is this a Sci-fi meme? Can somebody fill me in?
It’s taken on a bit of a “second coming” vibe. Most likely IMO it will enable some power users to have even bigger impact and eliminate a whole bunch of work nobody wanted to do anyway. Perhaps similar to the advent of compilers in the era of writing assembly.
If you wanted to push humanity into extinction, then one way to do it is to get them tilting against fantasy threats like diamondoid super-viruses - while refusing to do any tangible work to end capitalism.
Capitalist hyperproduction is already 100% set to destroy us. But let's worry about the thing that doesn't exist, instead. And let's give capitalists even more power to handle the threat, while denying the realism of capitalism induced extinction
It's a little suspicious, right?
I'm not sure about your goals, Hollerith. But me, I would rather accept a 1% chance that fully automated communism can save us, rather than ignore the 100% chance that continued capitalism will delete us.
