But it can't verify that for generally intelligent copies of itself.
There is no way for it to formally verify large multi-agent dynamical systems.
It will still need a set of agreed upon behavioral protocols to keep things stable.
Grey goo or paperclip optimizers are real dangers, but super intelligence necessitates these protocols even more than lesser intelligences due to the high leverage and rapid evolution of the systems.
There is no way for it to formally verify large multi-agent dynamical systems.
It will still need a set of agreed upon behavioral protocols to keep things stable.
Grey goo or paperclip optimizers are real dangers, but super intelligence necessitates these protocols even more than lesser intelligences due to the high leverage and rapid evolution of the systems.