There is work on rotation invariant CNNs, but I'm not sure why you would expect that property to just fall out of standard CNNs.

As much as architecture research gets denigrated these days, MLPs aren't what set off the revolution.