Using the entropic model you seem to indicate (which I also favor), us vs them seems to be the lowest energy state.
It’s certainly possible to not be there at any given time, but seems to require a specific and somewhat unique set of circumstances, which are not the most energetically stable.
I think post malthusian trap its very possible to have enough resources for everyone and thus no reason to be an oppressor; from a cultural context you have books like the pedagogy of the oppressed which aims to educate one out of the goal of becoming the oppressor.