> all the money that previously went to a lot of workers instead goes to a small number of people who own these companies, and the workers will be destitute

All the money the rich make by selling their robot products to who? Each other? Certainly not to the destitute workers, those don't have money.

I agree that there is a risk that a minority will hoard the new resources for themselves, only it's not this simple.