I believe that the "investor class speculating" will either:

1) pass the (excessive) costs on to the property sales price

or:

2) not speculate (and not build the house)

The OP has chosen one of the possible ways to have a home to live, you either buy an existing one or buy a plot of land and build a new one on it.

Are there other ways that you can suggest?