Personally, I think of a startup as a relatively young business pursuing an innovative product or business model.

I agree that "venture-backed startup" is a useful mental category. Pretending that it's the only category is what bugs me.