This point of view is essentially codified in effective field theory, which tells us why so much of classical physics (EM, fluids, gravity) can be seen as low order approximations of some more complete theory that we found later on. One of the great insights from 20th century physics imo.