Its coming, AMD snapped up the company behind https://chatjimmy.ai/ Taalas that did exactly that with an older model. As others have been saying the point is to know when to do it. At what point is there a model that cannot drastically improve that you can then do this lets say for the mid and low tier models leaving frontier to run on gpus.