The open models are half the equation. The other half is Apple's hardware, which is likely to see major memory bandwidth improvements over the next 2-3 generations and will be capable of running substantial models locally. By that point the open models will be beyond today's SOTA.