totally agreed on the "focus" aspect of it
that is why i was so happy about composer models from cursor when they came out but they werent very great
imagine opsu 5.5 level models at those speeds and faster.
yeah very true. I asked Opus 5.5 max if even such a thing is possible and it thought so, albeit after a lot of hurdles, especially memory related ones being overcome.
I think you are right and I think we are close to that speed, with codex ultrafast we are near 500 TPS but only with Astra and that is not financially viable. I would guess we will have wide spread near 1000 TPS with 6.1 sol level model with enough usage to, without worry, do the kind of things you describe in about 6 months max
hard part being the ideation is very true. i struggle with this all the time. even meditate on it for hours. but I think it is an important muscle to practice these days
I can understand how you might feel that way. this was the name of one of the first text to image apps I built 4 years ago with one of world's first auto prompt enhancement with a fine tuned currie model