Great point, whole harnesses and concepts like "loops" are obsolete in a matter of months. I think it was just 6 months ago that the GPT-5.x models needed a harness with an edit tool that took arguments in the form of a diff, otherwise the model would have trouble editing any files. Flash forward to 3 months ago and the Claude models now skip the edit tool and use the bash tool with some `sed` command 90% of the time.
It's sort of like a "bitter lesson" for all of software. Attempting to polish our tools isn't very useful when the tools are themselves these fluid minds that get general upgrades every month, and now every couple weeks.
It's a fantasy but I wonder if you were to wave a magic wand and pause model releases for 10 years if some of these areas would develop their own depth.
It's sort of like a "bitter lesson" for all of software. Attempting to polish our tools isn't very useful when the tools are themselves these fluid minds that get general upgrades every month, and now every couple weeks.
It's a fantasy but I wonder if you were to wave a magic wand and pause model releases for 10 years if some of these areas would develop their own depth.