I've been developing a suspicion that many people simply aren't looking at what their agents produce and can't speak to the quality of it in a fully informed way.
For context, I've set up harnesses with recursive automated review loops, spec driven development, explicit lists, better models, better harnesses, formal methods tooling, etc. All of it helps, but they don't eliminate output issues. Those become very apparent when I go through the slow, manual work of deeply comprehending / validating LLM code.
And that leads me to one of three conclusions. Either my standards are achievable only by hyperintelligent programming gods, I have a skill issue using LLMs, or others aren't applying the same level of attention.
The first is obviously untrue. I meet my own standards and I'm an idiot. The second seems unlikely because I can see my competent coworkers and well-regarded people in the community discussing the same issues. So that leaves the third.
If you assume that programmers’ skills follows a bell curve, the typical output will not be better than the average. And that leads directly into your third conclusion: average programmers just do not put in the effort. That’s literally part of what makes them average.
Unfortunately most people just treat it as a job. And indeed, it is a job for most people. Not all farmers love gardening and all in their free time. It's just a livelihood. For me I like programming but honestly for my job I can't be assed to do it by hand anymore. It looks good enough, screw it, it's not like they pay me extra to produce handwritten code. When the whole org is pushing down this one path you know it's time to dgaf
For context, I've set up harnesses with recursive automated review loops, spec driven development, explicit lists, better models, better harnesses, formal methods tooling, etc. All of it helps, but they don't eliminate output issues. Those become very apparent when I go through the slow, manual work of deeply comprehending / validating LLM code.
And that leads me to one of three conclusions. Either my standards are achievable only by hyperintelligent programming gods, I have a skill issue using LLMs, or others aren't applying the same level of attention.
The first is obviously untrue. I meet my own standards and I'm an idiot. The second seems unlikely because I can see my competent coworkers and well-regarded people in the community discussing the same issues. So that leaves the third.