Isn't this just an effect of what the LLMs are RL'ed for? Solving short-horizon tasks.

I assume one can't benchmaxx multi-year long efforts, clean architecture, taste etc as easily as these "make tests pass" tasks