In which local LLMs fail dismally to produce working code, where “frontier” commercial models do just fine:

The big iron models seem to be doing an ok job. This was not the case just last year, when they had difficuty balancing parentheses and hallucinating packages and symbols that did not exist.

The local models are a different story. […]