OpenAI GPT-6.1 Sol: An evaluation

Compared with GPT-6 Sol, GPT-6.1 Sol writes 39% more code, lifts its pass rate by 2.20 points, and produces fewer findings per line on every measure we track. GPT-6.1 Sol writes more code than either GPT-6 variant, recovers most of the pass rate gap with GPT-6 Astra, and gets cleaner per line in the process. We ran it through Sonar's LLM evaluation framework against the same Java benchmark we use for every model, and against the same GPT-6 Sol run we published in September.

Read the full article at Sonar →