DualGauge: strongest models stay under 15 percent on secure and correct code
The point
Researchers present DualGauge, the first fully automated framework for jointly evaluating correctness and security of specification-only code generation. DualGauge-Bench has 307 coding tasks, each with functional and security tests from the same specification.
Why it matters
Builders cannot trust functional tests alone to show code is secure and correct.
Key details
- Evaluated 10 representative LLMs across Python, C++, and JavaScript
- Even the strongest model remained below 15% joint security-functionality success in every language
- Codex, OpenHands, and Claude Code were tested, and two failed to outperform a comparable direct model
Original ~6 min → 25 sec here Source: arXiv cs.AI, Oct 30, 2026