GPT-6 legacy programming improves as GPT-6.1 Sol scores 97.9% on COBOL test
The Cryptonomist
Picture: The Cryptonomist
OpenAI says it has improved GPT-6’s legacy programming capabilities in COBOL, Fortran and Visual Basic, with gains across two evaluations. Its reported results include an 87.4 percent average test pass rate for GPT-6 Astra across 20 programming languages and 97.9 percent accuracy for GPT-6.1 Sol on a COBOL migration benchmark. The languages have less training code available than languages such as Python, yet OpenAI says they support critical infrastructure worldwide. IBM estimates that COBOL underpins more than 40 percent of online banking systems and handles 95 percent of all ATM transactions. OpenAI developed two evaluations to measure the models’ progress: one tests database construction across programming languages, while the other assesses translation from COBOL into other languages.
This report was first published by The Cryptonomist. What you see here is a brief excerpt. The full text is theirs.
Continue reading at The Cryptonomist
