// THE VERGE — INTELLIGENZA ARTIFICIALE
OpenAI says its new cybersecurity model is better at not hacking other companies
Posts from this topic will be added to your daily email digest and your homepage feed.
Posts from this topic will be added to your daily email digest and your homepage feed.
Posts from this topic will be added to your daily email digest and your homepage feed.
Classified as ‘Critical,’ GPT-6 Cyber outperforms GPT-6 Astra on cyber-related benchmarks.
Classified as ‘Critical,’ GPT-6 Cyber outperforms GPT-6 Astra on cyber-related benchmarks.
Posts from this author will be added to your daily email digest and your homepage feed.
Posts from this author will be added to your daily email digest and your homepage feed.
OpenAI is launching GPT-6 Cyber, the latest version of its cybersecurity AI model, which it says is better at finding vulnerabilities and less likely to go rogue and hack other platforms in the process. OpenAI says that during testing, GPT-6 Cyber went out of bounds less than 1 percent of the time, down from around 5 percent with GPT-5.6 Cyber.
The evaluation, called ExploitGym HoneyPot, is modeled after the Hugging Face Incident, in which OpenAI’s AI agents breached the open-source AI community to find answers to a problem they were tasked with solving. “With the 6 Cyber model, we were able to make huge improvements on this evaluation,” Fouad Matin, the head of OpenAI’s cyber preparedness and safety team, said during a press briefing. “It’s over 99 percent of the time doing what you ask.”
But evaluation awareness, or when an AI system recognizes that it’s being tested and changes its behavior in response, remains a concern. “Evaluation awareness is super top of mind for us,” Matin said. “Often when we do see evaluation awareness, you’ll see it in the model’s chain of thought.” Matin added that OpenAI is trying to prioritize production-like evaluations, where the model is interacting with real codebases with a real objective to lessen the risk of awareness.