Loading market data...

GCSA Agent Achieves 91.3% Success Rate on CyberGym Security Benchmark

GCSA Agent Achieves 91.3% Success Rate on CyberGym Security Benchmark

A new AI security agent has posted a 91.3% success rate on CyberGym, a real-world cybersecurity benchmark developed by UC Berkeley. The result places GCSA Agent in the benchmark's 'Leading Systems Above 90%' category, a tier that signals near-human performance on complex vulnerability discovery tasks.

What CyberGym measures

CyberGym isn't a toy test. It's a large-scale evaluation framework built from 1,507 historical real-world vulnerability test cases spanning 188 major software projects. The benchmark's Level 1 evaluation forces an AI agent to work autonomously through the entire vulnerability research process: code analysis, locating the flaw, reasoning about attack paths, constructing a proof-of-concept, and executing it for validation. Success is strict — the agent must trigger the vulnerability in the vulnerable version of the software but not in the patched version.

That's a tall order. It's one thing to recognize a known pattern; it's another to actually exploit a real bug in a real codebase without crashing the patched build.

Why the result matters

GCSA Agent ran on Grok 4.5 and Grok 4.6 models during the evaluation. The fact that it hit 91.3% on those models points to something bigger than raw model power. The result indicates that the underlying large language model alone doesn't determine a system's ultimate security capabilities. Agentic security workflows — the structured processes that guide how the model thinks and acts — are just as crucial.

In other words, a smarter model doesn't automatically make a better security agent. The way the agent is built to plan, collect evidence, and verify its own work matters enormously.

Inside the agent's workflow

GCSA Agent is built around an agentic security workflow designed to support end-to-end vulnerability research. That means it doesn't just spit out a guess. It formulates hypotheses, gathers runtime evidence, and runs reproducible validation checks. This structured approach is what lets the agent move from spotting a suspicious line of code to proving that the vulnerability actually exists and can be triggered.

The workflow is also built for the full security lifecycle, not just discovery. GCSA's stated aim is to develop AI Security Agents that can operate in real-world cybersecurity environments and participate in everything from vulnerability discovery to remediation.

Beyond the benchmark

CyberGym research has already shown that AI agents can do more than pass tests. They've identified previously unknown zero-day vulnerabilities and found historical security patches that didn't fully resolve the underlying flaws. That's a significant finding for an industry that still relies heavily on human researchers to catch what automated scanners miss.

The 91.3% score is a snapshot, but the broader trajectory is clear: agentic security systems are moving from lab experiments to practical tools. The next question isn't whether they can find bugs — it's how fast they'll be deployed in real security operations.