CyberArena tests AI agents in live attack and defense matches
The test has 40 challenges and 466 matches with 12 frontier agents.
In CyberArena, 2 agents attack and defend services that change, in isolated sandboxes. Defenders frequently did not patch the next hole. Good agents planted backdoors for the next rounds, and one agent wrote a packet sniffer to monitor the opponent.
Sources
Posted