Research
GPT-6-astra withdraws the claims of authors when it rewrites papers
The researchers say that less than 1 in 10 of the claims that GPT-6-astra withdraws are overstated.
arxiv.orgClaimed, not confirmed
Tag
arXiv
351 stories carry this tag.
Benchmarks
HarmBench does not measure one safety attribute, researchers find
3 of the 4 datasets that can target harmful refusal are saturated and cannot show differences between models.
arxiv.orgClaimed, not confirmed
Research
Researchers make TypedBench, a test for typed decision models
The hosted model follows its policy, but it is sensitive to wording and underconfident.
arxiv.orgClaimed, not confirmed
Research
A local model is equal to hosted models for 4 of 5 call sites
The authors tell that 2 hosted call sites give the same live result for 28% of the spend.
arxiv.orgClaimed, not confirmed
Agents
AgentMemGate keeps plans out of the memory of AI assistants
The authors tell that, with the gate, 95% of tasks are correct, not 65%.
arxiv.orgClaimed, not confirmed
Security
A rule monitor found about 70% of attacks on AI agents in a test
The authors tell that the monitor also gave an alarm for 29.3% of safe runs.
arxiv.orgClaimed, not confirmed
Security
An attack on world models can give robots dangerous policies
The authors put malicious prompts in data that looks safe, and the attack works only after a world model uses the data.
arxiv.orgClaimed, not confirmed
Security
A guardrails proxy increases injection recall from 25.0% to 94.5%
The authors found a false-positive rate of 0.1%, and the system limits the model to a closed set of commands.
arxiv.orgClaimed, not confirmed
Research
Only 0.7% of agent episodes in a hard test have no safety event
The authors found 12.3 times more collisions in real-time tests than in static tests. The agents completed 91% to 94% of the tasks.
arxiv.orgClaimed, not confirmed
Research
A test with 222 tasks shows that agents do not keep to a set time
The authors found a typical error of 2.9 times for Fable 5.1 in Claude Code, but only 1.2 times for GPT-6 Astra in Codex.
arxiv.orgClaimed, not confirmed
Security
A new attack agent goes around the guardrails of 4 AI models
The researchers find a success rate of more than 95% for the attack.
arxiv.orgClaimed, not confirmed
Research
Agents in a multi-agent system start to have the same behavior
2 easy methods to add diversity did not decrease the risk.
arxiv.orgClaimed, not confirmed