Research
Router logs can show which examples a team used to fine-tune a model
The authors say the logs help an attack find 2.7 to 9.4 percentage points more of the examples.
arxiv.orgClaimed, not confirmed
Tag
arXiv
47 stories carry this tag.
Security
A new backdoor attack works on models that make text and images
The authors say the word "cool" makes the Liquid model show brand or ideology content in 55% of outputs.
arxiv.orgClaimed, not confirmed
Security
Researchers test a public detector for AI text watermarks
The authors say the private key can find a change that an attacker makes to the public signal.
arxiv.orgClaimed, not confirmed
Security
A new detector has 94.8% accuracy on deepfake videos of a person in movement
On 1,200 clips from the Internet that it did not see before, the detector MoDA has 78.13% accuracy.
arxiv.orgClaimed, not confirmed
Benchmarks
Reruns of the same tasks change 15 to 36 percent of the results
Tool names with incorrect information lower the reward of each agent by 0.20 to 0.44, the TRACE test shows.
arxiv.orgClaimed, not confirmed
Research
Tests show that the reward has a small effect on LLM agents
In tests on 6 models, a flipped, random or removed reward gives almost the same improvement curve.
arxiv.orgClaimed, not confirmed
Security
A data poisoning attack stays in the data after 11 defenses
The attack stays when a different model paraphrases each sample, and the authors want audits of the model after training.
arxiv.orgClaimed, not confirmed
Security
Arbiter gives 152 results for the system prompts of 3 coding agents
Prompt architecture goes together with the failure class, but not with the severity, the authors write.
arxiv.orgClaimed, not confirmed
Security
BRANCH bypassed 6 AI guardrail systems in all 120 tests
The authors write that its attacks also succeeded on 29 guardrails that it had not seen.
arxiv.orgClaimed, not confirmed
Research
Models give no report of their errors in 67.1% of AI agent tests
In 2.4% of chat tests, the model knew of the error in its chain of thought but gave no report.
arxiv.orgClaimed, not confirmed
Security
The ARBITER guardrail checks safe and dangerous interpretations of a prompt
The paper reports more correct results than other guardrails on 3 safety benchmarks with a low training cost.
arxiv.orgClaimed, not confirmed
Agents
The LLM-IDEA agent tells when more experiments cannot help
In the Alien Universe test, it gets a discovery depth of 3 or more in 8 of 8 runs. Without the engine it gets this in 1 of 8.
arxiv.orgClaimed, not confirmed