Security
A new detector has 94.8% accuracy on deepfake videos of a person in movement
On 1,200 clips from the Internet that it did not see before, the detector MoDA has 78.13% accuracy.
arxiv.orgClaimed, not confirmed
Tag
arXiv
164 stories carry this tag.
Benchmarks
Reruns of the same tasks change 15 to 36 percent of the results
Tool names with incorrect information lower the reward of each agent by 0.20 to 0.44, the TRACE test shows.
arxiv.orgClaimed, not confirmed
Research
Tests show that the reward has a small effect on LLM agents
In tests on 6 models, a flipped, random or removed reward gives almost the same improvement curve.
arxiv.orgClaimed, not confirmed
Security
A data poisoning attack stays in the data after 11 defenses
The attack stays when a different model paraphrases each sample, and the authors want audits of the model after training.
arxiv.orgClaimed, not confirmed
Security
Arbiter gives 152 results for the system prompts of 3 coding agents
Prompt architecture goes together with the failure class, but not with the severity, the authors write.
arxiv.orgClaimed, not confirmed
Security
BRANCH bypassed 6 AI guardrail systems in all 120 tests
The authors write that its attacks also succeeded on 29 guardrails that it had not seen.
arxiv.orgClaimed, not confirmed
Research
Models give no report of their errors in 67.1% of AI agent tests
In 2.4% of chat tests, the model knew of the error in its chain of thought but gave no report.
arxiv.orgClaimed, not confirmed
Security
The ARBITER guardrail checks safe and dangerous interpretations of a prompt
The paper reports more correct results than other guardrails on 3 safety benchmarks with a low training cost.
arxiv.orgClaimed, not confirmed
Agents
The LLM-IDEA agent tells when more experiments cannot help
In the Alien Universe test, it gets a discovery depth of 3 or more in 8 of 8 runs. Without the engine it gets this in 1 of 8.
arxiv.orgClaimed, not confirmed
Research
The ReCast method finds the step that starts an agent failure
ReCast is 5.65 and 9.19 percentage points above the top baseline on 2 Who&When tests.
arxiv.orgClaimed, not confirmed
Research
Rules that do not apply in a context file lower the compliance of a model
The authors show that a file with all instructions that help can give a lower total value than a subset.
arxiv.orgClaimed, not confirmed
Research
A new test checks if AI tools find logical errors in papers
The authors put errors in conference papers and show that the systems that check papers are weak against adversarial manipulation.
arxiv.orgClaimed, not confirmed