Security
BRANCH bypassed 6 AI guardrail systems in all 120 tests
The authors write that its attacks also succeeded on 29 guardrails that it had not seen.
arxiv.orgClaimed, not confirmed
Tag
arXiv
351 stories carry this tag.
Research
Models give no report of their errors in 67.1% of AI agent tests
In 2.4% of chat tests, the model knew of the error in its chain of thought but gave no report.
arxiv.orgClaimed, not confirmed
Security
The ARBITER guardrail checks safe and dangerous interpretations of a prompt
The paper reports more correct results than other guardrails on 3 safety benchmarks with a low training cost.
arxiv.orgClaimed, not confirmed
Agents
The LLM-IDEA agent tells when more experiments cannot help
In the Alien Universe test, it gets a discovery depth of 3 or more in 8 of 8 runs. Without the engine it gets this in 1 of 8.
arxiv.orgClaimed, not confirmed
Research
The ReCast method finds the step that starts an agent failure
ReCast is 5.65 and 9.19 percentage points above the top baseline on 2 Who&When tests.
arxiv.orgClaimed, not confirmed
Research
Rules that do not apply in a context file lower the compliance of a model
The authors show that a file with all instructions that help can give a lower total value than a subset.
arxiv.orgClaimed, not confirmed
Research
A new test checks if AI tools find logical errors in papers
The authors put errors in conference papers and show that the systems that check papers are weak against adversarial manipulation.
arxiv.orgClaimed, not confirmed
Research
A new refinement step helps 6 methods of low-bit quantization
The method changes only the integer codes of the weights and adds no inference overhead.
arxiv.orgClaimed, not confirmed
Research
A memory filter cuts the failure rate of an agent by 8.8 percentage points
The paper reports that the 2 filters cause more personalization failures.
arxiv.orgClaimed, not confirmed
Compute
RaReCache lets a small model prefill the cache for a large model
The authors write that the large model keeps 95 to 99% of its precision when it recomputes only 30% of positions.
arxiv.orgClaimed, not confirmed
Security
6 lines of log text give a guardrail a fail-open rate of 63%
Because a deterministic rule was 100% correct on all 6 policies, the model is not necessary.
arxiv.orgClaimed, not confirmed
Benchmarks
An evolved verifier had 0.21 more held-out agreement on MBPP+
Without its guards, the verifier always passes, but the skills that it trains are as good.
arxiv.orgClaimed, not confirmed