Compute
A test of 86 open-weight models shows large differences in energy use
Thinking mode uses about 3.7 times more energy on average. FP8 uses about one quarter less energy with a small change in score.
What matters in AI.
SubscribeTag
164 stories carry this tag.
Compute
Thinking mode uses about 3.7 times more energy on average. FP8 uses about one quarter less energy with a small change in score.
Research
The errors add up with each turn of the chat, also when the model first gives the correct result.
arxiv.orgClaimed, not confirmed
Research
The authors write that this is correct only when the model has sufficient turns. The limit on messages gives incorrect low scores.
Security
On a medical test, COMPASS has 0.64 AUC and the strongest baseline stays at chance level.
arxiv.orgClaimed, not confirmed
Security
TARS removes sentences that have a strong effect on the output. The steps stay easy to read. The defense is not easy to find.
Security
A prompt-based safety layer cut the success rate of a strong baseline attack from 0.896 to 0.608.
arxiv.orgClaimed, not confirmed
Security
The attack gets the medical history of a target user in a maximum of 65% of the target chats.
arxiv.orgClaimed, not confirmed
Security
TRAP uses only black-box access to the target model. A reinforcement-learning policy selects an attack strategy from a tree of strategies.
Agents
The method uses no weight update and no answer label. It does improve the baseline harness on 6 benchmarks.
Security
Kairos is a monitor that holds an effect that is not clear. It holds the effect until the next steps show if it is safe. The agent keeps its utility.
Research
After 8 steps, LQET cut the change in log-odds by 89 to 91 percent in tests on Qwen3-4B and Phi-4-mini.
arxiv.orgClaimed, not confirmed
Research
On SWE-Bench-Verified, models that train on top-ranked trajectories get more points than models that train on random trajectories.
arxiv.orgClaimed, not confirmed