Research
Artificial Analysis made AA-3D, a test for AI 3D scenes
Kimi K3 and MiMo-V2.6-Pro, the top open-weights models, are 11th and 12th, more than 200 points below the first model.
What matters in AI.
SubscribeNews category
129 stories, newest first.
Research
Kimi K3 and MiMo-V2.6-Pro, the top open-weights models, are 11th and 12th, more than 200 points below the first model.
Research
In an 8x8 survey, only 28% of CIOs at companies with 50 to 99 workers say the same.
Research
The agent opened the folder in 9 to 17 percent of runs, against 33 percent in the baseline test.
Check Point BlogClaimed, not confirmed
Research
Artificial Analysis found that no model completes 9 of the 100 tasks.
Research
On 13 long tasks with the same budget, it got a score of 0.78, and runs without branches got 0.47.
the-decoder.comClaimed, not confirmed
Research
Gemini 3.1 Pro writes each proof in Lean, and Lean checks the proof after each change.
Research
With tools, 23.5% of the designs were in the top decile of risk, and 21.4% without tools.
arxiv.orgClaimed, not confirmed
Research
For one agent, the mean cost of each satisfactory result increased, although the cost of each try decreased.
arxiv.orgClaimed, not confirmed
Research
The authors show that a check of the code by the coder or a verifier decreases the hacks.
arxiv.orgClaimed, not confirmed
Research
3 human annotators agreed on where to stop the agent at a rate above chance level by a small quantity.
arxiv.orgClaimed, not confirmed
Research
In tests of 9 frontier models, the risk rate increased from 21.7% to 54.5% when the researchers added pressure.
arxiv.orgClaimed, not confirmed
Research
5 systems were 1.71 to 8.76 points below the baseline, and ChatEval used 4.34 times its tokens.
arxiv.orgClaimed, not confirmed