What matters in AI.

Subscribe

A separate answer call follows new evidence 29.9 to 60.6 points more

Continued thinking gives the stale result again in most conflicts.

Researchers did a test of 3 model families, gpt-oss, Gemma4 and Qwen3, on HotpotQA and MuSiQue. Each model had a reasoning trace, which is the written steps of its thinking, and evidence that was different from it. When a separate call gave the answer, the model followed the current evidence 29.9 to 60.6 points more than when it continued its thinking.

Sources

  1. When Reasoning Traces Conflict with Evidence: How Answer Configuration Shapes Evidence Followingarxiv.org
AI MATTER · NEWS · AI MATTER · NEWS ·16 OCT2026

Posted

Tags

More in Research

All Research news