What matters in AI.

Subscribe

An open-weight model gets the same score as closed models at a low cost

The authors write that this is correct only when the model has sufficient turns. The limit on messages gives incorrect low scores.

Open-weight model matched closed models at under a tenth of the cost Among 26 models tested, an open-weight model matched the strongest closed ones at under a tenth of the cost, given enough turns. Ten grey squares stand for the closed model cost; one small red square stands for the open-weight cost. 26 models tested 19 open-weight 7 closed less than 1/10 the cost Closed model cost Open-weight model cost Same reward. Given enough turns.
Among 26 models tested, an open-weight model matched the strongest closed ones at under a tenth of the cost, given enough turns.

Sources

  1. Unconstrained CTI-REALM with Open-Weightsarxiv.org
AI MATTER · NEWS · AI MATTER · NEWS ·14 OCT2026

Posted

Tags

Learn the terms in this story

Guides for this story

More in Research

All Research news