Small AI models suit short agent tasks, and large models long tasks
The researchers measure energy, cost and time for each completed task, not for each call.
A pilot study of 15 open-weight models, from 0.6B to 27B parameters, found that the model that uses the minimum energy for each completed task changes with task length. For short tasks, small models are good. For long tasks, large models are good.
Sources
Posted
