Skill drift erases 52 to 93 percent of the gain in agent tests
Worst-case success is 5 to 13 points below the peak for each pair of agent and skill bank.
Researchers found that agents that train together with their skill banks become easy to damage when skills change after deployment. In 4 methods and 5 benchmarks, worst-case success was 5 to 13 points below the peak. This erased 52 to 93 percent of the gain.
Sources
Posted
