The CASI method gives a 3.51% increase in a 7-day test on 10% of traffic
CASI gives credit to each retrieval step when the system gives one reward for the full set.
Claimed, not confirmed
CASI is a method for models that make many retrieval steps together. The test was randomized and used 10% of traffic for 7-day in production. The CASI policy gave a 3.51% increase in the primary advertiser-value metric. One sensitivity test shows that CASI does not give more accurate results than the Singleton rule.
Sources
Posted