arxivcs.LG2026-07-02
A More Accurate Algorithm Comparison through A/B Testing using Offline Evaluation Methods
Koki Konishi, Masataka Ushiku, Yuta Saito
A/B testing is the gold standard for selecting the better algorithm in online services. While offline evaluation has attracted attention as a safer alternative due to the high experimental costs and the potential risk of degrading user experience and revenue in A/B testing, it is…