arxivcs.ROcs.AI2026-07-10
Robo-ValueRL: Reliable Value Estimation for Offline-to-Online Reinforcement Learning
Wenke Xia, Pei Ren, Wenbo Yu, Yizhuo Zhang, Jifan Li, Yixue Zhang, et al.
Offline-to-online reinforcement learning is promising for generalizable robotic manipulation, yet its full-stack complexity obscures reproduction and diagnosis. Within such systems, value estimation plays a central role in prioritizing heterogeneous data for policy improvement. D…