Jörg Ott

Budget-Adaptive Routing: Skipping the Weak When the Strong Answers Anyway

Wei Geng, Nitinder Mohan, Jörg Ott

Edge-cloud inference collaborations are often designed with a routing estimator that decides whether to offload each frame from weak models at the edge to stronger models in the cloud. Existing systems place the routing estimator after the weak detector, so the weak forward pass…Read more