semantic_scholarIEEE Transactions on Mobile Computing2026-08-01
Criticality-Aware Gen-AI Inference via Dynamic Step Control in Resource-Efficient Vehicular Computing
Jinmei Shu, Jia Hu, Geyong Min, Zhu Xiao, Hongbo Jiang
TL;DR: A Criticality-aware Resource-efficient Inference (CARIN) framework, where inference steps are dynamically adjusted to balance delay and quality for multi-criticality tasks, is developed.
Integrating Generative AI (Gen-AI) into vehicular computing can significantly enhance road safety and driving experience. The performance of Gen-AI inference in vehicular computing is highly sensitive to the number of inference steps, where even minor adjustments can disrupt the…