Jinmei Shu

Criticality-Aware Gen-AI Inference via Dynamic Step Control in Resource-Efficient Vehicular Computing

Jinmei Shu, Jia Hu, Geyong Min, Zhu Xiao, Hongbo Jiang

TL;DR: A Criticality-aware Resource-efficient Inference (CARIN) framework, where inference steps are dynamically adjusted to balance delay and quality for multi-criticality tasks, is developed.

Integrating Generative AI (Gen-AI) into vehicular computing can significantly enhance road safety and driving experience. The performance of Gen-AI inference in vehicular computing is highly sensitive to the number of inference steps, where even minor adjustments can disrupt the…Read more