CORTEXA
← Browse

Zhaohui Wang

2 papers indexed

arxivcs.LGcs.AIstat.ML2026-06-27

Uncertainty-Aware Sequential Decision Rules for Event-Triggered LLM Invocation in Streaming Systems

Zhaohui Wang

Streaming inference pipelines increasingly pair lightweight fast models with Large Language Models (LLMs) that provide rich semantic understanding at substantial cost. The central question of when to invoke the LLM has received limited formal treatment. We cast this as a risk-bas…

View free PDFSource page