5 papers indexed
Junchi Liao, Jiawen Deng, Fuji Ren
Visible tests are a common gate for LLM-generated code, but passing them does not certify specification correctness. We study a deployment-like monitoring problem: after code has passed public tests, can a weaker LLM verifier identify the residual hidden bugs? We introduce Code M…
Junchi Liao, Jiawen Deng, Fuji Ren
Medical LLMs are often evaluated by whether they select the correct diagnosis, but diagnostic accuracy alone does not show whether the model used the case evidence appropriately. We present a behavioral audit of evidence use in medical diagnosis. For each case, we decompose patie…
Marko Balan, Thomas Bodley, Kiyan Heybati, Jiawen Deng, Melany Gaetani, Christina Maratta, et al.
PURPOSE: We sought to conduct a scoping review to summarize the existing literature on environmental sustainability in critical care medicine, methods for measuring intensive care unit (ICU)-related environmental impact, and interventions to improve ICU environmental sustainabili…
Junchi Liao, Jiawen Deng, Fuji Ren
In multi-hop RAG evaluation, a top-k answer score can hide two different failures: the retrieval window may drop part of the support chain, or it may contain support in a form the adapted reader does not use well. We call this reader-facing form of retrieved evidence an evidence…
Junchi Liao, Jiawen Deng, Fuji Ren
Vision-language models can exhibit visual concept-conditioned divergence: given images containing demographic features, corporate logos, or ideological symbols, some models produce unusually uniform responses that differ from what peer models say about the same input. These behav…