Prateek Singh

2 papers indexed

arxivcs.CLcs.LG2026-07-11

MAGE: Understanding Stability-Performance Trade-offs in Multi-component Prompt Optimization

How do different components of iterative prompt optimization interact, and what happens when they are combined? We investigate this through MAGE (Memory-Augmented Goal-directed Prompt Evolution), a controlled analysis framework for studying component interaction in prompt optimiz…

View free PDFSource page

arxivcs.LG2026-07-11

RDQ: Residual Distribution Quantization for Large Language Models

Prateek Singh

Post-training quantization (PTQ) of large language models degrades sharply below 4-bit precision. We identify the root cause as residual stream distributional drift: quantization noise injected at each transformer layer accumulates in the shared residual representation, causing K…

View free PDFSource page