CORTEXA
← Browse

Zhiren Gong

2 papers indexed

arxivcs.LGcs.AI2026-07-20

CoCurve: Cross-Module Co-Pruning Curvature for Training-Free Structured LLM Pruning

Zhiren Gong, Zihao Zeng, Zijie Wang, Tiantong Wang, Chau Yuen, Wei Yang Bryan Lim

Structured pruning compresses large language models (LLMs) by removing whole computational units, such as attention heads and feed-forward (FFN) channel groups. Most training-free methods, however, rank these units independently, implicitly treating the loss from pruning a set as…

View free PDFSource page
arxivcs.LGcs.AI2026-07-02

Conditional Co-Ablation: Recovering Self-Repair Backups in Transformer Circuits

Zhiren Gong, Zihao Zeng, Chau Yuen, Wei Yang Bryan Lim

Mechanistic interpretability often relies on component-level interventions to discover how a model produces a behavior. This guides attribution, capability knockout, and model pruning downstream to operate by scoring each unit by the effect of ablation in isolation. Such first-or…

View free PDFSource page