arxivstat.MLcs.LG2026-07-06
Context-Constrained Transfer Learning for Tabular Foundation Models via Data Distillation
Tabular Foundation Models (TFMs) have demonstrated strong empirical performance as black-box inference engines through in-context learning. However, their use in transfer learning is limited by two obstacles: strict context-size constraints and sensitivity to distribution shifts…