CORTEXA
← Browse
arxivstat.MEstat.ML2026-07-08

Transfer Learning for Linear Discriminant Analysis with a Shared Classification Signal

Yonghan Zhang, Yimeng Fan, Wenya Luo, Jiang Hu

This paper studies transfer learning for linear discriminant analysis in high-dimensional two-class classification. We consider one target domain and several source domains, where the mean difference in each domain is decomposed into a deterministic common component and a domain-specific random deviation. The common component represents a shared classification signal across domains, while the random deviation captures domain-specific heterogeneity. Under spiked covariance models, we derive deterministic limits for the target-domain Gaussian-calibrated error of weighted transfer classifiers under both homogeneous and heterogeneous covariance settings. These limits quantify the effects of the shared signal, domain-specific variation, dimension-to-sample-size ratios, and spike structures on transfer performance. They further lead to oracle transfer weights and consistent data-driven plug-in estimators. We also characterize the intercept bias induced by unbalanced target-domain class sample sizes and provide an asymptotically optimal correction.

View free PDFSource page

Related papers

arxivstat.MEstat.ML2026-06-28

Multi-Source Transfer Learning of Sparse Single-Index Models

Ye Tian

Transfer learning leverages knowledge from related source domains to improve learning in a target domain. Recent theoretical advances cover a broad range of regression settings within (generalized) linear models. Despite their diversity, these methods share two common constraints…

View free PDFSource page
arxivstat.MEstat.APstat.ML2026-07-09

Joint estimation of high-dimensional spiked covariance matrices via a partially shared subspace

Changwon Yoon, Minwoo Kim, Sungkyu Jung, Jeongyoun Ahn

Statistical analysis of high-dimensional data is often hampered by limited sample sizes, yet auxiliary datasets from related sources are often readily available. When two such datasets share part of their covariance structure, but not all of it, exploiting the shared part can sub…

View free PDFSource page
arxivstat.MLstat.ME2026-07-14

Contrast-Free ICA and Causal Inference via Wasserstein Distances to the Gaussian

Félix Laplante, Christophe Ambroise, Pierre Humbert

We study the squared $2$-Wasserstein distance to the standard Gaussian as a non-Gaussianity criterion and use it for linear Independent Component Analysis (ICA) and causal discovery in Linear Non-Gaussian Acyclic Models (LiNGAM). Unlike commonly used parametric contrasts and appr…

View free PDFSource page