CORTEXA
← Browse
arxivcs.LG2026-07-07

Dual Attention Heads for Personalized Federated Learning in ECG Classification

Kien Le, Joseph Lindley, Quoc Bao Phan, Tuy Tan Nguyen

Federated learning (FL) enables collaborative model training across institutions without sharing sensitive patient data. However, the inherent heterogeneity of electrocardiogram (ECG) data across healthcare providers presents significant technical challenges for robust classification. We propose FedDualAtt, a personalized federated learning approach that splits transformer attention heads into global and local branches. Global heads are aggregated via FedAvg to capture shared cross-site patterns, while local heads remain client-specific to adapt to institution-level recording characteristics. Experiments on FedCVD, an FL benchmark for cardiovascular disease detection, demonstrate that FedDualAtt outperforms existing FL and personalized FL methods in ECG classification tasks. Analysis of global-local head ratios reveals that different clients benefit from varying levels of architectural personalization.

View free PDFSource page

Related papers

arxivcs.LGcs.AI2026-07-02

QFedAgent: Quantum-Enhanced Personalized Federated Learning for Multi-Agent Activity Recognition

Quoc Bao Phan, Tuy Tan Nguyen

Federated learning (FL) enables collaborative model training across distributed devices without sharing raw data, making it suitable for privacy-sensitive robotic sensing applications. However, multi-agent systems generate heterogeneous and non-independent and identically distrib…

View free PDFSource page
arxivcs.LGcs.AIcs.DC2026-07-05

FedSPM: Routing-Enabled Federated Learning under Dual Heterogeneity via Semiparametric Mixture

Zijian Wang, Pengfei Li, Guangyu Yang, Qiong Zhang

Routing-prediction federated learning has emerged as a new paradigm that reframes inter-client heterogeneity as a resource for system-level intelligence: at inference time, the server routes each external query to the best-matched client for prediction. Existing approaches, howev…

View free PDFSource page
arxivcs.LGcs.AIcs.CL2026-07-15

Data-Efficient Adaptation of LLMs via Attention Head Reweighting

Tuomas Oikarinen, Zixiao Chen, Charlotte Siska, Tsui-Wei Weng, Chandan Singh, Jianfeng Gao

Learning effectively from limited data is critical in domains like security where labeled examples are scarce. Large language models (LLMs) have demonstrated some capabilities for data-efficient learning, especially through parameter-efficient adaptation methods, but continue to…

View free PDFSource page
arxivcs.CVcs.LG2026-07-09Cited by 2

FedTR: Federated Learning Framework with Transfer Learning for Industrial Visual Inspection

Vikash Sathiamoorthy, Shuo Huai, Hao Kong, Di Liu, Wendy Yong Yi Loy, Christian Makaya, et al.

Federated learning (FL) is a collaborative learning scheme to train deep learning models, where collaborating parties can consolidate their models without sharing local data with other parties, hence preserving data privacy. Nevertheless, when implementing FL in Industrial visual…

View free PDFSource page
arxivcs.LG2026-07-22

One Round Is All You Need: Analytic Federated Learning for Task-Heterogeneous Multi-Label Medical Image Classification

Afsaneh Mahanipour, Hana Khamfroush

Federated learning (FL) enables multiple clinical institutions to collaboratively train a shared disease classifier without centralizing patient data. In practice, however, each institution annotates only the pathologies within its area of expertise, so the federation operates un…

View free PDFSource page
arxivcs.LGcs.AI2026-07-21

Trustworthy Privacy-Preserving Multimodal Federated Learning for Personalised Breast Cancer Prediction

Ruth Amey, Muhammad Arifur Rahman, Taha Osman, Nicholas Shopland, Andy Burton, Mufti Mahmud, et al.

Federated learning has emerged as a potential solution to privacy concerns associated with using sensitive health data for training predictive models, particularly in personalised cancer care. This research investigates whether federated learning can support the development of ro…

View free PDFSource page