Artificial Intelligence (AI) plays an increasingly integral role in decision-making processes. In order to foster trust in AI predictions, many approaches towards explainable AI (XAI) have been developed and evaluated. Surprisingly, one factor that is essential for trust has been underrepresented in XAI research so far: uncertainty, both with respect to how it is modeled in Machine Learning (ML) and XAI as well as how it is perceived by humans relying on AI assistance. This review paper provides an in-depth analysis of both aspects. We review established and recent methods to account for uncertainty in ML models and XAI approaches and we discuss empirical evidence on how model uncertainty is perceived by human users of XAI systems. We summarize the methodological advancements and limitations of methods and human perception. Finally, we discuss the implications of the current state of the art in model development and research on human perception. We believe highlighting the role of uncertainty in XAI will be helpful to both practitioners and researchers and could ultimately support more responsible use of AI in practical applications.
Deep neural networks (DNNs) have significantly advanced machine perception and reasoning; however, their lack of transparency in decision-making continues to pose a major challenge, particularly in high-stakes domains such as healthcare, finance, and law. This is especially conce…
Validating wireless power transfer (WPT) systems for electric vehicles (EVs) is a challenge due to efficiency variations caused by coil misalignments and height differences arising from various vehicle designs. Traditional simulation methods, such as finite element analysis (FEM)…
Alzheimer’s disease (AD) is the most prevalent neurodegenerative disorder worldwide, affecting approximately 56.9 million people in 2021 and projected to reach 152 million by 2050. Its defining pathological features, amyloid-beta plaques and neurofibrillary tangles, accumulate fo…
Artificial intelligence is increasingly used to support clinical decision making, yet concerns remain regarding algorithmic aversion, automation bias and the preservation of meaningful human oversight; while explainable AI aims to improve transparency, less attention has been dev…
Digital twins (DTs) have become a central paradigm for modeling cyber–physical systems and digital infrastructures, yet the term is applied to very different representations—from physical assets to operational processes and service environments. This ambiguity obscures how the va…
Copper is a strategically important commodity whose price dynamics are increasingly affected by structural changes, geopolitical shocks, and the global energy transition. These conditions create substantial challenges for forecasting models and provide a useful setting for evalua…