CORTEXA
← Browse
arxivcs.HC2026-07-23Cited by 0

Reimagining the Augmented Reality Accessibility Ecosystem for Deaf Students: Service Provider Perspectives in Experiential Learning

Roshan Mathew, Roshan Peiris

In experiential learning environments, Deaf and hard of hearing (DHH) students often experience ``split attention,'' dividing their focus among tasks, instructors, and access providers. Augmented reality (AR) has been proposed as a means to centralize communication access within the student's field of view; however, little is known about how such systems affect the instructors, interpreters, and captioners who support access in these settings. We present a formative, expert-based evaluation of ARRAE, an AR-mediated communication access ecosystem, examining the experiences of an instructor, an American Sign Language (ASL) interpreter, and a real-time captioner in a simulated laboratory environment. Comparing in-person, traditional remote, and AR-mediated access, our findings suggest that AR reconfigures accessibility labor and interactional practices by redistributing communication, attention, and awareness across participants. While AR-mediated access supported integrated, in-situ communication and enhanced contextual awareness, it also altered interactional feedback mechanisms, such as gaze coordination and pacing, that support shared understanding during instruction. These observations highlight trade-offs between access, control, and coordination, and suggest that AR-mediated systems may be most effective when considered as part of a broader, hybrid ecosystem rather than as standalone replacements for existing modalities. This work contributes initial insights into how AR reshapes communication access in experiential learning and informs the design of systems that support coordinated, multi-user interaction in hands-on educational contexts.

View free PDFSource page

Related papers

arxivcs.HCcs.ET2026-07-16

Assessing Learning Processes with Multimodal Data in Virtual Reality Learning Environments

Eileen McGivney, Oluwatomilade Olarinde, Erica Kleinman, Kaylah Facey, Rana Jahani, Shripad Agashe, et al.

Assessing learning in virtual reality (VR) environments typically relied on traditional pre-post content retention tests, revealing little about the process of learnng within such immersive environments. Multimodal data from player activity in VR is promising to better measure le…

View free PDFSource page
arxivcs.HC2026-07-07

Head, Gaze, or Finger? Comparing Object Selection Techniques in Augmented Reality for People with Low Vision

Ruijia Chen, Tianyi Zhang, Sanbrita Mondal, Yukang Yan, Yuhang Zhao

Augmented reality (AR) can enhance visual perception for people with low vision (PLV) by overlaying multimodal information. Selection-based augmentation further allows users to flexibly choose and augment relevant information while reducing distraction and visual clutter. However…

View free PDFSource page
arxivcs.CVcs.CRcs.HCcs.LG2026-07-01

Sign in the Air to Unlock: An Interface for authentication in Virtual and Augmented Reality Powered by Point-Voxel Cross-Attention Network

Neda Abdolrahimi, Thiru Siddharth, Frank Sicong chen, Vir V Phoha

Significant advancement of immersive technologies such as Virtual and Augmented Reality (VR/AR) and their integration into diverse aspects of modern life need authentication interfaces that are secure, intuitive, and compatible with embodied interaction. Traditional methods such…

View free PDFSource page
arxivcs.CVcs.ETcs.HC2026-07-15

Marker-free deformable registration and fusion for augmented reality-guided positive margin localization during tumor resection surgery

Yue Yang, Annie Benson, Matthieu Chabanas, Jason Slagle, Thomas Myles, Matthew B. Weinger, et al.

Positive margins in head and neck oncologic surgery require mapping specimen-side pathology findings to the patient resection bed. This is challenging because pathologists identify the positive margin on slices of the resected, deformed specimen, while surgeons must relocate the…

View free PDFSource page
arxivcs.HC2026-07-11

Learning behavior accounts for background-related advantage in AI-assisted education

Jingwei Yi, Yueqi Xie, Jiyan He, Rui Ye, Junming Huang, Bin Zhu, et al.

Generative AI has been found, and will likely be found increasingly, useful in education. However, existing AI-for-education studies provide inconsistent evidence on its average effects. More broadly, research on prior educational technologies shows that average effects often mas…

View free PDFSource page
arxivcs.HC2026-07-01

Visualizing Engineering Fundamentals: Design of Mixed Reality and Physical Toolkits for Effective Learning

Mohammad Abu Nasir Rakib, Sharmin Akter, Eshwara Prasad Sridhar, Somik Biswas, Md Rassel Raihan, Mahmudur Rahman

This study examined students' experiences with mixed-reality applications and physical toolkits in Engineering Mechanics to inform design guidelines for educational tools. In a user study with 24 participants, we compared classroom instruction alone, classroom instruction with a…

View free PDFSource page