CORTEXA
← Browse
arxivcs.HC2026-07-01Cited by 1

Draped Surfaces: A Contour-Adaptive Interface Overlaid on the Physical Environment for Mixed Reality Workspaces

SoonUk Kwon, Barrett Ens, Pourang Irani

Conventional Mixed Reality (MR) workspaces are frequently organized in cockpit-like layouts, where multiple floating windows surround the user. While this configuration facilitates access to digital content, it often induces occlusion, reducing understanding of the physical environment and limiting access to real-world objects. To overcome this challenge, we present the Contour-Adaptive Mixed Environment Overlays (CAMEO), a contour-adaptive MR interface that drapes virtual windows onto physical surfaces. This design integrates digital content with nearby items, thereby improving users' visual access to background objects and supporting interaction with them. We evaluate CAMEO in two controlled studies. The first demonstrates that draping reduces hand-movement detours relative to flat mid-air surfaces, enabling more direct interaction with nearby items. The second shows that controlled window deformation does not significantly impair text legibility when compared to flat surfaces. Together, these findings contribute a novel design paradigm for MR workspaces that balances immersion, readability, and environmental understanding.

View free PDFSource page

Related papers

arxivcs.HC2026-07-01

Visualizing Engineering Fundamentals: Design of Mixed Reality and Physical Toolkits for Effective Learning

Mohammad Abu Nasir Rakib, Sharmin Akter, Eshwara Prasad Sridhar, Somik Biswas, Md Rassel Raihan, Mahmudur Rahman

This study examined students' experiences with mixed-reality applications and physical toolkits in Engineering Mechanics to inform design guidelines for educational tools. In a user study with 24 participants, we compared classroom instruction alone, classroom instruction with a…

View free PDFSource page
arxivcs.HC2026-07-04

Post-Lecture Interactive Environments for Conceptual Learning: A Randomized Comparison of Mixed Reality and Tangible Instruction in Undergraduate STEM Education

Sharmin Akter, Mohammad Abu Nasir Rakib, Eshwara Prasad Sridhar, Somik Biswas, Mahmudur Rahman, Md Rassel Raihan

Developing conceptual understanding in engineering requires learners to connect spatial reasoning with abstract representations, yet lecture-based instruction often provides limited support for this process. Interactive learning environments, including mixed reality (MR) and tang…

View free PDFSource page
arxivcs.HCcs.ET2026-07-16

Assessing Learning Processes with Multimodal Data in Virtual Reality Learning Environments

Eileen McGivney, Oluwatomilade Olarinde, Erica Kleinman, Kaylah Facey, Rana Jahani, Shripad Agashe, et al.

Assessing learning in virtual reality (VR) environments typically relied on traditional pre-post content retention tests, revealing little about the process of learnng within such immersive environments. Multimodal data from player activity in VR is promising to better measure le…

View free PDFSource page
arxivcs.HC2026-07-07

Creating a Mixed-Reality Installation with Families through Theatrical Co-Design

Pavlos Panagiotidis, Roma Patel, Boriana Koleva, Steve Benford, Jocelyn Spence, Paul Tennent, et al.

Co-designing with families for environmental sustainability relies on participatory imagination, yet habitual family roles and uneven participation, especially between adults and young children, often constrain it. A second challenge is continuity: workshop relationships and embo…

View free PDFSource page
arxivcs.HC2026-07-20

ChatMuse: Supporting In-Person Small-Group Conversation Experience with a Proactive Assistive AI Agent in Mixed Reality

Shaoze Zhou, Joaquin Frangi, Diana Nelly Rivera Rodriguez, Rawan Alghofaili, Janet G. Johnson, Lingyao Li, et al.

In-person small-group conversations occur across nearly every aspect of daily life and play a crucial role in social interaction. However, achieving effective in-person group conversations can be challenging and cognitively demanding. While recent Mixed Reality (MR) headsets show…

View free PDFSource page