2026
UPinch: Enabling Unaligned Gaze-Hand Coordination forSelection in 3D Environments
Yuchen Wu,, Shizhen Zhang,, Shengxin Li,, Yang Ouyang,, Qian Zhu,, Quan Li
Accepted by Proceedings of the 2025 International Conference on Human-Engaged Computing (ICEHC 2025)
Interaction techniques in virtual environments (such as Mixed Reality) necessitate Gaze-Hand Alignment, which requires gaze fixation and hand selection on the same target at the same time. However, people's gaze-hand behaviour in real world is often unaligned. We proposed UPinch, a gaze-hand based selection technique that adapts the inherent gaze-hand coordination observed in human reach-to-grasp process to 3D environments. We conducted a series of cross-reality experiments comparing UPinch to Gaze + Pinch, Gaze + Handray and Reality, identifying their gaze-hand characteristics in diverse tasks.
2025
Understood: Real-Time Communication Support for Adults with ADHD Using Mixed Reality
Shizhen Zhang*, Shengxin Li*, Quan Li (* equal contribution)
Accepted by The 38th Annual ACM Symposium on User Interface Software and Technology (UIST 25)
Adults with ADHD face persistent communication difficulties stemming from executive dysfunction and emotional dysregulation, yet existing interventions mainly focus on children and lack everyday support for adults. Through formative interviews and a design workshop, we developed Understood, a Mixed Reality system on HoloLens 2, designed to assist adults with ADHD in real-world communication. Understood integrates real-time conversation summarization, context-aware word suggestions, and topic-shift detection to reduce cognitive load and disfluency. A within-subject user study and expert interviews show that Understood offers effective and usable support, serving as a valuable complement to therapist-led interventions.
DancingBoard: Streamlining the Creation of Motion Comics to Enhance Narratives
Longfei Chen*, Shengxin Li*, Ziang Li, Quan Li (* equal contribution)
Accepted by The 30th Annual ACM Conference on Intelligent User Interfaces (IUI 25)
Motion Comic, a form of animation that appropriates an existing comic book into a screen-based animated narrative, proposes challenges for amateur creators as they lack proficiency with professional creation tools.
We conducted (1) a formative study to identify challenges faced by amateurs and (2) a review of the Motion Comics design space. Based on these results, we developed DancingBoard, an integrated authoring tool streamlines motion comic creation for amateur creators. We evaluated DancingBoard’s usability and the outcome’s efficiency in conveying the story through two user studies and semi-structured interviews.
2024
Trinity: Synchronizing Verbal, Nonverbal, and Visual Channels to Support Academic Oral Presentation Delivery
Yuchen Wu, Shengxin Li, Shizhen Zhang, Xingbo Wang, Quan Li
Accepted by International Symposium of Chinese CHI 2024; Best Paper Award.
Academic Oral Presentation allows students to express ideas and present research findings. However, students often face the challenge of integrating verbal, nonverbal and visual elements into the presentation.
Based on a need-finding survey, a design study and an expert interview, we proposed Trinity, a hybrid delivery support system that provides guidance for multichannel delivery on-the-fly.
We conducted a controlled between-subject user study to investigate the usability, effectiveness, interaction, influence, trust and collaboration of Trinity.