Hybrid User Interfaces: Past, Present, and Future of Complementary Cross-Device Interaction in Mixed Reality.
| Title: | Hybrid User Interfaces: Past, Present, and Future of Complementary Cross-Device Interaction in Mixed Reality. |
|---|---|
| Authors: | Hubenschmid S; Satkowski M; Zagermann J; Mendez J; Elmqvist N; Feiner S; Feuchtner T; Gronbaek JE; Lee B; Schmalstieg D; Dachselt R; Reiterer H |
| Source: | IEEE transactions on visualization and computer graphics [IEEE Trans Vis Comput Graph] 2026 Apr 15; Vol. PP. Date of Electronic Publication: 2026 Apr 15. |
| Publication Model: | Ahead of Print |
| Publication Type: | Journal Article |
| Language: | English |
| Journal Info: | Publisher: IEEE Computer Society Country of Publication: United States NLM ID: 9891704 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1941-0506 (Electronic) Linking ISSN: 10772626 NLM ISO Abbreviation: IEEE Trans Vis Comput Graph Subsets: MEDLINE |
| Imprint Name(s): | Original Publication: New York, NY : IEEE Computer Society, c1995- |
| Abstract: | We investigate hybrid user interfaces (HUIs), aiming to establish a cohesive understanding and to adopt consistent terminology for this nascent research area. HUIs combine heterogeneous devices in complementary roles, leveraging the distinct benefits of each. Our work focuses on cross-device interaction between 2D devices and mixed reality environments, which are particularly compelling, leveraging the familiarity of traditional 2D platforms while providing spatial awareness and immersion. Although prior work has prominently explored such HUIs in the context of mixed reality, we still lack a cohesive understanding of the unique design possibilities and challenges of such combinations, resulting in a fragmented research landscape. We conducted a systematic survey and present a taxonomy of HUIs that combine conventional display technology and mixed reality environments. Based on this, we discuss past and current challenges, the evolution of definitions, and prospective opportunities to tie together the past 30 years of research with our vision of future HUIs. |
| Entry Date(s): | Date Created: 20260415 Latest Revision: 20260415 |
| Update Code: | 20260416 |
| DOI: | 10.1109/TVCG.2026.3683941 |
| PMID: | 41984606 |
| Database: | MEDLINE |
Journal Article