The Aesthetics of Immersion - Towards a Visual Design Lexicon for Emerging Spatial User Interfaces: Perspectives from Research and Teaching Explorations

Abstract

Spatial computing interfaces being introduced into the mass market hold the promise to offer users compelling immersive and interactive 3D experiences for applications ranging from media and entertainment to gaming and sport to productivity and education. Nonetheless, there is a lack of visual design methodologies and frameworks to facilitate the creation, criticism, and communication of visually compelling such spatial computing applications. In this showcase, several case study applications from the speaker’s pedagogical experience teaching design students at both Stanford University and the National University of Singapore are discussed from a visual design perspective. The study highlights both opportunities and challenges for visual design associated with the unique considerations surrounding such immersive experiences, including scene reconstruction, object and image tracking, real-time 3D rendering, including through the integration of novel artificial intelligence models for 3D computer vision and 3D asset generation tasks. Particular emphasis is placed on the novel aesthetic qualities made possible by such technological modalities, while also highlighting the risk of producing visually incoherent and disorienting user experiences if visual design perspectives are ignored during the design and development phases. The discussion concludes with perspectives and predictions on the short to medium term future for such technologies in the context of visual design, and the skills required to prepare visual designers of the future to render such emerging immersive interfaces not only functional but visually delightful to users.

Presenters

Gabriel Lipkowitz
Assistant Professor, Industrial Design, National University of Singapore, South West, Singapore

Details

Presentation Type

Innovation Showcase

Theme

Visual Design

KEYWORDS

Spatial Computing, Interactive 3D, Immersive Technologies