3D User Interfaces

Description

This extensively updated Second Edition adds coverage of new 3D UI systems, trends, technologies, and advances; and will more consistently cover practical issues by introducing three case studies that run throughout the book. It fully reflects major advances, including new generations of interactive systems that have been introduced throughout consumer, research, and industry sectors.

Moving beyond its earlier strict focus on VR, this edition reflects today’s far wider applications of 3D technology. The authors have revisited and extended this book’s theoretical sections with new insights, updating the examples, and adding novel areas of research. In particular, they focus on true 3D spatial user interfaces where a user’s position and orientation is known, and examines research areas that have rapidly grown since the first edition. These include:

• Mobile augmented reality
• Novel tactile and haptic displays
• Gaming
• Human-robot interaction and tele-operation
• Collaborative systems

JOSEPH J. LAVIOLA, JR., Associate Professor of Computer Science, directs the Interactive Systems and User Experience Research Cluster of Excellence at the University of Central Florida.

ERNST KRUIJFF, Interim Professor for Computer Graphics and Interactive Systems at the Institute of Visual Computing, Bonn-Rhein-Sieg University of Applied Sciences, leads the 3DMi group’s design of multisensory 3D user interfaces.

RYAN P. McMAHAN, Associate Professor of Computer Science at UT Dallas, directs its Future Immersive Virtual Environments (FIVE) Lab.

DOUG A. BOWMAN, Professor of Computer Science at Virginia Tech, directs its 3D Interaction Research Group and Center for Human-Computer Interaction. He is an ACM Distinguished Scientist.

IVAN POUPYREV is Technical Program Lead working on advanced interaction research at Google’s Advanced Technology and Products (ATAP) division.

The definitive guide to modern 3D user interfaces: updated for today’s latest advances and a far wider spectrum of applications

• Cutting-edge guidance on designing 3D UIs for optimal user experience, from a team of world-class researchers and practitioners
• Discover new techniques and technologies for gaming, mobile augmented reality, tactile and haptic displays, human-robot interaction, tele-operation, remote collaboration, and VR
• Covers breakthrough devices such as Oculus Rift, Leap Motion, and Kinect – plus emerging advances in brain input, mobile AR, and beyond
• Now offers deeper practical insight through three complete running case studies

3D interaction is suddenly everywhere. But simply using 3D input or displays isn’t enough: 3D interfaces must be carefully designed for optimal user experience. 3D User Interfaces: Theory and Practice, 2nd Edition is today’s most comprehensive primary reference to building state-of-the-art 3D user interfaces and interactions. Five pioneering researchers and practitioners cover the full spectrum of emerging applications, techniques, and best practices. The authors combine theoretical foundations, analysis of leading devices, and empirically validated design guidelines. This edition adds two new chapters on human factors and general human-computer interaction—indispensable foundational knowledge for building any 3D user interface. It also demonstrates advanced concepts at work through two running case studies: a first-person VR game and a mobile augmented reality application.

Coverage Includes

• 3D user interfaces: evolution, elements, and roadmaps
• Key applications: virtual and augmented reality (VR, AR), mobile/wearable devices
• What 3D UI designers should know about human sensory systems and cognition ergonomics
• How proven human-computer interaction techniques apply to 3D UIs
• 3D UI output hardware for visual, auditory, and haptic/ tactile systems
• Obtaining 3D position, orientation, and motion data for users in physical space
• 3D object selection and manipulation
• Navigation and wayfinding techniques for moving through virtual and physical spaces
• Changing application state with system control techniques, issuing commands, and enabling other forms of user input
• Strategies for choosing, developing, and evaluating 3D user interfaces
• Utilising 2D, “magic,” “natural,” multimodal, and two-handed interaction
• The future of 3D user interfaces: open research problems and emerging technologies

• Part I: Background and Introduction
• 1. Introduction to 3D Interaction
• 2. 3D User Interfaces: History and Roadmap
• Part II: HCI and Human Factors Basics
• 3. General Principles of Human-Computer Interaction
• 4. Human Factors Fundamentals
• Part III: 3D Interaction Technology
• 5. 3D Output Devices
• 6. 3D Input Devices
• Part IV: Interaction Techniques for Common 3D Tasks
• 7. Selection and Manipulation
• 8. Navigation
• 9. System Control 
• Part V: Designing and Developing 3D User Interfaces
• 10. Strategies for Designing and Developing 3D User Interfaces
• 11. Evaluation of 3D User Interfaces 
• Part V: The Future of 3D User Interfaces
• 12. The Future of 3D Interfaces

“An essential guide for anyone developing interfaces for Virtual and Augmented Reality gaming experiences.”
—Richard Marks, Director of Magic Lab, Sony PlayStation

“An incredible resource for 3D interaction researchers and practitioners, made all the more timely and valuable with today’s renewed interest in Virtual and Augmented reality platforms. Everyone in VR and AR can benefit from the decades of research thoughtfully organized and presented in this updated edition.”
—Andy Wilson, Microsoft Research

“This is an essential book for researchers and developers creating 3D user interfaces. If you’re developing Virtual Reality or Augmented Reality experiences, or even mobile and desktop 3D applications, you need to buy this book.”
—Mark Billinghurst, University of South Australia

From video games to mobile augmented reality, 3D interaction is everywhere. But simply choosing to use 3D input or 3D displays isn’t enough: 3D user interfaces (3D UIs) must be carefully designed for optimal user experience. 3D User Interfaces: Theory and Practice, Second Edition is today’s most comprehensive primary reference to building outstanding 3D UIs. Four pioneers in 3D user interface research and practice have extensively expanded and updated this book, making it today’s definitive source for all things related to state-of-the-art 3D interaction.

This edition goes far beyond VR, covering the full spectrum of emerging applications for 3D UIs, and presenting an extraordinary array of pioneering techniques and technologies. The authors combine theoretical foundations, analysis of devices and techniques, empirically validated design guidelines, and much more. Throughout each chapter, they illustrate key concepts with running case studies on gaming, mobile AR, and robot teleoperation.

You’ll find authoritative, accessible coverage of all this, and much more:

• Essentials of HCI and human factors (for thousands of students and practitioners now entering the field)
• How 3D UIs have evolved, and the “hard problems” that remain
• 3D UIs in console gaming, VR, augmented reality (AR), robot teleoperation, mobile/wearable computers, and remote collaboration
• How 3D input/output enables users to perceive and act much as they do in the physical world
• 3D output devices, including visual, auditory, haptic, and tactile displays
• 3D input devices, including traditional, special purpose, and direct human input via biosignals (e.g., brain input)
• 3D interaction techniques for common tasks such as selection, manipulation, navigation, and system control
• Strategies for designing and developing 3D UIs, including the use of 2D interaction; “magic” vs. “natural” interaction techniques; multimodal interaction, and two-handed interaction
• Evaluating existing 3D UIs, and previewing their future

• Cutting-edge guidance on designing 3D UIs for optimal user experience, from a team of world-class researchers and practitioners
• Teaches new techniques and technologies for gaming, mobile augmented reality, tactile and haptic displays, human-robot interaction, tele-operation, remote collaboration, and VR
• Covers breakthrough devices such as Oculus Rift, Leap Motion, and Kinect – plus emerging advances in brain input, mobile AR, and beyond
• Now offers deeper practical insight through three complete running case studies

Additional information