SpaceTop

SpaceTop, integrating 2D and spatial 3D interactions in a see through desktop environment. (2011-2013)

Advice and Mentoring: Alex Olwal, Hiroshi Ishii and Cati Boulanger.
Assistance in Software Development: Akimitsu Hogge, John Weiss.

SpaceTop is a technological and design solution to fuse 2D and spatial 3D interactions in a single desktop workspace. It extends the traditional desktop interface with interaction technology and visualization techniques that enable seamless transitions between 2D and 3D manipulations. SpaceTop allows users to type, click, draw in 2D, and directly manipulate interface elements that float in the 3D space above the keyboard. It makes it possible to easily switch from one modality to another, or to simultaneously use two modalities with different hands. We introduce hardware and software configurations for co-locating these various interaction modalities in a unified workspace using depth cameras and a transparent display. We describe new interaction and visualization techniques that allow users to interact with 2D elements floating in 3D space and present the results from a preliminary user study that indicates the benefit of such hybrid workspaces.

 

1671989-poster-1280-spacetop-stillimage

Related Publication-SpaceTop: Integrating 2D and Spatial 3D Interactions in a See-through Desktop Environment

http://web.media.mit.edu/~jinhalee/spacetop_jinhalee.pdf

ABSTRACT

SpaceTop is a concept that fuses 2D and spatial 3D interactions in a single desktop workspace. It extends the traditional desktop interface with interaction technology and visualization techniques that enable seamless transitions between 2D and 3D manipulations. SpaceTop allows users to type, click, draw in 2D, and directly manipulate interface elements that float in the 3D space above the keyboard. It makes it possible to easily switch from one modality to another, or to simultaneously use two modalities with different hands. We introduce hardware and software configurations for co-locating these various interaction modalities in a unified workspace using depth cameras and a transparent display. We describe new interaction and visualization techniques that allow users to interact with 2D elements floating in 3D space and present the results from a preliminary user study that indicates the benefit of such hybrid workspaces.

Author Keywords:

3D UI; Augmented Reality; Desktop Management

ACM Classification Keywords

H.5.m. Information interfaces and presentation (e.g., HCI)

General Terms

Human Factors; Design; Measurement.

INTRODUCTION

Desktop computing today is primarily composed of 2D graphical user interfaces (GUI) based on a 2D screen with

INTRODUCTION

Desktop computing today is primarily composed of 2D graphical user interfaces (GUI) based on a 2D screen with input through a mouse or a touchscreen. While GUIs have many advantages, they can constrain the user due to the limited screen space and interaction bandwidth, and there exists situations where users can benefit from more expressive spatial interactions. For instance, switching between overlapping windows on a 2D screen adds more cognitive load than arranging a stack of physical papers in 3D space [7]. While there has been advances in sensing and display technologies, 3D spatial interfaces have not been widely employed in everyday computing.  Despite advantages from spatial memory and increased expressiveness, potential issues related to precision and fatigue make 3D desktop computing challenging. We present SpaceTop, an experimental prototype that brings 3D spatial interaction space to desktop computing environments. We address the previously mentioned challenges in three interdependent ways. First, SpaceTop accommodates both conventional and 3D spatial interactions in the same space. Second, we enable users to switch between 3D I/O and conventional 2D input, or even use them simultaneously with both hands. Finally, we present new interaction and visualization techniques to allow users to interact with 2D elements floating in 3D space. These techniques aim to address issues and confusion that arise from shifting between interactions of different styles and dimensions.

 

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s