Designing augmented reality visualizations for synchronized and time-dominant human-robot teaming

Savannah Paul; Christopher Reardon; Tom Williams; Hao Zhang

doi:10.1117/12.2559402

19 May 2020 Designing augmented reality visualizations for synchronized and time-dominant human-robot teaming

Savannah Paul, Christopher Reardon, Tom Williams, Hao Zhang

Proceedings Volume 11426, Virtual, Augmented, and Mixed Reality (XR) Technology for Multi-Domain Operations; 1142607 (2020) https://doi.org/10.1117/12.2559402
Event: SPIE Defense + Commercial Sensing, 2020, Online Only

Abstract

Team communication is crucial in multi-domain operations (MDOs) that require teammates to collaborate on complex tasks synchronously in dynamic unknown environments. In order to enable effective communication in human-robot teams, the human teammate must have an intuitive interface that supports and satisfies the time-sensitive nature of the task for communicating information to and from their robot teammate. Augmented Reality (AR) technologies can provide just such an interface by providing a medium for both active and passive robot communication. In this paper we propose a new Virtual Reality (VR) based framework for authoring AR visualizations, and demonstrate the use of this framework to produce AR visualizations that help facilitate high task performance in synchronized, time-dominant human-robot teaming. In this paper we propose a new framework that uses a virtual reality (VR) simulation environment for developing AR strategies as well as present a AR solution for maximizing task performance in synchronized, time-dominant human-robot teaming. The framework utilizes a Unity-based VR simulator that is run from the first person point of view of the human teammate and overlays AR features to virtually imitate the use of an AR headset in human-robot teaming scenarios. Then, we introduce novel AR visualizations that support strategic communication within teams by collecting information from each teammate and presenting it to the other in order to influence their decision making. Our proposed design framework and AR solution has the potential to impact any domain in which humans conduct synchronized multi-domain operations alongside autonomous robots in austere environments, including search and rescue, environmental monitoring, and homeland defense.

Conference Presentation

Citation Download Citation

Savannah Paul, Christopher Reardon, Tom Williams, and Hao Zhang "Designing augmented reality visualizations for synchronized and time-dominant human-robot teaming", Proc. SPIE 11426, Virtual, Augmented, and Mixed Reality (XR) Technology for Multi-Domain Operations, 1142607 (19 May 2020); https://doi.org/10.1117/12.2559402

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available