Mixed Reality Light Fields
for Interactive Remote Assistance

Abstract

Remote assistance represents an important use case for mixed reality. With the rise of handheld and wearable devices, remote assistance has become practical in the wild. However, spontaneous provisioning of remote assistance requires an easy, fast and robust approach for capturing and sharing of unprepared environments. In this work, we make a case for utilizing interactive light fields for remote assistance. We demonstrate the advantages of object representation using light fields over conventional geometric reconstruction. Moreover, we introduce an interaction method for quickly annotating light fields in 3D space without requiring surface geometry to anchor annotations. We present results from a user study demonstrating the effectiveness of our interaction techniques, and we provide feedback on the usability of our overall system.

Results

Lightfield capture guidance

Lightfield annotation

Augmented Reality guidance

Citation Copy

@inbook{10.1145/3313831.3376289,
	author = {Mohr, Peter and Mori, Shohei and Langlotz, Tobias and Thomas, Bruce H. and Schmalstieg, Dieter and Kalkofen, Denis},
	title = {Mixed Reality Light Fields for Interactive Remote Assistance},
	year = {2020},
	isbn = {9781450367080},
	publisher = {Association for Computing Machinery},
	address = {New York, NY, USA},
	url = {https://doi.org/10.1145/3313831.3376289},
	booktitle = {Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems},
	pages = {1–12},
	numpages = {12}
	}