EditAR: A Digital Twin Authoring and Editing Environment for Creation of AR/VR and Video Instructions from a Single Demonstration Inproceedings

Abstract:

Augmented/Virtual reality and video-based media play a vital role in the digital learning revolution to train novices in spatial tasks. However, creating content for these different media requires expertise in several fields. We present EditAR, a unified authoring and editing workflow to create content for AR, VR, and video with a single demonstration. EditAR captures the user’s interaction within an environment and creates a digital twin enabling users with no prior programming background to develop content. We conducted formative interviews with both subject and media experts to design the system. The prototype then developed was reviewed by experts. We also performed a comparative study on 2D video creation from 3D recordings, via a 3D editor, which uses freehand interaction for in-headset editing vs. traditional video creation. Users took 5x less time to record instructions and preferred EditAR in a qualitative survey, along with giving significantly higher usability scores.