An Empirical Analysis to Determine a Common Augmented Reality or Mixed Reality Solution to Improve Training and Operational Capabilities for the Marine Corps

Abstract

I Marine Expeditionary Force sponsored research to identify methods of developing applications for various augmented reality (AR), virtual reality (VR), and mixed reality (XR) use cases. The research sought to identify methods of hand and arm tracking that would assist with the completion of tasks. This thesis provides the background for the growing demand in the Marine Corps for the use of AR/​VR/​XR systems grounded in Project Tripoli. The method of thesis research identifies various AR/​VR/​XR systems that assists in better understanding current capabilities in commercially developed systems. Site visits were conducted to various laboratories to learn about the systems and to learn about a new technology under development by the Defense Advanced Research Projects Agency (DARPA). Perceptually enabled task guidance (PTG) is an artificial intelligence solution to providing task guidance to the user to assist with the completion of various tasks. PTG uses computer vision (CV) technology to identify actions taken by the user and provides detailed instructions for the user to complete the task. Instructions are provided to the user through an AR/​XR head-mounted device. AR/​XR displays overlay data and projects the data in front of the user where it can be referenced in real time without the need to look away at a laptop, publication, or reference material. AR/​XR supported by AI can support multiple military use cases across a wide range of military communities.