Systems Engineering Applied Leading Indicators: Enabling Assessment of Acquisition Technical Performance

Abstract

This paper discusses research in developing DoD acquisition metrics associated with Systems Engineering activities that may provide greater insight into the technical performance of development programs. These metrics are called Systems Engineering Applied Leading Indicators (ALI). We examine current development of single- and multi-factor ALIs that have been developed during the past year at the Naval Air Systems Command (NAVAIR) in Patuxent River, MD. The development methods, early examination of ALI utility, and user acceptance are discussed. The authors have been embedded with the NAVAIR Systems Engineering Development and Implementation Center (SEDIC) (the center of this work for NAVAIR) as part of this ALI exploration. The aim of this research work is to develop a framework for making coordinated acquisitions decisions, integrating: (i) schedules of maintenance based on the condition of system components, and (ii) trigger acquisition of multiple vendor maintenance, repair, and overhaul (MRO) supplies and services. To do so, we develop a multi-objective optimization maintenance/acquisition scheduling algorithm where tradeoffs are made between two competing objectives: maximizing condition-based component reliability while maximizing the sensitivity of condition-based reliability to changes in the component condition (e.g., degradation). This scheduling algorithm integrates with an acquisition algorithm to addresses vendor lead-time. Case studies broadly inspired by Tinker Air Force Base, the largest Air Force MRO hub in the US, in Oklahoma City, OK, illustrate the framework.