Please use this identifier to cite or link to this item:
https://dair.nps.edu/handle/123456789/4313
Title: | Acquiring Artificial Intelligence Systems: Development Challenges, Implementation Risks, and Cost/Benefits Opportunities |
Authors: | Thomas Housel, Johnathan Mun Raymond Jones, Timothy Shives |
Keywords: | Artificial Intelligence Systems Development Challenges Risks Cost/Benefits Opportunities |
Issue Date: | 8-Feb-2021 |
Publisher: | Acquisition Research Program |
Citation: | Published--Unlimited Distribution |
Series/Report no.: | Artificial Intelligence;NPS-PM-21-014 |
Abstract: | The acquisition of artificial intelligence (AI) systems is a relatively new challenge for the U.S. Department of Defense (DoD). Given the potential for high-risk failures of AI system acquisitions, it is critical for the acquisition community to examine new analytical and decision-making approaches to managing the acquisition of these systems in addition to the existing approaches (i.e., Earned Value Management, or EVM). In addition, many of these systems reside in small start-up or relatively immature system development companies, further clouding the acquisition process due to their unique business processes when compared to the large defense contractors. This can lead to limited access to data, information, and processes that are required in the standard DoD acquisition approach (i.e., the 5000 series). The well-known recurring problems in acquiring information technology automation within the DoD will likely be exacerbated in acquiring complex and risky AI systems. Therefore, more robust, agile, and analytically driven acquisition methodologies will be required to help avoid costly disasters in acquiring these kinds of systems. This research provides a set of analytical tools for acquiring organically developed AI systems through a comparison and contrast of the proposed methodologies that will demonstrate when and how each method can be applied to improve the acquisitions lifecycle for AI systems, as well as provide additional insights and examples of how some of these methods can be applied. This research identifies, reviews, and proposes advanced quantitative, analytically based methods within the integrated risk management (IRM)) and knowledge value added (KVA) methodologies to complement the current EVM approach. This research examines whether the various methodologies—EVM, KVA, and IRM—could be used within the Defense Acquisition System (DAS) to improve the acquisition of AI. While this paper does not recommend one of these methodologies over the other, certain methodologies, specifically IRM, may be more beneficial when used throughout the entire acquisition process instead of within a portion of the system. Due to this complexity of AI system, this research looks at AI as a whole and not specific types of AI. |
Description: | Program Management / NPS Faculty |
URI: | https://dair.nps.edu/handle/123456789/4313 |
Appears in Collections: | Sponsored Acquisition Research & Technical Reports |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
NPS-PM-21-014.pdf | Technical Report | 4.15 MB | Adobe PDF | View/Open |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.