Why were key performance parameters KPP and key system attributes KSA developed?

Key Performance Parameters (KPPs) specify what the critical performance goals are in a United States Department of Defense (DoD) acquisition under the JCIDS process.[1][2]

The JCIDS intent for KPPs is to have a few measures stated where the acquisition product either meets the stated performance measure or else the program will be considered a failure[3] per instructions CJCSI 3170.01H – Joint Capabilities Integration and Development System. The mandates require 3 to 8 KPPs be specified for a United States Department of Defense major acquisition, known as Acquisition Category 1 or ACAT-I.

The term is defined as "Performance attributes of a system considered critical to the development of an effective military capability. A KPP normally has a threshold representing the minimum acceptable value achievable at low-to-moderate risk, and an objective, representing the desired operational goal but at higher risk in cost, schedule, and performance. KPPs are contained in the Capability Development Document (CDD) and the Capability Production Document (CPD) and are included verbatim in the Acquisition Program Baseline (APB). KPPs are considered Measures of Performance (MOPs) by the operational test community."[4]

Commentary notes that metrics must be chosen carefully, and that they are hard to define and apply throughout a projects life cycle.[5] It is also desired that KPPs of a program avoid repetition, and to be something applicable among different programs such as fuel efficiency.[6] Higher numbers of KPPs are associated to program and schedule instability.[7]

• Before the project starts to assess the feasibility of success.
• During the project to assure the work is performed in accordance with (IAW) the plan.
• After project completion to capture and assess the lessons learned to build a reference class database for the next project.

Failure to do these actions is itself a root cause of project failure.

Key Performance Parameters

KPPs are considered the most essential for successful mission accomplishment. KPPs represent those capabilities or characteristics so significant that failure to meet the threshold value of performance can be cause for the concept or system selected to be reevaluated, or the program to be reassessed or terminated. Each KPP has a threshold and an objective value.

Trade studies typically may trade off everything, except a KPP. In other words, KPPs are non-trade-able. They flow from the operational requirements. They are documented in the Operational Requirements Document, the Capability Development Document, or the Capability Production Document.

Key System Attributes

KSAs are attributes considered most critical or essential for an effective capability but not selected as KPPs. KSAs provide decision makers with an additional level of capability prioritization below the KPP. A KSA does not have to be related to a KPP and there is no implication that multiple KSA’s equal a KPP.

Measures Of Effectiveness

MOEs are a measure of how well an operational task or task element is accomplished through using a system. The data used to measure the effect (mission accomplishment) comes from the use of the system in its expected environment.

MOEs often have green/yellow/red limits established early in the program and are tracked until they turn green or are demonstrated to be unachievable. The MOE can be stated either as a question or a declarative statement. The MOE is often stated in terms of accomplishment gained per cost incurred.

Measures of Performance

MOPs are components, or subsets, of MOEs. The degree-to-which a system performs is one of a number of possible measures of how well a system's task is accomplished. MOPs can be accumulated to assess an MOE that is not directly measurable. Several MOPs may be related to the achievement of a particular MOE.

MOPs supply supporting data to determine MOE status as it evolves over the life of a program. Together they determine what constitutes successful operations for the system. MOPs and MOEs are derived from requirements or the Concept of Operations. Their selection should be based on their ability to discriminate between levels of good performance.

Key Performance Parameters (KPP) are key system capabilities that must be met for a system to meet its operational goals set by the user/customer. These key capabilities form the foundation of any system and are deemed vital to its performance, function, design, and operations. Any changes to the KPP would have a significant impact on the performance of the system along with the development cost and schedule. That’s why they have been deemed the most important attributes of a system.

Advertisements

In the Defense Acquisition System, the Capability Development Document (CDD) and Capability Production Document (CPD) identify the KPP(s) that contribute to the desired operational capability in a threshold and objective format.  Each KPP is supported by an operational analysis that considers technology maturity, fiscal constraints, and schedule before determining threshold and objective values. If an attribute is considered important but not critical to meeting system goals, it can be classified as a Key System Attribute (KSA).

Definition: Key Performance Parameters are attributes of a system considered critical to the development of an effective military capability. The number of KPPs identified by a Sponsor should be kept to a minimum to maintain program flexibility.  Failure of a system to meet a validated KPP threshold/initial minimum rescinds the validation, brings the military utility of the associated system(s) into question, and may result in a reevaluation of the program or modification to production increments. [1]

See: Manual for the Operation of the JCIDS – Enclosure B, Appendix A

Key Performance Parameters (KPP) Values

A KPP or KSA’s threshold value is the minimum acceptable value considering cost, schedule, and technology. Performance below the threshold value is not operationally effective or suitable. A KPP also has an objective value that is the desired operational goal considering cost, schedule, and technology. Performance above the objective value does not justify the additional expense. The difference between the threshold and objective values sets the trade space.

Advertisements

• Threshold Value: an attribute is the “Minimum Acceptable Level” value considered achievable within the available cost, schedule, and technology at low-to-moderate risk.
• Objective Value: an attribute is applicable when a “Desired Level” of performance represents a significant increase in operational utility.

Key Performance Parameters (KPP) Validation

All KPPs and Key System Attributes (KSA) are validated by the Joint Requirement Oversight Council (JROC). Advances in technology or changes to system goals may result in changes to the KPP and KSA threshold and objective values, which will have to be validated by the JROC again. Below is the list of mandatory KPP that every system shall have according to the JCIDS Manual – Enclosure B (Appendix A).

Mandatory Key Performance Parameters (KPP) per para 2.5.4 2018 JCIDS Manual:

• System Survivability
• Force Protection
• Energy
• Sustainment

Key Performance Parameters (KPP) Development Steps: [1]

• Step 1: List required capabilities for each mission or function as described in the proposed CDD or CPD.
• Step 2: Review for applicability the list of attributes associated with each of the joint functions.
• Step 3: For each mission or function, build at least one measurable performance attribute using the list from Step 2 as a starting point.
• Step 4: Determine the attributes that are most critical or essential to the system(s) and designate them as KPPs.
• Step 5: Document how the KPPs are responsive to the capability performance attributes identified in the Initial Capability Documents (ICD)s in support of the mission outcomes and associated desired effects.

Guidelines for Identifying the Capstone Concepts Joint Operation (CCJO)-derived KPP:

• Based on the system’s primary mission, does it contribute to one or more of the CCJO characteristics of the future joint force? For example, a bomber could contribute to multiple key characteristics: expeditionary, adaptable, and enduring/persistent, and an unmanned aerial vehicle could contribute to knowledge-empowered, networked, and enduring/persistent.
• Does the system have other attributes that contribute significantly to any of the CCJO characteristics of the future joint force? For example, the tactical data link on a fighter may contribute to the overall networked characteristic and the primary mission of the fighter.
• If the answer is yes to either of the above, designate at least one (if not more) attribute as a KPP for each relevant characteristic. It is not necessary to designate as a KPP every attribute associated with a particular characteristic, only those most essential to the capability.

Difference Between a Key Performance Parameter (KPP) and Key System Attribute (KSA)

If an attribute is considered important but not critical to meeting system goals, it can be classified as a Key System Attribute (KSA). A KSA is a system capability considered crucial in support of achieving a balanced solution/approach to a Key Performance Parameter (KPP) or some other key performance attribute deemed necessary by the sponsor.

Advertisements

AcqNotes Tutorial

Requirements Development Steps

There is no set standard way to develop requirements but they are normally developed following the same basic six (6) steps. These requirements development steps don’t really change depending on which SE model is used. All models are similar in their approach but they just usually depict the step differently graphically. The main model that is used is the Systems Engineering “Vee” where requirements development is depicted on the left side.

What is KPP and KSA?

What is KPP performance management?

What is a performance attribute of a system considered critical or essential to the development of an effective military capability?

What are the 4 mandatory key performance parameters?