search menu icon-carat-right cmu-wordmark

Evaluating Artifact Quality from an Appraisal Perspective

Technical Note
This report explores the lack of agreement among SCAMPI Lead Appraisers about what “artifact quality” means in the SCAMPI process context.
Publisher

Software Engineering Institute

CMU/SEI Report Number
CMU/SEI-2009-TN-021
DOI (Digital Object Identifier)
10.1184/R1/6573521.v1
Subjects

Abstract

A question currently being argued throughout the appraisal community concerns evaluation of artifact quality during Standard CMMI Appraisal Method for Process Improvement (SCAMPI) appraisals. Different, conflicting opinions on whether evaluation of artifact quality during a SCAMPI is appropriate run from an extremely vigorous “no” to an equally vigorous “yes!” In other words, some lead appraisers and teams believe artifact quality is totally outside the scope of a SCAMPI appraisal. Other appraisers and teams believe that evaluating artifact quality is an integral part of the SCAMPI.  

This technical note examines the various opinions in an attempt to resolve the confusion. 

The main issue appears to be linked to word definitions—specifically, a lack of agreement among SCAMPI lead appraisers about what “quality” means in the SCAMPI context. This report notes that earlier writings on the subject focus on the problem of defining the attributes of artifact quality in appraisals. Three attributes—appropriate, adequate, and reasonable—are recognized throughout the community as applicable to the quality of artifacts. However, these attributes are not defined, creating the opportunity to apply subjective rules where objectivity is critical. With this information in hand, we can initiate an effort to provide more clear-cut, succinct guidance on the application of quality attributes to appraisal artifacts. This effort will enable Lead Appraisers and team members to inject greater objectivity into appraisals.

Cite This Technical Note

Baker, E., Fisher, M., & Gross, C. (2009, November 1). Evaluating Artifact Quality from an Appraisal Perspective. (Technical Note CMU/SEI-2009-TN-021). Retrieved March 5, 2024, from https://doi.org/10.1184/R1/6573521.v1.

@techreport{baker_2009,
author={Baker, Emanuel and Fisher, Matthew and Gross, Charlene},
title={Evaluating Artifact Quality from an Appraisal Perspective},
month={Nov},
year={2009},
number={CMU/SEI-2009-TN-021},
howpublished={Carnegie Mellon University, Software Engineering Institute's Digital Library},
url={https://doi.org/10.1184/R1/6573521.v1},
note={Accessed: 2024-Mar-5}
}

Baker, Emanuel, Matthew Fisher, and Charlene Gross. "Evaluating Artifact Quality from an Appraisal Perspective." (CMU/SEI-2009-TN-021). Carnegie Mellon University, Software Engineering Institute's Digital Library. Software Engineering Institute, November 1, 2009. https://doi.org/10.1184/R1/6573521.v1.

E. Baker, M. Fisher, and C. Gross, "Evaluating Artifact Quality from an Appraisal Perspective," Carnegie Mellon University, Software Engineering Institute's Digital Library. Software Engineering Institute, Technical Note CMU/SEI-2009-TN-021, 1-Nov-2009 [Online]. Available: https://doi.org/10.1184/R1/6573521.v1. [Accessed: 5-Mar-2024].

Baker, Emanuel, Matthew Fisher, and Charlene Gross. "Evaluating Artifact Quality from an Appraisal Perspective." (Technical Note CMU/SEI-2009-TN-021). Carnegie Mellon University, Software Engineering Institute's Digital Library, Software Engineering Institute, 1 Nov. 2009. https://doi.org/10.1184/R1/6573521.v1. Accessed 5 Mar. 2024.

Baker, Emanuel; Fisher, Matthew; & Gross, Charlene. Evaluating Artifact Quality from an Appraisal Perspective. CMU/SEI-2009-TN-021. Software Engineering Institute. 2009. https://doi.org/10.1184/R1/6573521.v1