search menu icon-carat-right cmu-wordmark

Characterizing Technical Software Performance Within System of Systems Acquisitions: A Step-Wise Methodology

Technical Report
This report focuses on both qualitative and quantitative ways of determining the current state of SWP (software performance) in terms of both test coverage and confidence for SOA-based SoS environments.
Publisher

Software Engineering Institute

CMU/SEI Report Number
CMU/SEI-2010-TR-007
DOI (Digital Object Identifier)
10.1184/R1/6572213.v1

Abstract

The characterization of software performance (SWP) in complex, service-oriented architecture (SOA)-based system of systems (SoS) environments is an emergent study area. This report focuses on both qualitative and quantitative ways of determining the current state of SWP in terms of both test coverage (what has been tested) and confidence (degree of testing) for SOA-based SoS environments. Practical tools and methodologies are offered to aid technical and programmatic managers:

  • a stepwise methodology toward SWP selection
  • SWP and system architecture design considerations
  • resource limiters of SWP
  • SWP and test event design considerations
  • organizational and process suggestions toward improved SWP management
  • a matrix of measures including test fidelity and realism levels

These tools are not complete, but do offer a good starting point with the intent to encourage contributions to this growing body of knowledge. This report is intended to benefit leaders within the varied acquisition communities, Program Executive Offices, and Program Management Offices. It provides detailed guidance for use by technical leadership as well.

Supplemental Materials

Cite This Technical Report

Meyer, B., & Wessel, J. (2010, April 1). Characterizing Technical Software Performance Within System of Systems Acquisitions: A Step-Wise Methodology. (Technical Report CMU/SEI-2010-TR-007). Retrieved May 23, 2024, from https://doi.org/10.1184/R1/6572213.v1.

@techreport{meyer_2010,
author={Meyer, Bryce and Wessel, James},
title={Characterizing Technical Software Performance Within System of Systems Acquisitions: A Step-Wise Methodology},
month={Apr},
year={2010},
number={CMU/SEI-2010-TR-007},
howpublished={Carnegie Mellon University, Software Engineering Institute's Digital Library},
url={https://doi.org/10.1184/R1/6572213.v1},
note={Accessed: 2024-May-23}
}

Meyer, Bryce, and James Wessel. "Characterizing Technical Software Performance Within System of Systems Acquisitions: A Step-Wise Methodology." (CMU/SEI-2010-TR-007). Carnegie Mellon University, Software Engineering Institute's Digital Library. Software Engineering Institute, April 1, 2010. https://doi.org/10.1184/R1/6572213.v1.

B. Meyer, and J. Wessel, "Characterizing Technical Software Performance Within System of Systems Acquisitions: A Step-Wise Methodology," Carnegie Mellon University, Software Engineering Institute's Digital Library. Software Engineering Institute, Technical Report CMU/SEI-2010-TR-007, 1-Apr-2010 [Online]. Available: https://doi.org/10.1184/R1/6572213.v1. [Accessed: 23-May-2024].

Meyer, Bryce, and James Wessel. "Characterizing Technical Software Performance Within System of Systems Acquisitions: A Step-Wise Methodology." (Technical Report CMU/SEI-2010-TR-007). Carnegie Mellon University, Software Engineering Institute's Digital Library, Software Engineering Institute, 1 Apr. 2010. https://doi.org/10.1184/R1/6572213.v1. Accessed 23 May. 2024.

Meyer, Bryce; & Wessel, James. Characterizing Technical Software Performance Within System of Systems Acquisitions: A Step-Wise Methodology. CMU/SEI-2010-TR-007. Software Engineering Institute. 2010. https://doi.org/10.1184/R1/6572213.v1