TY - JOUR
T1 - System training metrics and measures
T2 - A key operational effectiveness imperative
AU - Verma, Dinesh
AU - Farr, John
AU - Johannesen, Line H.
PY - 2003/10
Y1 - 2003/10
N2 - An assessment framework to make explicit the "cause and effect" relationship between design decisions and their impact on system operations, maintenance, and support is essential to influence new and upgrade program development from the longer-term life-cycle perspective. This becomes even more urgent with increasingly greater utilization of commercial-off-the-shelf (COTS) elements within information and knowledge intensive systems in the commercial (IT, Telecommunication, Banking, Finance) and aerospace domains. These architectures are often characterized by an evolving physical baseline (technology refreshment) driven by obsolescence and end-of-life risk considerations. The first objective of this paper is to present the concept of System Operational Effectiveness (SOE). System Operational Effectiveness serves as a generic framework for a wholistic system assessment by balancing factors pertaining to system performance, availability, process efficiency, and cost. Then, given the significance of system training costs, the results of an industry survey on system training metrics and methods are presented. This survey was conducted to help understand training metrics currently utilized within industry with a particular focus on information and knowledge intensive systems. A subsequent objective is to delineate architectural attributes that can be used to assess architectural goodness with respect to training requirements and cost. This is an ongoing research initiative and initial results from this initiative are also presented.
AB - An assessment framework to make explicit the "cause and effect" relationship between design decisions and their impact on system operations, maintenance, and support is essential to influence new and upgrade program development from the longer-term life-cycle perspective. This becomes even more urgent with increasingly greater utilization of commercial-off-the-shelf (COTS) elements within information and knowledge intensive systems in the commercial (IT, Telecommunication, Banking, Finance) and aerospace domains. These architectures are often characterized by an evolving physical baseline (technology refreshment) driven by obsolescence and end-of-life risk considerations. The first objective of this paper is to present the concept of System Operational Effectiveness (SOE). System Operational Effectiveness serves as a generic framework for a wholistic system assessment by balancing factors pertaining to system performance, availability, process efficiency, and cost. Then, given the significance of system training costs, the results of an industry survey on system training metrics and methods are presented. This survey was conducted to help understand training metrics currently utilized within industry with a particular focus on information and knowledge intensive systems. A subsequent objective is to delineate architectural attributes that can be used to assess architectural goodness with respect to training requirements and cost. This is an ongoing research initiative and initial results from this initiative are also presented.
KW - Architecture evaluation
KW - System operational effectiveness
KW - Training
KW - Training methods survey
KW - Training metrics
UR - http://www.scopus.com/inward/record.url?scp=24744467099&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=24744467099&partnerID=8YFLogxK
U2 - 10.1002/sys.10047
DO - 10.1002/sys.10047
M3 - Review article
AN - SCOPUS:24744467099
SN - 1098-1241
VL - 6
SP - 238
EP - 248
JO - Systems Engineering
JF - Systems Engineering
IS - 4
ER -