TY - GEN
T1 - Criteria for the Analysis of Gaps and Limitations of VV Methods for Safety- and Security-Critical Systems
AU - Ferrari, Enrico
AU - Schlick, Rupert
AU - Vara, Jose Luis de la
AU - Folkesson, Peter
AU - Sangchoolie, Behrooz
PY - 2022
Y1 - 2022
N2 - As society increasingly relies on safety- and security- critical systems, the need for confirming their dependability becomes essential. Adequate V&V (verification and validation) methods must be employed, e.g., for system testing. When selecting and using the methods, it is important to analyze their possible gaps and limitations, such as scalability issues. However, and as we have experienced, common, explicitly defined criteria are seldom used for such analyses. This results in analyses that consider different aspects and to a different extent, hindering their comparison and thus the comparison of the V&V methods. As a solution, we present a set of criteria for the analysis of gaps and limitations of V&V methods for safety- and security-critical systems. The criteria have been identified in the scope of the VALU3S project. Sixty-two people from 33 organizations agreed upon the use of nine criteria: functionality, accuracy, scalability, deployment, learning curve, automation, reference environment, cost, and standards. Their use led to more homogeneous and more detailed analyses when compared to similar previous efforts. We argue that the proposed criteria can be helpful to others when having to deal with similar activities.
AB - As society increasingly relies on safety- and security- critical systems, the need for confirming their dependability becomes essential. Adequate V&V (verification and validation) methods must be employed, e.g., for system testing. When selecting and using the methods, it is important to analyze their possible gaps and limitations, such as scalability issues. However, and as we have experienced, common, explicitly defined criteria are seldom used for such analyses. This results in analyses that consider different aspects and to a different extent, hindering their comparison and thus the comparison of the V&V methods. As a solution, we present a set of criteria for the analysis of gaps and limitations of V&V methods for safety- and security-critical systems. The criteria have been identified in the scope of the VALU3S project. Sixty-two people from 33 organizations agreed upon the use of nine criteria: functionality, accuracy, scalability, deployment, learning curve, automation, reference environment, cost, and standards. Their use led to more homogeneous and more detailed analyses when compared to similar previous efforts. We argue that the proposed criteria can be helpful to others when having to deal with similar activities.
U2 - 10.1007/978-3-031-14862-0_9
DO - 10.1007/978-3-031-14862-0_9
M3 - Conference Proceedings with Oral Presentation
SN - 978-3-031-14861-3
VL - 13415
T3 - Lecture Notes in Computer Science
SP - 35
EP - 46
BT - Computer Safety, Reliability, and Security. SAFECOMP 2022 Workshops - DECSoS, DepDevOps, SASSUR, SENSEI, USDAI, and WAISE, Munich, Germany, September 6-9, 2022, Proceedings
A2 - Trapp, Mario
A2 - Schoitsch, Erwin
A2 - Guiochet, Jérémie
A2 - Bitsch, Friedemann
PB - Springer
T2 - Computer Safety, Reliability, and Security. SAFECOMP 2022 Workshops
Y2 - 6 September 2022 through 9 September 2022
ER -