Blog

Verification and Validation in Computer-Aided Engineering – Explained

fea software for structural mechanics simulation on a motorbike swingarm

Computer-aided engineering (CAE) is one of the most powerful tools of the recent era, utilized in almost every field to provide efficient, cost-effective results. Conducting physical experiments for each design version is both time and cost intensive. Instead, design engineers can perform numerical studies to reduce the number of prototypes, saving a significant amount of effort, money, and time. However, no matter how well the simulation software performs, it is unlikely that the numerical analysis will provide 100% accuracy.

For a reliable numerical analysis, verification and validation assessments (V&V) are the proposed models that are implemented in various fields such as engineering, medicine, informatics, and economics. Even though verification and validation are generally used interchangeably, they are actually distinct concepts, investigating the accuracy and credibility of numerical studies from different perspectives.


SimScale’s CEO David Heiny tests the capabilities of the cloud-based CAE platform to solve a real-life engineering problem. Click on the button below, fill in the form, and watch this free webinar to see how!


Verification

  • Investigates if the computational model accurately represents the underlying mathematical model and also if the resulting code can be properly used for an analysis [1]
  • Asks the question: “Are we building the system correctly?” [2]
  • Focuses on solving the equations in a suitable way [3]
  • Examines numerical uncertainty

Validation

  • Determines if the computational simulation agrees with the physical reality [1]
  • Asks the question: “Are we building the right system?” [2]
  • Focuses on solving the correct equations (i.e., getting the physics right) [3]
  • Examines the difference between the numerical simulation and the experimental results

Standards for Verification and Validation

With the increasing use of computer-aided engineering software in the last 50 years, a standard regarding verification and validation has become a necessity. The first V&V guideline was issued by the American Nuclear Society in 1987. Further development of V&V guidelines was conducted by other professional organizations to provide industry-specific standards. In 1998, the American Institute of Aeronautics and Astronautics (AIAA) released its first modern standards document. Thereafter, the American Society of Mechanics Engineers (ASME) V&V Standards Committee issued documents related to fluid dynamics and solid mechanics, including:

  • A Standard for Verification and Validation in Computational Fluid Dynamics and Heat Transfer, ASME V&V-20 (2009).
  • An Illustration of the Concepts of Verification and Validation in Computational Solid Mechanics, ASME V&V-10.1 (2012).

Mathematical commands for an easily-expressed example of verification and validation can be used. Imagine a study of the product of 3 and 1. To obtain the result of 3, either multiplication or division can be applied. When a division is applied to solve the problem, it gives an accurate result for the product of 3 and 1, but when the same logic is applied to the product of 4 and 2 to check for consistency, the division command severely fails (Figure 1).

verification and validation process v&v

Figure 1: Examination of the verification and validation process according to the example of fundamental math commands.

Aside from basic mathematical commands, both CFD and FEA encompass nonlinear equations and complicated simulation steps to describe physical systems. Hence, V&V assessments should be carried out separately and incrementally to ensure reliable processes. In order to avoid false conclusions regarding the validity of the model, it is necessary to perform a verification assessment before a validation assessment. If the verification assessment has ambiguities which result in errors, the validity of the model fails simultaneously [5]. If the verification process succeeds, the validation process must be confirmed with experimental studies as it is required that the comparison studies rely upon real-time data.

Verification is the process that investigates the solution of the equations with regards to the verification of code (programming) and the verification of the calculation (mathematical models and numerical methods). The fundamental duties of the process consist of finding programming errors and examining mathematical calculations in order to solve the equations correctly. The steps of verification assessment [4] include:

  • Error detection in the underlying computer programming code
  • Iterative convergence
  • Grid convergence
  • Temporal convergence analysis for transient cases
  • Comparison of results with a reliable solution

The validation assessment examines the relationship between the equations and the physical experiments in order to solve the correct equations. An experimental setup such as a benchmark is used to conduct studies to investigate the physics. During experimental studies, some level of error occurs and thus it is essential to ensure that the experimental results are reproducible. The main steps of the validation process [4] can be summarised as follows:

  • Comparison between the CFD or FEA results and the experimental data
  • Investigation of numerical model uncertainties (for example, the turbulence model)

The complete process of analysis based on V&V assessments is shown in Figure 2:

verification and validation process v&v assessment

Figure 2: V&V assessment through an entire analysis according to ASME V&V-20 [4]

We can conclude that it is obvious that V&V assessments should be implemented in all studies encompassing numerical analysis. However, due to varying error rates throughout both the verification and validation processes, 100% accuracy is almost impossible. Hence, for V&V assessments, it is essential to specify the level of acceptable error regarding the model and solution.

If you are interested in learning more about verification and validation, check out this list of public validations performed with SimScale.

simulation experimental data comparison, simulation result validation

Figure 3: An example of comparison between experimental data and simulation with SimScale


References

1. Overview of CFD Verification and Validation, NASA, 2008.

2. Barry Boehm, Software Engineering Economics, 1981.

3. Patrick J. Roache, Verification and Validation in Computational Science and Engineering, 1998.

4. A Standard for Verification and Validation in Computational Fluid Dynamics and Heat Transfer, ASME, V&V-20, 2009.

5. Guide for Verification & Validation in Computational Solid Mechanics, ASME, V&V10, 2006.

SimScale is the world's first cloud-based simulation platform, enabling you to perform CFD, FEA, or thermal analyses. Sign up for the 14-day free trial and join the community of 70 000 engineers and designers. No payment data required.