Modeling and Simulation Validation Overview

The purpose of this two-day simulation course is to present a comprehensive discussion of practical techniques for validating your models and simulations. All techniques will be illustrated by one or more examples based on actual simulation projects. At the end of the seminar, each attendee will be familiar with “the” twelve fundamental validation techniques and know how to apply them to their models and simulations. The development of this seminar has benefited from contracts with the Defense Modeling and Simulation Office (now the Modeling and Simulation Coordination Office) and the Office of Naval Research.

A particular highlight of this seminar is the discussion and illustration of an assumptions document, which is a detailed report delineating all model concepts, assumptions, algorithms, and data summaries. It serves as the main vehicle for communications among the project team, and it is a “blueprint” for creating the simulation computer program. It should not be confused with a conceptual model, which can be thought of as initial ideas on what a model will look like. Dr. Averill M. Law, the course instructor, has been intimately involved in the problem formulation, validation, and analysis of approximately 40 simulation models.

He has been a validation consultant to organizations such as Booz Allen and Hamilton, ITT, Stanley Tools, U.S. Air Force, U.S. Army, U.S. Marine Corps, and U.S. Navy.

Versions of this seminar have been presented to Boeing, Lockheed Martin, NSA, Raytheon, Sasol Technology (South Africa), U.S. Army, U.S. Navy, International Council on Systems Engineering (INCOSE), and International Test and Evaluation Association (ITEA).

Outline

What You Will Learn:

  1. Seven Important Steps in a Sound Study
  2. Formulating the Problem Precisely
  3. Talking to Appropriate Subject-Matter Experts
  4. Interacting with the Decision-Maker on a Regular Basis
  5. Using Quantitative Techniques to Validate Components of the Model
  6. Developing a Written Assumptions Document
  7. Performing a Structured Walk-Through of the Assumptions Document
  8. Using Sensitivity Analysis to Determine Important Model Factors
  9. Results Validation
  10. Using Animation to Show that a Model is not Valid and to Enhance Credibility
  11. Guidelines for Obtaining Good Model Data
  12. Additional Topics
  13. 6 Critical Pitfalls and How to Avoid Them