Simulation models often have many input factors and determining which ones have a significant impact on performance measures (responses) of interest can be a truly daunting task. The common approach of changing one factor at a time is very often incorrect, because for many models factors interact to impact on the responses. In this 3-day course we give a comprehensive presentation of design of experiments (DOE) specifically for simulation modeling, whose major goal is to determine which factors have the greatest effect on the responses. Another important use of DOE is to develop a metamodel (a simplified model of the simulation model) based on the important factors to predict the model response for factor-level combinations that were not actually simulated because a prediction is needed in real time or because of execution-time constraints. A metamodel can also be used to find the factor combination that optimizes the simulation response.

We discuss a simple and widely applicable approach for determining significant factors in the context of simulation modeling. Methods designed for physical experiments, which are discussed in university courses or implemented in statistical software, make assumptions (monotonic responses, normal errors, lack of higher-way interactions, etc.) that are rarely satisfied in practice. Students will analyze simulation-response data in class using a leading DOE software package, and be prepared to apply their knowledge the following week at work.

Each attendee will receive a copy of the book Simulation Modeling and Analysis (6th Edition, McGraw-Hill, 2024) by Dr. Averill M. Law as part of their registration fee – this book is widely considered to be the “bible” of simulation with more than 178,000 copies in print and 24,900 citations. Versions of this seminar have been presented to Australian Department of Defence (2 times), Lockheed Martin, Middle East Technical University/Roketsan (Turkey), Sasol Technology (South Africa), and the U.S. Navy (2 times).

“This is an excellent class. I attended this years ago and continue to use the information that I learned from Dr. Law.” David Krahl, Senior Simulation Engineer, Engineering Industries eXcellence, 2-21-2021

“The design of experiments class was fantastic. I would recommend it to everyone who works with simulation models.” Robin Clark, Ph.D. student at the University of Tennessee, Simulation Analyst, QMT Group, 4-12-2021

Outline

What You Will Learn (look to the right for more detail):

  1. Factorial Designs for Determining Important Model Factors
  2. Fractional Factorial Designs for Reducing the Required Number of Simulation Runs
  3. Classical Metamodels Based on Central-Composite Designs and Regression for Prediction or Optimization
  4. Simulation Metamodels Based on Space-Filling Designs and Kriging (Gaussian Process Modeling) or Neural Networks.
  5. Critical Dangers of Using Standard Experimental Designs and Analyses for Simulation Modeling
  6. Commercial Software for DOE That Are Appropriate for Simulation Modeling
  7. Numerous Examples and In-Class Exercises to Illustrate the Mechanics and Applications of DOE