Create strength through teamwork. Home Life Coaching Communication Coaching Coach Bios Library Inner Strength Development Inner Strength Theory Emotions Money Sex Relationships Politics Religion Organizational Development --------------- FLEX: Training Evaluation Table of Contents Overview For more information, contact: Gary Schouborg, PhD (925) 932-1982 gary@garynini.com

Schouborg, Gary (1993). FLEX: A Flexible Tool for Continuously Improving Your Evaluation of Training Effectiveness. Amherst, MA: HRD Press. Contents ix Acknowledgments xi The Author 1 How to Use this Manual 2 How to Use the Worksheets 4 What Each Item Means 4 How Worksheets are Interrelated 7 Overview < click for text 10 The 8 Primary Dimensions 15 Constraints on Evaluation 16 Decisions, Decisions 17 Continuously Improving Your Evaluations 17 Two Hot Topics: Training Evaluation and Total Quality 17 The Link between Training Evaluation and Total Quality 18 Your Greatest Enemy: All-or-Nothing Thinking 20 FLEX is FLEXible 21 FLEX is Comprehensive 21 FLEX Provides Perspective 1 - 1 Summarizing the Evaluations · - 3 Purpose · - 3 Users · - 5 Worksheet · - 7 Evaluation Summary · - 9 Glossary 1 - 1 1. Evaluating the Business Results 1 - 3 Purpose 1 - 3 Users 1 - 4 Position in the Hierarchy 1 - 4 Methodology 1 - 5 Worksheets 1 - 7 1. Business Results Evaluation 1 - 9 Benefit to Cost Ratio 1 - 12 Payback Period 1 - 13 Glossary 2 - 1 2. Evaluating the Business Planning 2 - 3 Purpose 2 - 4 Users 2 - 4 Position in the Hierarchy 2 - 5 Methodology 2 - 7 Worksheets 2 - 9 2. Business Planning Evaluation 2 - 11 2.2 Planning: Plausibility of Solution 2 - 13 Benefit to Cost Ratio 2 - 16 Payback Period 2 - 17 Glossary 3 - 1 3. Evaluating the Transfer 3 - 3 Purpose 3 - 4 Users 3 - 4 Position in the Hierarchy 3 - 4 Methodology 3 - 7 Worksheets 3 - 9 3. Transfer Evaluation 3 - 11 3.1 Transfer: Before Training 3 - 13 3.2 Transfer: During Training 3 - 15 3.3 Transfer: After Training 3 - 17 3.4 Transfer: Performance Change 3 - 19 Glossary 4 - 1 4. Evaluating the Learning 4 - 3 Purpose 4 - 3 Users 4 - 4 Position in the Hierarchy 4 - 4 Methodology 4 - 5 Worksheet 4 - 7 4. Learning Evaluation 4 - 9 Glossary 5 - 1 5. Evaluating the Delivery 5 - 3 Purpose 5 - 4 Users 5 - 4 Position in the Hierarchy 5 - 5 Methodology 5 - 7 Worksheets 5 - 9 5. Delivery Evaluation 5 - 11 5.1 Delivery: Builds on Trainee Motivation 5 - 13 5.1.1 Delivery/Motivation: Promotes Attention 5 - 15 5.1.2 Delivery/Motivation: Promotes Relevance 5 - 17 5.1.3 Delivery/Motivation: Promotes Confidence 5 - 19 5.1.4 Delivery/Motivation: Promotes Satisfaction 5 - 21 5.2 Delivery: Facilitates Understanding 5 - 23 5.3 Delivery: Facilitates Skill Development 5 - 25 5.4 Delivery: Facilitates Transfer 5 - 27 5.4.3 Delivery/Transfer: Appropriate Material 5 - 29 5.5 Delivery: Creates Learning Environment 5 - 31 5.6 Delivery: Manages Time Efficiently 5 - 33 Glossary 6 - 1 6. Evaluating the Design 6 - 3 Purpose 6 - 4 Users 6 - 4 Position in the Hierarchy 6 - 5 Methodology 6 - 7 Worksheets 6 - 9 6. Design Evaluation 6 - 11 6.1 Design: Builds on Trainee Motivation 6 - 13 6.1.1 Design/Motivation: Promotes Attention 6 - 15 6.1.2 Design/Motivation: Promotes Relevance 6 - 17 6.1.3 Design/Motivation: Promotes Confidence 6 - 19 6.1.4 Design/Motivation: Promotes Satisfaction 6 - 21 6.2 Design: Facilitates Understanding 6 - 23 6.4 Design: Facilitates Transfer 6 - 25 6.4.3 Design/Transfer: Appropriate Material 6 - 27 6.5 Design: Designs Learning Environment 6 - 29 6.6 Design: Manages Time Efficiently 6 - 31 6.7 Design: Creates Instructor's Guide 6 - 33 Glossary 7 - 1 7. Evaluating the Reaction 7 - 3 Purpose 7 - 3 Users 7 - 3 Position in the Hierarchy 7 - 5 Methodology 7 - 7 Worksheets 7 - 9 7. Reaction Evaluation 7 - 11 FLEX Trainee Survey 7 - 13 Glossary 8 - 1 8. Evaluating the Vendor 8 - 3 Purpose 8 - 3 Users 8 - 3 Position in the Hierarchy 8 - 4 Methodology 8 - 5 Worksheets 8 - 7 8. Vendor Evaluation 8 - 9 Vendor Evaluation Notes 8 - 11 Glossary AA - 1 Appendix A: Why System is Desirable AA - 1 Expert Opinion and Common Sense AA - 2 Availability AA - 3 Representativeness AA - 4 Presupposition AA - 5 Vividness AA - 5 Regression to the Mean AA - 6 Conclusion AA - 7 Objective vs. Subjective AA - 7 Theoretical Introduction AA - 9 Application to Training Evaluation AB - 1 Appendix B: Decision Aids AB - 2 Matrix AB - 5 Introduction to Decision Tree AB - 9 Directions for Using Decision Tree AB - 11 Footnotes AC - 1 Appendix C: Evaluation Designs & Methods AC - 2 Evaluation Designs AC - 3 Pre-Experimental Designs AC - 5 Quasi-Experimental Designs AC - 8 True Experimental Designs AC - 10 The Comparative Advantages of Pretest/Posttest and Posttest-only Designs AC - 11 Methods of Measurement AD - 1 Appendix D: Survey Worksheets AD - 1 Contents AD - 2 Instructions for FLEX Subject Matter Expert (SME) Survey AD - 3 FLEX Subject Matter Expert (SME) Survey AD - 6 Instructions for FLEX Trainee Survey AD - 7 FLEX Trainee Survey AD - 9 Instructions for FLEX Training Transfer Surveys AD - 11 FLEX Training Transfer Surveys (Trainee) AD - 13 FLEX Training Transfer Survey (Supervisor) AE - 1 Appendix E: Program Information Worksheet AF - 1 Appendix F: Executive Summary Worksheets AF - 1 Purpose AF - 1 Contents AF - 2 Example: AF - 3 Executive Summary of Evaluation of Workshop 123 AF - 5 Executive Summary AF - 11 Individual Primary Dimensions: Supporting Detail AF - 23 Blank Survey Worksheets Executive Summary Executive Summary: 1. Business Results Executive Summary: 2. Business Planning Executive Summary: 3. Transfer Executive Summary: 4. Learning Executive Summary: 5. Delivery Executive Summary: 6. Design Executive Summary: 7. Reaction Executive Summary: 8. Vendor R - 1 References To order manual, email coach@garynini.com