Training Evaluation Methodology

Article Image

Before evaluating training, HumRRO often conducts an assessment of the extent to which training follows principles of adult learning and instructional systems design. If the standards of adult learning and instructional systems design (ISD) have not been met, HumRRO makes recommendations and is happy to work with clients to improve the quality of the training design.
 
Following the assessment of these standards, HumRRO often uses the Phillips Return on Investment (ROI) Methodology to evaluate training. This methodology offers a systematic approach to evaluating training and development courses and programs. The process develops six types of data, reporting the chain of impact that occurs as participants react positively to a course, acquire knowledge and skills, apply the knowledge and skills acquired, then, as a result, improve key business impact measures that the course was intended to improve. When necessary, the improvement in the impact measures is converted to monetary value, then compared to the fully-loaded costs of the course to calculate the return on investment (ROI). Those measures not converted to monetary value are reported as intangible benefits – often the most important measures of success. The data collected are categorized into five levels of evaluation as shown in the table below.

Five-Level Evaluation Framework

Level Measurement Focus
1. Reaction & Planned Action Measures participant satisfaction with the program and captures planned action
2. Learning Measures changes in knowledge, skills, and attitudes
3. Application & Implementation Measures changes in on-the-job behavior
4. Business Impact Measures changes in critical business measures
5. Return on Investment (ROI) Compares the monetary benefits to the costs
Data collection at each level requires a variety of considerations, including selecting the:
  • Data collection technique 
  • Data source 
  • Data collection timing
HumRRO is happy to work with clients to develop a customized approach to analyzing and evaluating training programs.

filed under: