Training Evaluation Methodology
Before evaluating training, HumRRO often conducts an assessment of the extent to which training follows principles of adult learning and instructional systems design. If the standards of adult learning and instructional systems design (ISD) have not been met, HumRRO makes recommendations and is happy to work with clients to improve the quality of the training design.
Following the assessment of these standards, HumRRO often uses the Phillips Return on Investment (ROI) Methodology to evaluate training. This methodology offers a systematic approach to evaluating training and development courses and programs. The process develops six types of data, reporting the chain of impact that occurs as participants react positively to a course, acquire knowledge and skills, apply the knowledge and skills acquired, then, as a result, improve key business impact measures that the course was intended to improve. When necessary, the improvement in the impact measures is converted to monetary value, then compared to the fully-loaded costs of the course to calculate the return on investment (ROI). Those measures not converted to monetary value are reported as intangible benefits – often the most important measures of success. The data collected are categorized into five levels of evaluation as shown in the table below.
Five-Level Evaluation Framework
| Level | Measurement Focus |
|---|---|
| 1. Reaction & Planned Action | Measures participant satisfaction with the program and captures planned action |
| 2. Learning | Measures changes in knowledge, skills, and attitudes |
| 3. Application & Implementation | Measures changes in on-the-job behavior |
| 4. Business Impact | Measures changes in critical business measures |
| 5. Return on Investment (ROI) | Compares the monetary benefits to the costs |
Data collection at each level requires a variety of considerations, including selecting the:
- Data collection technique
- Data source
- Data collection timing
HumRRO is happy to work with clients to develop a customized approach to analyzing and evaluating training programs.
Browse content with Tags
Assessments
Awards
Compensation
Credentialing
Educational Research
ENWIMP
Evaluation
Graduate Students
Human Capital
Instructional Systems Development
Internships
Leadership Development
Non-profit
OPM
Organization
Performance Management
Personnel Selection
Policy Analysis
Program
Promotion
ROI
Selection Classification
SIOP
SPIE
Survey-Based Evaluations
Training
US Army
US Military
wead
web

