Training Program Evaluation

ANSI Z490.1-2016 Training Evaluation Guidelines

As outlined in ANSI Z490.1, Section 3.4, the employer should design evaluation strategies to measure the performance of the safety training program. To do this, one or more evaluation techniques may be used to evaluate training.

Evaluate Reaction, Knowledge, Skills, Application, and Impact (RKSAI)

To make sure the training program is conforming to ANSI/ASSE Z490.1-2016, one evaluation strategy to measure results of training on the employee and the organization is the RKSAI process. In this process, training includes methods to evaluate all of the following key performance indicators (KPIs):

• Reaction - does the learner like the training?
• Knowledge - did the training increase the learner's knowledge?
• Skills - did the training improve the learner's skills?
• Abilities - can the learner apply what they learned to the job?
• Results - how does the training impact the organization?

Note: The first four levels focus on the learner.

It's important that a strategy for evaluating the training be developed when the course objectives and content are developed. It should not be delayed until the training has been completed.

Evaluating Program Effectiveness

To make sure that the training program is accomplishing its goals, an evaluation of the training can be valuable.

• Training should have, as one of its critical components, a method for measuring the effectiveness of the training.
• When course objectives and content are developed for a training program, a plan for evaluating the training session(s) should be designed and integrated into the program’s other elements.
• An evaluation will help employers or supervisors determine the amount of learning achieved and whether a worker’s performance has improved on the job.

Kirkpatrick's Four Levels of Evaluation

The evaluation strategy mentioned in the ANSI standard mirrors those developed by Donald Kirkpatrick, author of Evaluating Training Programs: The Four Levels. Kirkpatrick's four levels are similar to the RKSAI process we mentioned earlier. Kirkpatrick's four levels of evaluation are:

1. Kirkpatrick's Level I Evaluation - Student Reaction: Questionnaires or informal discussions with employees can help employers determine the relevance and appropriateness of the training program.
2. Kirkpatrick's Level II Evaluation - Student learning: This can be accomplished through such activities as demonstration skills or testing.
3. Kirkpatrick's Level III Evaluation - Student application: Supervisors are in good positions to observe an employee's performance both before and after the training and note improvements or changes.
4. Kirkpatrick's Level IV Evaluation - Workplace results: The ultimate success of a training program may be best evaluated by looking at changes throughout the workplace that result in reduced injury or accident rates.

However you conduct the training evaluation, it can give employers the information necessary to decide whether employees achieved the desired results, and whether the training session should be offered again at some future date.

It's important that a strategy for evaluating the training be developed when the course objectives and content are developed. It should not be delayed until the training has been completed.

ANSI Z490.1 Guidelines for Evaluating Training Programs, Process, and Results

ANSI Z490.1-2016, Section 3.4.2, recommends evaluating three important elements of a safety training program.

• How the training program is managed
• The quality of the training process
• The results of training

Let's look at each of these three important elements more closely.

Evaluating the Training Program

Training works best when it's designed and performs as part of an integrated safety management system rather than a series of unrelated training sessions. Below are elements that should be included in the evaluation of a training program.

• Responsibility and accountability
• Quality of facilities and equipment
• Adequacy of program development
• Quality of delivery
• Completeness of documentation and records
• Adequacy of the safety training program evaluation process

Evaluating the Training Process

In an effective training program the training should be conducted using a systematic process that includes a needs assessment, objectives, course materials, lesson plans, evaluation strategies, and criteria for successful completion. Areas of emphasis include:

• training goals;
• learning environment;
• learning objectives; and
• training effectiveness.

Evaluating the Training Results

By evaluating the results of training, it's possible to make improvements to existing plans and gain awareness of the need for new training. Items to evaluate include:

• quality of the training action-plan;
• adequacy of long-term planning;
• use of needs assessment;
• appropriateness of prioritizing training; and
• adequacy of support and funding.

Instructions

Before beginning this quiz, we highly recommend you review the module material. This quiz is designed to allow you to self-check your comprehension of the module content, but only focuses on key concepts and ideas.

Read each question carefully. Select the best answer, even if more than one answer seems possible. When done, click on the "Get Quiz Answers" button. If you do not answer all the questions, you will receive an error message.

Good luck!