Training Program Evaluation

ANSI Z490.1-2016 Training Evaluation Guidelines

As outlined in detail in ANSI Z490.1, Section 3.4, the employer should design evaluation strategies to measure the performance of the safety training program. To do this, one or more evaluation techniques may be used to evaluate training.

The evaluation strategy mentioned in the ANSI standard mirror those developed by Donald Kirkpatrick, author of Evaluating Training Programs: The Four Levels.

As the title of the book implies, he developed a four-level model for evaluating training. The first three levels of evaluation, those that you'll be involved with most of the time, measure the impact of training on the learner. The fourth level measures the impact on the organization. Let's take a look at these four levels of evaluation.

Purpose of Training Evaluation

1. the amount of learning achieved by training; and
2. whether an employee's performance has improved on the job as result of training.

Below are some methods commonly used to evaluate the effectiveness of training.

1. Employee opinion: Questionnaires or informal discussions with employees can help employers determine the relevance and appropriateness of the training program.
2. Supervisor observations: Supervisors are in good positions to observe an employee's performance both before and after the training and note improvements or changes.
3. Workplace improvements: The ultimate success of a training program may be best evaluated by looking at changes throughout the workplace that result in reduced injury or accident rates.

However you conduct the training evaluation, it can give employers the information necessary to decide whether employees achieved the desired results, and whether the training session should be offered again at some future date.

Evaluate Reaction, Knowledge, Skills, Application, and Impact (RKSAI)

To make sure the training program is conforming to ANSI/ASSE Z490.1-2016, an evaluation strategy to measure results of training on the employee and the organization is required. Training should include methods to evaluate:

• REACTION - does the learner like the training?
• LEARNING - did the training improve the learner's knowledge and skills?
• APPLICATION - can the learner apply what they learned to the job?
• RESULTS - how does the training impact the organization?

Note: The first three levels focus on the learner.

It's important that a strategy for evaluating the training be developed when the course objectives and content are developed. It should not be delayed until the training has been completed.

ANSI Z490.1 Guidelines for Evaluating Training Programs, Process, and Results

ANSI Z490.1-2016, Section 3.4.2, recommends evaluating three important elements of a safety training program.

• How the training program is managed
• The quality of the training process
• The results of training

Let's look at each of these three important elements more closely.

Evaluating the Training Program

Training works best when it's designed and performs as part of an integrated safety management system rather than a series of unrelated training sessions. Below are elements that should be included in the evaluation of a training program.

• Responsibility and accountability
• Quality of facilities and equipment
• Adequacy of program development
• Quality of delivery
• Completeness of documentation and records
• Adequacy of the safety training program evaluation process

Evaluating the Training Process

In an effective training program the training should be conducted using a systematic process that includes a needs assessment, objectives, course materials, lesson plans, evaluation strategies, and criteria for successful completion. Areas of emphasis include:

• training goals;
• learning environment;
• learning objectives; and
• training effectiveness.

Evaluating the Training Results

By evaluating the results of training, it's possible to make improvements to existing plans and gain awareness of the need for new training. Items to evaluate include:

• quality of the training action-plan;
• adequacy of long-term planning;
• use of needs assessment;
• appropriateness of prioritizing training; and
• adequacy of support and funding.

Instructions

Before beginning this quiz, we highly recommend you review the module material. This quiz is designed to allow you to self-check your comprehension of the module content, but only focuses on key concepts and ideas.

Read each question carefully. Select the best answer, even if more than one answer seems possible. When done, click on the "Get Quiz Answers" button. If you do not answer all the questions, you will receive an error message.

Good luck!