Study guide

5.2 Evaluating Existing Training and Interventions

BCSP CIT Certified Instructional Trainer Study Guide 2026

Track your progress as you read

Finished sections get a check mark.

1 Credential and Training Standards

1.1 BCSP CIT Credential Scope, Exam Logistics & Recertification 1.2 ANSI/ASSP Z490 Criteria for Accepted EHS Training Practices

2 Adult Learning and Learning Access

2.1 Foundations of Andragogy: Knowles' Adult Learning Assumptions in Safety 2.2 Learner Literacy, ESL Accommodations & Plain Language Compliance 2.3 Opening a Course: Administrative Items and Learning Expectations

3 Communication and Facilitation

3.1 Verbal & Nonverbal Facilitation Techniques in Safety Training 3.2 Active Listening, Socratic Questioning & Teach-Back Verification 3.3 Feedback Frameworks, Corrective Coaching & Psychological Safety

4 Conflict and Instructional Technology

4.1 Managing Challenging Classroom Dynamics, Resistance & Conflict 4.2 Instructional Media, Presentation Tools & Technology Contingencies

5 Performance Needs and Existing Training

5.1 Performance Gaps and Training Necessity 5.2 Evaluating Existing Training and Interventions

6 Organizational, Task and Hazard Analysis

6.1 Organizational and Job Task Analysis 6.2 Hazard Analysis, KSAs and Task Evidence

7 Audience, Baseline and Prerequisites

7.1 Defining the Audience and Its Learning Needs 7.2 Baseline Knowledge and Prior-Learning Credit 7.3 Verifying Prerequisites and Readiness for Training

8 Applicable Training Requirements

8.1 OSHA Training Frameworks, General Duty Clause & Consensus Standards 8.2 Mandated Safety Programs: Lockout/Tagout, Confined Space & Fall Protection 8.3 Chemical & Biological Hazards: HazCom, Bloodborne & Respiratory Protection

9 Systematic and Iterative Design

9.1 ADDIE and the Systematic Approach to Training 9.2 SAM, Agile Development and Prototypes

10 Objectives and Learning Outcomes

10.1 Writing Observable ABCD Objectives 10.2 SMART, Objective Hierarchies and Stakeholder Consensus

11 Learning Domains and Practice

11.1 Cognitive Learning and Revised Bloom Taxonomy 11.2 Psychomotor, Affective and Constructive Alignment 11.3 Experiential Learning Cycles (Kolb), Adult Discovery & Instructional Scaffolding

12 Delivery Choices and Program Economics

12.1 Modality Matrix: Classroom ILT, E-Learning, Microlearning, Hands-On & OJT 12.2 Cost Classification and Worked Budgets 12.3 Resource Feasibility and Cost-Benefit Decisions

13 Developing and Validating Course Components

13.1 Lesson Plan Architecture: Components of Comprehensive Trainer & Participant Guides 13.2 Job Aids and Performance Support 13.3 SME Selection, Credible Sources and Validation

14 Development Planning and External Providers

14.1 Implementing the Instructional Development Plan 14.2 Deciding When and How to Outsource Development

15 Pilots and Recoverable Records

15.1 Representative Pilots and Course Revision 15.2 Record Retention, Privacy and Recovery

16 Implementation Environments and Logistics

16.1 Physical Classroom Design, Seating Arrangements, Ergonomics & Environmental Controls 16.2 Field, Shop & Hands-On Training: Safety Briefings, PPE Verification & Live Demonstration Safety 16.3 Virtual Instructor-Led Training (VILT), Technical Contingency Planning & Remote Engagement 16.4 Scheduling, Logistics and Course Time Management

17 Assessment and Remediation

17.1 Formative and Summative Assessment Tools 17.2 Assessment Criteria, Alignment and Remediation

18 Items, Performance and Standards

18.1 Writing Clear Items and Plausible Distractors 18.2 Item Analysis and Assessment Data 18.3 Performance Checklists and Evaluator Calibration 18.4 Standard Setting and the Angoff Calculation

19 Evaluation Models, Surveys and Learning Data

19.1 Evaluation Models and Feedback Surveys 19.2 Learning Outcomes and Evaluation Data

20 Transfer and Behavior Evidence

20.1 Transfer of Learning and Work Conditions 20.2 Behavior Observations and Change Reporting

21 Results, ROI and Improvement Reports

21.1 Organizational Results and Causal Limits 21.2 ROI, Course Improvement and Training Reports

5.2 Evaluating Existing Training and Interventions

Key Takeaways Explain This Topic AI

Review existing content, learner usability and assessment evidence separately.

Course revision should target the demonstrated cause of the learning gap.

Validate the effect of a revision and control obsolete active versions.

Last updated: October 2026

Case Analysis: The Machine Guard Bypass Dilemma

In this hypothetical case, operators bypass a machine guard because the approved arrangement interferes with a task and production rewards encourage shortcuts. An additional reminder course is proposed before anyone examines the actual work.

The analyst observes the task, interviews operators and supervisors, and reviews the approved procedure with the responsible engineering and safety personnel. The evidence identifies a design and incentive problem as well as a need to reinforce the required procedure.

The responsible team addresses the hazard with an approved engineering solution and revised production expectations. Any equipment or procedure changes also trigger appropriate instruction. The trainer does not authorize bypassing a guard while waiting for redesign.

Success must be checked after implementation: compare observed use of the approved controls, worker feedback and relevant events. Do not assume the intervention eliminated tampering simply because it was installed.

Note

Instructional trainers must view themselves as performance consultants. When operational managers request safety training, the trainer's primary professional obligation is to determine whether training is truly the appropriate remedy or if engineering, ergonomic, or administrative controls are needed.

Non-Training Interventions in EHS Environments

When a performance gap analysis confirms that a lack of knowledge is not the root driver, safety professionals must collaborate with engineering, maintenance, and operational leadership to deploy non-training interventions.

Discrepancy Category Operational Symptom Primary Non-Training Intervention Why Training Fails Here

Environmental & Ergonomic Assembly technicians fail to wear cut-resistant gloves during precision wire harnessing. Evaluate alternative glove materials offering high tactile dexterity; redesign wire harness routing to eliminate sharp sheet metal edges. Lectures on hand injury statistics cannot change the physical loss of tactile sensitivity caused by thick, stiff gloves.

Incentive & Consequence Misalignment Forklift drivers consistently exceed aisle speed limits and fail to stop at blind intersections. Install mechanical speed governors on trucks; restructure dispatch schedules so drivers are not penalized for safe driving speeds. Workers naturally prioritize behaviors that leadership rewards and incentivizes over abstract classroom safety rules.

Cognitive Overload & Infrequent Tasks Field operators make errors during annual emergency boiler blowdown sequences. Mount laminated point-of-use step checklists directly on the boiler control panel; install physical valve key interlocks. Long-term memory degrades over time; annual classroom presentations cannot ensure error-free recall of complex, high-stress sequences.

Inadequate Resources & Tooling Welders fail to utilize local exhaust ventilation (LEV) hoods during structural welding. Replace heavy, rigid duct hoods with flexible, counterbalanced articulated arm hoods; implement daily preventative maintenance on blowers. Exhorting welders to capture toxic fumes is useless if positioning the hood requires two hands, a wrench, and excessive physical force.

The Organizational and Human Costs of Misapplied Training

Misapplied training consumes time and may leave hazards uncontrolled. Estimate costs from actual learner time, release arrangements, development effort and materials. For illustration, 150 employees attending four hours represents 600 learner-hours; wages and other costs require supplied inputs, not an assumed universal course price.

Reviewing an existing course before replacing it

An existing course is an asset to inspect, not evidence that the performance need is already met. Compare its audience, objectives, technical revision, practice and assessment with the present need. A course written for a different model or job role may contain useful foundations but still omit site-specific duties. Review the facilitator guide as well as the slides; activities and scoring rules may be invisible in the presentation file.

Separate three questions: Is the content correct? Can the intended audience learn from it? Does its assessment establish the required outcome? A technically accurate manual can fail the second question if its reading demands exceed the audience's preparation. A popular discussion can fail the third if no one checks individual performance. Gather examples of learner responses and workplace difficulties to locate the defect rather than replacing all materials automatically.

  • Existing-course finding Appropriate next step
  • Obsolete reference Validate current requirement and revise all affected components
  • Learners miss the same step Examine explanation, practice and assessment of that step
  • Correct classroom performance, poor workplace use Investigate transfer conditions and support
  • Unnecessary prerequisite content Consider permitted credit or a shorter pathway

In a hypothetical workshop, learners correctly identify a defect in a slide but cannot find it on a specimen. The review finds that practice used only photographs. Add safe specimen practice and observe whether learners can locate the feature independently. Rewriting the introduction would not address that evidence. If the approved inspection criterion itself is unclear, resolve it with the technical owner before revising instruction.

Record the decision, evidence, responsible owner and follow-up measure. After revision, compare results on the same objective under suitable conditions. Preserve the old version for traceability where the retention policy requires it, and remove obsolete copies from active delivery. A revision is complete when the intended change has been validated, not merely when a new file is saved.

Key takeaways

Review existing content, learner usability and assessment evidence separately.

Course revision should target the demonstrated cause of the learning gap.

Validate the effect of a revision and control obsolete active versions.