Study guide

19.1 Evaluation Models and Feedback Surveys

BCSP CIT Certified Instructional Trainer Study Guide 2026

Track your progress as you read

Finished sections get a check mark.

1 Credential and Training Standards

1.1 BCSP CIT Credential Scope, Exam Logistics & Recertification 1.2 ANSI/ASSP Z490 Criteria for Accepted EHS Training Practices

2 Adult Learning and Learning Access

2.1 Foundations of Andragogy: Knowles' Adult Learning Assumptions in Safety 2.2 Learner Literacy, ESL Accommodations & Plain Language Compliance 2.3 Opening a Course: Administrative Items and Learning Expectations

3 Communication and Facilitation

3.1 Verbal & Nonverbal Facilitation Techniques in Safety Training 3.2 Active Listening, Socratic Questioning & Teach-Back Verification 3.3 Feedback Frameworks, Corrective Coaching & Psychological Safety

4 Conflict and Instructional Technology

4.1 Managing Challenging Classroom Dynamics, Resistance & Conflict 4.2 Instructional Media, Presentation Tools & Technology Contingencies

5 Performance Needs and Existing Training

5.1 Performance Gaps and Training Necessity 5.2 Evaluating Existing Training and Interventions

6 Organizational, Task and Hazard Analysis

6.1 Organizational and Job Task Analysis 6.2 Hazard Analysis, KSAs and Task Evidence

7 Audience, Baseline and Prerequisites

7.1 Defining the Audience and Its Learning Needs 7.2 Baseline Knowledge and Prior-Learning Credit 7.3 Verifying Prerequisites and Readiness for Training

8 Applicable Training Requirements

8.1 OSHA Training Frameworks, General Duty Clause & Consensus Standards 8.2 Mandated Safety Programs: Lockout/Tagout, Confined Space & Fall Protection 8.3 Chemical & Biological Hazards: HazCom, Bloodborne & Respiratory Protection

9 Systematic and Iterative Design

9.1 ADDIE and the Systematic Approach to Training 9.2 SAM, Agile Development and Prototypes

10 Objectives and Learning Outcomes

10.1 Writing Observable ABCD Objectives 10.2 SMART, Objective Hierarchies and Stakeholder Consensus

11 Learning Domains and Practice

11.1 Cognitive Learning and Revised Bloom Taxonomy 11.2 Psychomotor, Affective and Constructive Alignment 11.3 Experiential Learning Cycles (Kolb), Adult Discovery & Instructional Scaffolding

12 Delivery Choices and Program Economics

12.1 Modality Matrix: Classroom ILT, E-Learning, Microlearning, Hands-On & OJT 12.2 Cost Classification and Worked Budgets 12.3 Resource Feasibility and Cost-Benefit Decisions

13 Developing and Validating Course Components

13.1 Lesson Plan Architecture: Components of Comprehensive Trainer & Participant Guides 13.2 Job Aids and Performance Support 13.3 SME Selection, Credible Sources and Validation

14 Development Planning and External Providers

14.1 Implementing the Instructional Development Plan 14.2 Deciding When and How to Outsource Development

15 Pilots and Recoverable Records

15.1 Representative Pilots and Course Revision 15.2 Record Retention, Privacy and Recovery

16 Implementation Environments and Logistics

16.1 Physical Classroom Design, Seating Arrangements, Ergonomics & Environmental Controls 16.2 Field, Shop & Hands-On Training: Safety Briefings, PPE Verification & Live Demonstration Safety 16.3 Virtual Instructor-Led Training (VILT), Technical Contingency Planning & Remote Engagement 16.4 Scheduling, Logistics and Course Time Management

17 Assessment and Remediation

17.1 Formative and Summative Assessment Tools 17.2 Assessment Criteria, Alignment and Remediation

18 Items, Performance and Standards

18.1 Writing Clear Items and Plausible Distractors 18.2 Item Analysis and Assessment Data 18.3 Performance Checklists and Evaluator Calibration 18.4 Standard Setting and the Angoff Calculation

19 Evaluation Models, Surveys and Learning Data

19.1 Evaluation Models and Feedback Surveys 19.2 Learning Outcomes and Evaluation Data

20 Transfer and Behavior Evidence

20.1 Transfer of Learning and Work Conditions 20.2 Behavior Observations and Change Reporting

21 Results, ROI and Improvement Reports

21.1 Organizational Results and Causal Limits 21.2 ROI, Course Improvement and Training Reports

19.1 Evaluation Models and Feedback Surveys

Key Takeaways Explain This Topic AI

Kirkpatrick perspectives distinguish reaction, learning, behavior and results.

The levels are connected and do not require a rigid linear measurement sequence.

Reaction surveys should ask focused, neutral questions and report response limitations.

Last updated: October 2026

Kirkpatrick Level 1 (Reaction) & Level 2 (Learning): Designing Valid Feedback Tools & Pre/Post Tests

Important

Training evaluation is not an administrative formality; it is an empirical feedback loop required by professional training standards (including ANSI/ASSP Z490.1). A certified trainer must systematically measure whether learning occurred, whether instructional interventions were effective, and how delivery methods should be refined.

The Kirkpatrick Four-Level Evaluation Model

The familiar Kirkpatrick model distinguishes reaction, learning, behavior and results. Current model-owner guidance stresses that these levels are connected rather than a rigid linear sequence. Start with the intended organizational outcome when planning what evidence to gather.

  • Level Evidence focus Timing principle
  • Reaction Relevance and experience Gather where feedback can inform improvement
  • Learning Intended knowledge, skills or attitudes Check during and after instruction as appropriate
  • Behavior Application at work Match opportunities to perform
  • Results Organizational outcomes Match a defensible observation period

The levels organize different evidence: reaction, learning, behavior and results. They are connected, but are not a rigid staircase requiring one measurement to finish before the next begins. Planning can begin with the desired organizational outcome and work backward to needed behavior and learning.

Level 1: Reaction — Moving Beyond the "Smile Sheet"

A favorable reaction is evidence about the learner's experience, not proof of learning or workplace performance. Gather more specific feedback on relevance, clarity and activity usefulness alongside other evaluation evidence.

To establish construct validity, an effective Level 1 tool must isolate utility reaction (perceived job relevance and practical value) and instructional quality from superficial satisfaction.

Critical Level 1 Measurement Constructs

Perceived Practical Utility : Does the learner believe the content directly addresses the physical hazards and procedural realities of their daily work?

Cognitive Self-Efficacy : Does the learner feel confident that they can perform the safety procedure independently under operating constraints?

Instructional Materials and Clarity : Were hazard communication visuals, equipment schematics, and regulatory explanations presented coherently?

Trainer Competence : Did the instructor demonstrate subject matter expertise, answer technical inquiries accurately, and facilitate active engagement?

Mitigating Response Biases

Level 1 surveys frequently suffer from systematic psychometric biases that skew data:

Acquiescence Bias : The tendency for respondents to agree unconditionally with positively framed statements. Mitigation : Balance positively worded prompts with neutrally worded behavioral statements.

Central Tendency Bias : Learners avoiding extreme ratings by defaulting to middle values (e.g., selecting 3 on a 5-point scale). Mitigation : Utilize well-defined behavioral anchors on 4- or 6-point forced-choice scales, or clearly anchor each point on a 5-point scale.

Halo Effect : A favorable overall impression of the instructor clouding objective assessment of individual course components (e.g., rating poor technical handbooks highly because the instructor was charismatic). Mitigation : Separate instructor performance items from curriculum, equipment, and facility evaluation sections.

High-Validity Level 1 Instrument Design

Construct Ineffective "Smile Sheet" Item High-Validity Anchored Likert Item

Utility "I enjoyed today's fall protection class." (1–5) "I can immediately apply the harness inspection and anchor calculation procedures to my daily site tasks." (1 = Strongly Disagree to 5 = Strongly Agree)

Self-Efficacy "The instructor made fall arrest easy." (1–5) "I feel confident calculating total fall clearance distance across varying lanyard and deceleration device configurations." (1–5)

Curriculum "The course manual was good." (1–5) "The job aid diagrams provided clear, step-by-step guidance for lockout/tagout zero-energy verification." (1–5)

Developing an evaluation instrument

Begin with the decision the evaluation should inform. A reaction survey can help revise an explanation or delivery method; it cannot establish that a worker is qualified. Ask about relevant aspects separately. "The instructor and materials were excellent" combines two judgments and leaves the cause of a low rating unclear. A neutral item about clarity, another about relevance and a focused open question produce more actionable information.

Use a response scale whose labels fit the question and offer an appropriate not-applicable response where needed. Do not force a learner to rate a practical activity that was not delivered. Keep wording understandable and avoid leading prompts such as "How helpful was our excellent demonstration?" Explain how feedback will be used and its confidentiality limits.

Self-evaluation is another perspective. Ask learners to identify a task they can now explain and one for which they need practice. Compare these reports with actual assessment evidence. High confidence can coexist with a critical error, while low confidence can coexist with accurate performance. Use the difference to guide support, not to replace the performance check.

Administer the instrument where learners have a reasonable opportunity to respond. Report the number and proportion responding, because feedback from a small self-selected subset may not represent the whole group. Review comments for patterns, preserving relevant context without exposing identities unnecessarily. Assign an owner to each planned improvement.

Kirkpatrick model-owner guidance describes the connected reaction, learning, behavior and results perspectives.

Key takeaways

Kirkpatrick perspectives distinguish reaction, learning, behavior and results.

The levels are connected and do not require a rigid linear measurement sequence.

Reaction surveys should ask focused, neutral questions and report response limitations.