Study guide
19.1 Evaluation Models and Feedback Surveys
BCSP CIT Certified Instructional Trainer Study Guide 2026
Track your progress as you read
Finished sections get a check mark.
1 Credential and Training Standards
1.1 BCSP CIT Credential Scope, Exam Logistics & Recertification 1.2 ANSI/ASSP Z490 Criteria for Accepted EHS Training Practices
2 Adult Learning and Learning Access
2.1 Foundations of Andragogy: Knowles' Adult Learning Assumptions in Safety 2.2 Learner Literacy, ESL Accommodations & Plain Language Compliance 2.3 Opening a Course: Administrative Items and Learning Expectations
3 Communication and Facilitation
3.1 Verbal & Nonverbal Facilitation Techniques in Safety Training 3.2 Active Listening, Socratic Questioning & Teach-Back Verification 3.3 Feedback Frameworks, Corrective Coaching & Psychological Safety
4 Conflict and Instructional Technology
4.1 Managing Challenging Classroom Dynamics, Resistance & Conflict 4.2 Instructional Media, Presentation Tools & Technology Contingencies
5 Performance Needs and Existing Training
5.1 Performance Gaps and Training Necessity 5.2 Evaluating Existing Training and Interventions
6 Organizational, Task and Hazard Analysis
6.1 Organizational and Job Task Analysis 6.2 Hazard Analysis, KSAs and Task Evidence
7 Audience, Baseline and Prerequisites
7.1 Defining the Audience and Its Learning Needs 7.2 Baseline Knowledge and Prior-Learning Credit 7.3 Verifying Prerequisites and Readiness for Training
8 Applicable Training Requirements
8.1 OSHA Training Frameworks, General Duty Clause & Consensus Standards 8.2 Mandated Safety Programs: Lockout/Tagout, Confined Space & Fall Protection 8.3 Chemical & Biological Hazards: HazCom, Bloodborne & Respiratory Protection
9 Systematic and Iterative Design
9.1 ADDIE and the Systematic Approach to Training 9.2 SAM, Agile Development and Prototypes
10 Objectives and Learning Outcomes
10.1 Writing Observable ABCD Objectives 10.2 SMART, Objective Hierarchies and Stakeholder Consensus
11 Learning Domains and Practice
11.1 Cognitive Learning and Revised Bloom Taxonomy 11.2 Psychomotor, Affective and Constructive Alignment 11.3 Experiential Learning Cycles (Kolb), Adult Discovery & Instructional Scaffolding
12 Delivery Choices and Program Economics
12.1 Modality Matrix: Classroom ILT, E-Learning, Microlearning, Hands-On & OJT 12.2 Cost Classification and Worked Budgets 12.3 Resource Feasibility and Cost-Benefit Decisions
13 Developing and Validating Course Components
13.1 Lesson Plan Architecture: Components of Comprehensive Trainer & Participant Guides 13.2 Job Aids and Performance Support 13.3 SME Selection, Credible Sources and Validation
14 Development Planning and External Providers
14.1 Implementing the Instructional Development Plan 14.2 Deciding When and How to Outsource Development
15 Pilots and Recoverable Records
15.1 Representative Pilots and Course Revision 15.2 Record Retention, Privacy and Recovery
16 Implementation Environments and Logistics
16.1 Physical Classroom Design, Seating Arrangements, Ergonomics & Environmental Controls 16.2 Field, Shop & Hands-On Training: Safety Briefings, PPE Verification & Live Demonstration Safety 16.3 Virtual Instructor-Led Training (VILT), Technical Contingency Planning & Remote Engagement 16.4 Scheduling, Logistics and Course Time Management
17 Assessment and Remediation
17.1 Formative and Summative Assessment Tools 17.2 Assessment Criteria, Alignment and Remediation
18 Items, Performance and Standards
18.1 Writing Clear Items and Plausible Distractors 18.2 Item Analysis and Assessment Data 18.3 Performance Checklists and Evaluator Calibration 18.4 Standard Setting and the Angoff Calculation
19 Evaluation Models, Surveys and Learning Data
19.1 Evaluation Models and Feedback Surveys 19.2 Learning Outcomes and Evaluation Data
20 Transfer and Behavior Evidence
20.1 Transfer of Learning and Work Conditions 20.2 Behavior Observations and Change Reporting
21 Results, ROI and Improvement Reports
21.1 Organizational Results and Causal Limits 21.2 ROI, Course Improvement and Training Reports
19.1 Evaluation Models and Feedback Surveys
Key Takeaways Explain This Topic AI
Kirkpatrick perspectives distinguish reaction, learning, behavior and results.
The levels are connected and do not require a rigid linear measurement sequence.
Reaction surveys should ask focused, neutral questions and report response limitations.
Last updated: October 2026
Kirkpatrick Level 1 (Reaction) & Level 2 (Learning): Designing Valid Feedback Tools & Pre/Post Tests
Important
Training evaluation is not an administrative formality; it is an empirical feedback loop required by professional training standards (including ANSI/ASSP Z490.1). A certified trainer must systematically measure whether learning occurred, whether instructional interventions were effective, and how delivery methods should be refined.
The Kirkpatrick Four-Level Evaluation Model
The familiar Kirkpatrick model distinguishes reaction, learning, behavior and results. Current model-owner guidance stresses that these levels are connected rather than a rigid linear sequence. Start with the intended organizational outcome when planning what evidence to gather.
- Level Evidence focus Timing principle
- Reaction Relevance and experience Gather where feedback can inform improvement
- Learning Intended knowledge, skills or attitudes Check during and after instruction as appropriate
- Behavior Application at work Match opportunities to perform
- Results Organizational outcomes Match a defensible observation period
The levels organize different evidence: reaction, learning, behavior and results. They are connected, but are not a rigid staircase requiring one measurement to finish before the next begins. Planning can begin with the desired organizational outcome and work backward to needed behavior and learning.
Level 1: Reaction — Moving Beyond the "Smile Sheet"
A favorable reaction is evidence about the learner's experience, not proof of learning or workplace performance. Gather more specific feedback on relevance, clarity and activity usefulness alongside other evaluation evidence.
To establish construct validity, an effective Level 1 tool must isolate utility reaction (perceived job relevance and practical value) and instructional quality from superficial satisfaction.
Critical Level 1 Measurement Constructs
Perceived Practical Utility : Does the learner believe the content directly addresses the physical hazards and procedural realities of their daily work?
Cognitive Self-Efficacy : Does the learner feel confident that they can perform the safety procedure independently under operating constraints?
Instructional Materials and Clarity : Were hazard communication visuals, equipment schematics, and regulatory explanations presented coherently?
Trainer Competence : Did the instructor demonstrate subject matter expertise, answer technical inquiries accurately, and facilitate active engagement?
Mitigating Response Biases
Level 1 surveys frequently suffer from systematic psychometric biases that skew data:
Acquiescence Bias : The tendency for respondents to agree unconditionally with positively framed statements. Mitigation : Balance positively worded prompts with neutrally worded behavioral statements.
Central Tendency Bias : Learners avoiding extreme ratings by defaulting to middle values (e.g., selecting 3 on a 5-point scale). Mitigation : Utilize well-defined behavioral anchors on 4- or 6-point forced-choice scales, or clearly anchor each point on a 5-point scale.
Halo Effect : A favorable overall impression of the instructor clouding objective assessment of individual course components (e.g., rating poor technical handbooks highly because the instructor was charismatic). Mitigation : Separate instructor performance items from curriculum, equipment, and facility evaluation sections.
High-Validity Level 1 Instrument Design
Construct Ineffective "Smile Sheet" Item High-Validity Anchored Likert Item
Utility "I enjoyed today's fall protection class." (1–5) "I can immediately apply the harness inspection and anchor calculation procedures to my daily site tasks." (1 = Strongly Disagree to 5 = Strongly Agree)
Self-Efficacy "The instructor made fall arrest easy." (1–5) "I feel confident calculating total fall clearance distance across varying lanyard and deceleration device configurations." (1–5)
Curriculum "The course manual was good." (1–5) "The job aid diagrams provided clear, step-by-step guidance for lockout/tagout zero-energy verification." (1–5)
Developing an evaluation instrument
Begin with the decision the evaluation should inform. A reaction survey can help revise an explanation or delivery method; it cannot establish that a worker is qualified. Ask about relevant aspects separately. "The instructor and materials were excellent" combines two judgments and leaves the cause of a low rating unclear. A neutral item about clarity, another about relevance and a focused open question produce more actionable information.
Use a response scale whose labels fit the question and offer an appropriate not-applicable response where needed. Do not force a learner to rate a practical activity that was not delivered. Keep wording understandable and avoid leading prompts such as "How helpful was our excellent demonstration?" Explain how feedback will be used and its confidentiality limits.
Self-evaluation is another perspective. Ask learners to identify a task they can now explain and one for which they need practice. Compare these reports with actual assessment evidence. High confidence can coexist with a critical error, while low confidence can coexist with accurate performance. Use the difference to guide support, not to replace the performance check.
Administer the instrument where learners have a reasonable opportunity to respond. Report the number and proportion responding, because feedback from a small self-selected subset may not represent the whole group. Review comments for patterns, preserving relevant context without exposing identities unnecessarily. Assign an owner to each planned improvement.
Kirkpatrick model-owner guidance describes the connected reaction, learning, behavior and results perspectives.
Key takeaways
Kirkpatrick perspectives distinguish reaction, learning, behavior and results.
The levels are connected and do not require a rigid linear measurement sequence.
Reaction surveys should ask focused, neutral questions and report response limitations.