Study guide
Validity, Reliability, IOA, Procedural Integrity, and Dosage
BCBA Study Guide Exam
Track your progress as you read
Finished sections get a check mark.
1 Orientation, Eligibility, and Exam Strategy
Current BCBA Credential, Official Sources, and Transition Awareness Exam Format, Timing, Scoring, Pass-Rate Data, and Fees Eligibility Pathways and Application Workflow Fieldwork Overview and Documentation Mindset 12-20 Week Study Plan and Diagnostic Baseline Exam Security, ID, Pearson Logistics, and Retake Planning
2 Behaviorism, Philosophical Foundations, and ABA Dimensions
Goals of Behavior Analysis as a Science Philosophical Assumptions: Selectionism, Determinism, Empiricism, Parsimony, and Pragmatism Radical Behaviorism and Private Events Behaviorism, EAB, ABA, and Professional Practice Seven ABA Dimensions and Exam Traps Translating Conceptual Questions into Applied Decisions
3 Concepts and Principles
Behavior, Response, Response Class, Stimulus, Stimulus Class Respondent and Operant Conditioning Reinforcement, Punishment, Automatic, and Socially Mediated Contingencies Schedules, Extinction, Stimulus Control, Discrimination, and Generalization Motivating Operations, Rule-Governed Behavior, and Verbal Operants Momentum, Matching Law, Imitation, Observational Learning, and Emergent Relations
4 Measurement, Data Display, and Interpretation
Operational Definitions and Selecting Dimensions Direct, Indirect, Product, Continuous, and Discontinuous Measurement Occurrence, Rate, Duration, Latency, IRT, Trials to Criterion, and Efficiency Validity, Reliability, IOA, Procedural Integrity, and Dosage Graphing and Visual Interpretation Measurement Selection Under Environmental Constraints
5 Experimental Design and Visual Analysis
Dependent and Independent Variables Internal/External Validity and Threats Single-Case Design Logic: Prediction, Verification, Replication Reversal, Multiple-Baseline, Multielement, Changing-Criterion Designs Comparative, Component, and Parametric Analyses Critiquing Graphs and Choosing Defensible Designs
6 Ethical and Professional Issues
Core Principles and Risks of Unethical Behavior Competence, Professional Development, and Scope Confidentiality, Documentation, Public Statements, and Social Media Multiple Relationships, Transitions, and Discontinuing Services Cultural Humility, Responsiveness, Bias, and Collaboration Legal, Regulatory, Funding Requirements, and Licensure Boundaries
7 Behavior Assessment
Records Review and Intake Hypotheses Cultural Variables and Client-Informed Assessment Skill Strengths and Needs Assessment Preference Assessments Descriptive Assessment and Functional Analysis Interpreting Data for Referral, Goals, and Service Decisions
8 Behavior-Change Procedures
Reinforcement and Differential Reinforcement Time-Based Reinforcement, Conditioned Reinforcers, and Token Economies Motivating Operations and Discriminative Stimuli in Intervention Prompting, Prompt Fading, Modeling, Instructions, and Rules Shaping, Chaining, Instructional Formats, and Group Contingencies Generalization, Maintenance, Punishment, Emotional Effects, and Emergent Relations
9 Selecting and Implementing Interventions
Observable Measurable Goals Intervention Selection From Assessment, Evidence, Preferences, and Contextual Fit Socially Valid Alternative Behavior Mitigating Unwanted Effects and Relapse Procedural Integrity and Effectiveness Decisions Collaboration and Intervention Modification
10 Personnel Supervision and Management
Benefits and Ethics of Behavior-Analytic Supervision Supervisory Relationships, Contracts, Expectations, and Feedback Equity and Cultural Responsiveness in Supervision Practices Onboarding, Assessing Supervisee Skills, and Selecting Supervision Goals Behavioral Skills Training, Performance Management, and Function-Based Staff Support Data-Based Supervision Decisions, Documentation, and Fieldwork Exam Traps
11 Integrated Case Analysis and Domain Review
Functional Case Formulation Across TCO Domains Measurement-to-Design-to-Intervention Chain Ethics Embedded in Assessment and Treatment Choices High-Probability Distractor Patterns Building Mixed-Domain Practice Blocks Final Weak-Domain Remediation Plan
12 Final Countdown, Results, and Next Steps
Final 30/14/7 Day Plan Four-Hour Timing, Fatigue, and Review Strategy Exam-Day Checklist and Security Rules Results, Retakes, and Error-Log Reuse After Passing: Certification, Licensure Check, Scope, and Supervision Readiness Maintenance Mindset and Continuing Professional Development
Validity, Reliability, IOA, Procedural Integrity, and Dosage
Key Takeaways Explain This Topic AI
Accuracy is closeness to the true value; reliability is consistency; validity is measuring the right behavior/dimension; they are independent.
IOA is a reliability index, not validity; the method must match the data (total count, mean count-per-interval, exact, trial-by-trial, duration).
Mean count-per-interval IOA averages within-interval count ratios; exact count-per-interval IOA counts only intervals with identical counts and divides by all intervals, then multiplies by 100.
Most fields treat 80%+ IOA as minimally acceptable, with 90%+ preferred, though no threshold is universal.
Check procedural integrity and dosage before concluding a flat intervention has failed.
Last updated: October 2026
Accuracy, Reliability, and Validity
Three measurement-quality concepts anchor this section. Accuracy is the extent to which observed values match the true value of the behavior (often established by an independent calibrated standard or a thorough "true" count). Reliability is the consistency of measurement: the same behavior measured repeatedly yields the same value. Validity asks whether you measured the right thing , the behavior and dimension that answer the question.
These are independent. A bathroom scale that always reads 5 pounds high is reliable but inaccurate . Observers can be highly reliable yet invalid if they share a flawed definition, measuring accidental contact as "aggression" identically every time. The exam's recurring lesson: high agreement never proves validity . Always confirm the measure captures the intended response class and dimension before trusting consistent data.
Interobserver Agreement (IOA): Types and a Worked Calculation
Interobserver agreement (IOA) is the degree to which two independent observers report the same values for the same events. It is a reliability index, not a validity index. The method must match the measurement system:
- IOA method Used with How it is computed
- Total count IOA Event/frequency data (smaller count / larger count) x 100
Mean count-per-interval IOA Count data split into intervals average of per-interval (smaller/larger) percentages; score joint zero counts as 100% agreement
Exact count-per-interval IOA Frequency counts split into intervals intervals with identical counts / total intervals x 100
Interval-by-interval IOA Occurrence/nonoccurrence interval data intervals with matching occurrence or nonoccurrence scores / total intervals x 100
- Trial-by-trial IOA Discrete-trial / opportunity data agreements / (agreements + disagreements) x 100
- Total duration IOA Duration data (smaller duration / larger duration) x 100
Worked example (mean count-per-interval). Two observers count a behavior across five 1-minute intervals:
- Interval Obs A Obs B smaller/larger
- 1 4 4 4/4 = 100%
- 2 5 4 4/5 = 80%
- 3 3 3 3/3 = 100%
- 4 2 3 2/3 = 67%
- 5 6 5 5/6 = 83%
Mean count-per-interval IOA is approximately 86% : average the five interval percentages, using unrounded ratios in the calculation. Exact count-per-interval IOA uses identical counts instead: only intervals 1 and 3 match, so (2 / 5) x 100 = 40% . Total count IOA compares the session totals of 20 and 19, giving (19 / 20) x 100 = 95% . These three methods answer different agreement questions. Mean count-per-interval can expose disagreements hidden by session totals, but its score is not necessarily lower than total count IOA for every dataset. Joint zero counts count as exact agreement and contribute 100% to the mean method. Common IOA benchmarks depend on the measurement protocol; no score alone proves accuracy or validity.
Procedural Integrity, Treatment Fidelity, and Dosage
Data quality is more than the dependent-variable line on a graph. Procedural integrity (treatment fidelity / treatment integrity) measures whether the independent variable , the intervention, was implemented as written. Low integrity threatens internal validity: if outcomes are flat but the plan was not run correctly, you cannot conclude the plan failed. Dosage measures the amount of exposure: minutes, sessions, opportunities, or trials delivered.
Use this decision chain when interpreting disappointing data:
Observers disagree -> check the definition, training, scoring rules, and IOA method first.
Data do not match the clinical question -> check validity of the measure and dimension.
Intervention data are flat -> check procedural integrity and dosage before rejecting the plan.
Change appears only on some days -> check setting events, schedule, observer coverage, and representativeness.
The defensible rule: if outcomes are poor but integrity is low, improve implementation and collect more data; if integrity and dosage are adequate and outcomes are still poor, modification is warranted. Do not let a strong IOA value distract from validity or integrity; observers can agree perfectly on the wrong response class while the intervention was never delivered as designed.
Threats to Accuracy and Choosing the Right IOA Method
Several predictable threats degrade accuracy and reliability, and the exam expects you to name and prevent them. Observer drift is the gradual, unintentional change in how an observer applies a definition over time, two observers trained together slowly diverge. Observer reactivity occurs when being observed changes the observer's scoring (e.g., scoring more carefully when a supervisor is present).
Observer bias / expectancy is scoring that is nudged toward an anticipated result, which is why observers should be blind to phase or condition when feasible. Poorly designed datasheets and complex definitions also lower accuracy. The standard safeguards are clear definitions, thorough training, periodic recalibration, and routine IOA checks across the study, not just at the start.
Matching the IOA method to the data is itself a high-yield skill. The wrong method can inflate agreement and hide real disagreement:
Data type Preferred IOA Why
Free-operant counts divided into intervals Mean count-per-interval or exact count-per-interval IOA Mean averages count ratios; exact credits only identical counts
Occurrence/nonoccurrence interval recording Interval-by-interval; scored-interval for sparse occurrence or unscored-interval for dense occurrence Compare yes/no interval scores; focus on occurrence or nonoccurrence when shared scores could inflate agreement
- Discrete-trial Trial-by-trial Preserves opportunity-level agreement
- Duration / latency Total duration or mean duration-per-occurrence Matches the timed dimension
For interval data with very low-rate behavior, occurrence-only IOA (agreement only on intervals where at least one observer scored an occurrence) prevents agreement inflation from a long run of jointly empty intervals; for very high-rate behavior, nonoccurrence IOA does the parallel job.
Recognizing when total count IOA overstates agreement, and when occurrence/nonoccurrence agreement is the honest index, is exactly the nuance Domain C items probe. The unifying principle: report the agreement statistic that is most stringent and most informative for the measurement system you actually used, then interpret it as a check on reliability, never as evidence of validity.