Internal/External Validity and Threats

BCBA Study Guide Exam

Track your progress as you read

Finished sections get a check mark.

1 Orientation, Eligibility, and Exam Strategy

Current BCBA Credential, Official Sources, and Transition Awareness Exam Format, Timing, Scoring, Pass-Rate Data, and Fees Eligibility Pathways and Application Workflow Fieldwork Overview and Documentation Mindset 12-20 Week Study Plan and Diagnostic Baseline Exam Security, ID, Pearson Logistics, and Retake Planning

2 Behaviorism, Philosophical Foundations, and ABA Dimensions

Goals of Behavior Analysis as a Science Philosophical Assumptions: Selectionism, Determinism, Empiricism, Parsimony, and Pragmatism Radical Behaviorism and Private Events Behaviorism, EAB, ABA, and Professional Practice Seven ABA Dimensions and Exam Traps Translating Conceptual Questions into Applied Decisions

3 Concepts and Principles

Behavior, Response, Response Class, Stimulus, Stimulus Class Respondent and Operant Conditioning Reinforcement, Punishment, Automatic, and Socially Mediated Contingencies Schedules, Extinction, Stimulus Control, Discrimination, and Generalization Motivating Operations, Rule-Governed Behavior, and Verbal Operants Momentum, Matching Law, Imitation, Observational Learning, and Emergent Relations

4 Measurement, Data Display, and Interpretation

Operational Definitions and Selecting Dimensions Direct, Indirect, Product, Continuous, and Discontinuous Measurement Occurrence, Rate, Duration, Latency, IRT, Trials to Criterion, and Efficiency Validity, Reliability, IOA, Procedural Integrity, and Dosage Graphing and Visual Interpretation Measurement Selection Under Environmental Constraints

5 Experimental Design and Visual Analysis

Dependent and Independent Variables Internal/External Validity and Threats Single-Case Design Logic: Prediction, Verification, Replication Reversal, Multiple-Baseline, Multielement, Changing-Criterion Designs Comparative, Component, and Parametric Analyses Critiquing Graphs and Choosing Defensible Designs

6 Ethical and Professional Issues

Core Principles and Risks of Unethical Behavior Competence, Professional Development, and Scope Confidentiality, Documentation, Public Statements, and Social Media Multiple Relationships, Transitions, and Discontinuing Services Cultural Humility, Responsiveness, Bias, and Collaboration Legal, Regulatory, Funding Requirements, and Licensure Boundaries

7 Behavior Assessment

Records Review and Intake Hypotheses Cultural Variables and Client-Informed Assessment Skill Strengths and Needs Assessment Preference Assessments Descriptive Assessment and Functional Analysis Interpreting Data for Referral, Goals, and Service Decisions

8 Behavior-Change Procedures

Reinforcement and Differential Reinforcement Time-Based Reinforcement, Conditioned Reinforcers, and Token Economies Motivating Operations and Discriminative Stimuli in Intervention Prompting, Prompt Fading, Modeling, Instructions, and Rules Shaping, Chaining, Instructional Formats, and Group Contingencies Generalization, Maintenance, Punishment, Emotional Effects, and Emergent Relations

9 Selecting and Implementing Interventions

Observable Measurable Goals Intervention Selection From Assessment, Evidence, Preferences, and Contextual Fit Socially Valid Alternative Behavior Mitigating Unwanted Effects and Relapse Procedural Integrity and Effectiveness Decisions Collaboration and Intervention Modification

10 Personnel Supervision and Management

Benefits and Ethics of Behavior-Analytic Supervision Supervisory Relationships, Contracts, Expectations, and Feedback Equity and Cultural Responsiveness in Supervision Practices Onboarding, Assessing Supervisee Skills, and Selecting Supervision Goals Behavioral Skills Training, Performance Management, and Function-Based Staff Support Data-Based Supervision Decisions, Documentation, and Fieldwork Exam Traps

11 Integrated Case Analysis and Domain Review

Functional Case Formulation Across TCO Domains Measurement-to-Design-to-Intervention Chain Ethics Embedded in Assessment and Treatment Choices High-Probability Distractor Patterns Building Mixed-Domain Practice Blocks Final Weak-Domain Remediation Plan

12 Final Countdown, Results, and Next Steps

Final 30/14/7 Day Plan Four-Hour Timing, Fatigue, and Review Strategy Exam-Day Checklist and Security Rules Results, Retakes, and Error-Log Reuse After Passing: Certification, Licensure Check, Scope, and Supervision Readiness Maintenance Mindset and Continuing Professional Development

Internal/External Validity and Threats

Key Takeaways Explain This Topic AI

Internal validity concerns whether the IV — not a confound — caused the behavior change; it is about defensible causal claims for THIS case.

External validity concerns whether findings generalize across people, settings, behaviors, materials, and times; it is built through replication, not asserted.

Classic threats include history, maturation, testing, instrumentation, procedural drift, and multiple-treatment interference — memorize a definition and a design remedy for each.

Single-case designs counter threats with repeated measurement, staggered replications, reversals, and crisp condition changes.

A design can have strong internal validity for one client yet narrow external validity until the effect is replicated.

Last updated: June 2026

Two Different Questions: Cause vs. Reach

Internal validity asks whether the IV is the most plausible reason behavior changed in this study. High internal validity means rival explanations have been ruled out and you can defend a causal claim. External validity asks whether the same effect would hold under other relevant conditions — different participants, settings, behaviors, materials, implementers, or times.

These trade off and must be kept separate. A tightly controlled reversal in one clinic room maximizes internal validity but says nothing, by itself, about generality. Conversely, a sprawling field demonstration across many sites with weak control may look general but cannot establish that the IV caused anything.

The BCBA exam repeatedly tests whether you can separate a strong functional relation (internal validity) from a weak generality claim (external validity). When a stem says a treatment 'reduced behavior for this client,' that is an internal-validity statement; do not over-extend it to all clients.

A useful frame: internal validity is the inward question (did the IV cause change here ?), while external validity is the outward question (does this travel elsewhere ?). Strong single-case designs prioritize the inward question first, because a result that cannot be trusted internally has nothing worth generalizing. Only after internal validity is secured does replication earn the right to widen the claim outward.

The Classic Threats to Internal Validity

Threats are events other than the IV that could produce the observed change. Learn a one-line definition and a design remedy for each.

• Threat What it means Design response
• History An outside event coincides with treatment Stagger starts (multiple baseline); replicate the effect
• Maturation Behavior changes from time, growth, or fatigue Establish baseline trend; replicate across tiers
• Testing Repeated exposure to measurement changes performance Use unobtrusive measures; careful probing
• Instrumentation The measurement system itself drifts or changes Train observers; monitor IOA and definitions
• Procedural drift Implementers deliver the IV differently over time Collect procedural integrity data; retrain

Multiple-treatment interference One condition carries over and affects another Counterbalance; choose a different design; insert washout

History and maturation are the most frequently confused pair. History is a specific external event (a new med, a holiday, a new aide). Maturation is a gradual internal process (development, learning over time, getting tired within a session). If the stem names a concrete event, think history; if it describes the passage of time or growth, think maturation.

Two More Threats: Multiple-Treatment Interference and Procedural Drift

Beyond the classic six, two threats appear constantly in ABA scenarios. Multiple-treatment interference (carryover) occurs when exposure to one condition alters responding in a subsequent condition — common in multielement and rapidly alternating arrangements. If a participant just experienced a rich reinforcement condition, behavior in the next condition may be temporarily 'contaminated.' Remedies include counterbalancing the order, separating conditions with discriminative signals, or choosing a design that does not alternate so quickly.

Procedural drift (treatment-integrity failure) occurs when implementers gradually deliver the IV differently over time — a paraprofessional who slowly stops running the full protocol. The danger is that a 'no effect' result may reflect a treatment that was never truly in place, not a treatment that failed. The remedy is to measure procedural integrity directly and retrain. Note the symmetry with measurement: IOA protects the integrity of the DV , while procedural integrity protects the integrity of the IV . Confusing the two is a classic distractor.

How Single-Case Designs Defeat Threats

Single-case designs support internal validity by producing a pattern that matches the planned manipulation. A sudden improvement right after treatment is promising, but it is weak evidence if a school vacation, a medication change, or a staff turnover occurred at the same moment. Replication at planned, staggered times is what makes coincidence implausible — if behavior changes three separate times, each time the IV is applied, history would have to coincide three times.

External validity is built , not declared, through two kinds of replication:

Direct replication repeats the same procedures with similar participants and conditions to confirm reliability of the effect.

Systematic replication deliberately varies something — a new setting, implementer, behavior, or learner — to test how far the effect extends. Successful systematic replications progressively widen the generality claim.

When an item asks for the biggest threat , scan for an event that coincides with the condition change — that is almost always the answer. When it asks for the best design improvement , choose the option that adds prediction, verification, or replication while remaining ethical and feasible. Avoid options that 'prove' generality from a single case; that confuses internal and external validity.

A reversal with one client may convincingly show a treatment reduced disruption for that client, but it does not prove the treatment will work for all clients, all settings, or all functions of behavior. Generality is also one face of social validity : a result is most useful when it holds in the settings and with the people the client actually lives and works among, run by the staff who will actually deliver it.