Study guide

7.6 Effect Size, Power, Clinical Significance, and Program Evaluation

EPPP Study Guide Exam

Track your progress as you read

Finished sections get a check mark.

1 Orientation: EPPP Two-Part Exam, Eligibility, Fees, Authorization, Scoring, and Retakes

1.1 Two-Part 2026 EPPP and the Candidate Handbook 1.2 Jurisdiction Eligibility and Authorization to Test 1.3 Fees and Budget Control 1.4 Pearson VUE Appointments, Timing, and Identification 1.5 Scaled Scoring and Passing Recommendations 1.6 Retakes, Remediation, and Board Follow-Up

2 Part 1 and Part 2 Domain Map, Pretest Items, Pacing, and Study Strategy

2.1 Part 1-Knowledge Domain Map 2.2 Part 2-Skills Domain Map 2.3 Pretest Items and Exam Development 2.4 Timing, Pacing, and Review Discipline 2.5 Domain Weighting and Score Equating 2.6 Study Strategy Across Both Parts

3 Biological Bases and Cognitive-Affective Bases of Behavior

3.1 Part 1 Map for Biological and Cognitive-Affective Bases 3.2 Neuroanatomy, Neurotransmission, and Imaging 3.3 Psychopharmacology and Substance Effects 3.4 Genetics, Epigenetics, Endocrine Systems, and Health Behavior 3.5 Attention, Learning, Memory, and Executive Function 3.6 Emotion, Motivation, Stress, and Affect-Behavior Links

4 Social/Cultural Bases and Growth/Lifespan Development

4.1 Part 1 Map for Social/Cultural and Lifespan Domains 4.2 Social Cognition, Attitudes, and Attribution 4.3 Groups, Social Influence, and Relationships 4.4 Culture, Diversity, Identity, and Clinical Reasoning 4.5 Lifespan Theories, Developmental Tasks, and Aging 4.6 Risk, Protective Factors, and Developmental Psychopathology

5 Assessment and Diagnosis: Psychometrics, Differential Diagnosis, and Communication

5.1 Assessment Domain Orientation for EPPP Part 1 5.2 Psychometric Foundations: Reliability, Validity, Norms, and Error 5.3 Clinical Interviewing, Mental Status, Collateral Data, and Risk 5.4 Diagnostic Frameworks and Differential Diagnosis 5.5 Test Selection, Administration, Scoring, and Interpretation 5.6 Diversity-Responsive Assessment and Fair Interpretation 5.7 Assessment Reports, Feedback, and Communication of Findings

6 Treatment, Intervention, Prevention, Consultation, and Supervision Knowledge

6.1 Treatment Domain Orientation and Evidence-Based Practice 6.2 Case Formulation and Treatment Planning 6.3 Major Intervention Models and Mechanisms of Change 6.4 Prevention, Crisis Intervention, and Risk Management 6.5 Consultation, Interprofessional Work, and Systems Practice 6.6 Supervision Models, Competence, Evaluation, and Telepsychology

7 Research Methods, Statistics, and Evidence-Based Practice

7.1 Research Domain Map and Exam Logic 7.2 Designs, Sampling, and Variable Control 7.3 Measurement, Reliability, and Validity 7.4 Validity Threats and Causal Inference 7.5 Descriptive, Inferential, and Predictive Statistics 7.6 Effect Size, Power, Clinical Significance, and Program Evaluation

8 Ethical, Legal, and Professional Issues for Part 1

8.1 Ethics Domain, Sources, and Decision Model 8.2 Competence, Scope, Impairment, Consultation, and Referral 8.3 Informed Consent, Confidentiality, Privacy, and Records 8.4 Boundaries, Multiple Relationships, Conflicts, and Fees 8.5 Assessment, Intervention, Supervision, and Evidence Ethics 8.6 Telepsychology, Emerging Issues, Rights, and Jurisdiction

9 Part 2 Skills I: Scientific Orientation, Assessment, and Intervention

9.1 Scientific Orientation in Real Practice Decisions 9.2 Critical Appraisal and Evidence Fit 9.3 Assessment Method Selection and Measurement Planning 9.4 Interviewing, Observation, Collateral Data, and Diagnosis 9.5 Risk Assessment, Safety Planning, and Crisis Decisions 9.6 Intervention Planning, Adaptation, and Informed Consent 9.7 Progress Monitoring, Outcomes, and Course Correction

10 Part 2 Skills II: Relational Competence, Professionalism, and Ethical Practice

10.1 Relational Competence, Alliance, and Boundaries 10.2 Diversity, Culture, Language, and Bias in Practice 10.3 Self-Reflection, Competence, and Professional Limits 10.4 Professional Responsibility, Records, and Practice Management 10.5 Ethical Documentation, Consent, and Confidentiality 10.6 Billing, Multiple Relationships, and Ethical Consultation

11 Part 2 Skills III: Collaboration, Consultation, Supervision, and Systems Practice

11.1 Interdisciplinary Collaboration, Role Clarity, and Shared Decisions 11.2 Consultation Models, Referral Questions, and Boundaries 11.3 Supervision Structure, Alliance, Feedback, and Gatekeeping 11.4 Supervisee Compliance, Documentation, and Risk Response 11.5 Systems Practice, Program Evaluation, and Quality Improvement 11.6 Integrated Part 2 Decision Practice for Collaboration and Systems

12 Final EPPP Review: Test Day, Results, Score Transfer, and Licensure Next Steps

12.1 Final Two-Part Review and Official Fact Check 12.2 Authorization, Scheduling, Fees, and Identification 12.3 Test-Day Timing, Tutorial, Survey, and Pacing 12.4 Results, Scaled Scores, Feedback, and Score Meaning 12.5 Retakes, Score Transfer, and Board Follow-Up 12.6 Jurisprudence, Supervised Experience, and the Final Licensure File

7.6 Effect Size, Power, Clinical Significance, and Program Evaluation

Key Takeaways Explain This Topic AI

Effect size describes the magnitude of a finding and can matter more for practice than whether a result merely crosses p < .05.

Clinical significance asks whether change is meaningful for functioning, risk, symptoms, or quality of life, not just statistically detectable.

Program evaluation applies research logic to real services using needs, process/fidelity, outcome, and cost data.

Evidence-based practice integrates the best research evidence, clinical expertise, and client characteristics, culture, and preferences.

Last updated: June 2026

Move From Results to Practice Decisions

Research findings become useful only when they inform decisions responsibly. A result can be statistically detectable yet too small, too narrow, or too uncertain to guide care alone, which is why the EPPP research domain folds in effect size, power, clinical significance, and program evaluation. These tools move the candidate from a table of results to a defensible professional conclusion.

Effect size quantifies magnitude, independent of sample size. Because a tiny p value can come from a large sample rather than a large effect, effect size is the better index of practical importance. Common metrics with conventional benchmarks:

  • Effect-size metric Used for Small / medium / large (Cohen)
  • Cohen's d Difference between two means 0.2 / 0.5 / 0.8
  • Pearson r Association between two continuous variables 0.1 / 0.3 / 0.5
  • Eta-squared / partial eta-squared Variance explained in ANOVA .01 / .06 / .14
  • Odds ratio / risk ratio Likelihood comparisons in outcome research 1.0 = no effect

The EPPP may ask which of two findings is more meaningful for clinical planning. A large, well-powered study with d = 0.15 is statistically significant but trivial; a smaller study with d = 0.80 may be more clinically compelling even if the p value is less impressive. Meta-analysis aggregates effect sizes across studies to produce a pooled estimate and examine moderators, which is why it sits near the top of the evidence hierarchy.

Clinical Significance, Power, and Evidence-Based Practice

Clinical significance is not the same as statistical evidence. A symptom score may shift enough to register in a study yet not enough for the client to return to work, sleep safely, reduce risk, or meet treatment goals. Jacobson and Truax's methods (reliable change index and movement from the dysfunctional to the functional distribution) operationalize whether change is meaningful , not merely detectable. Good judgment weighs both statistical and clinical meaning.

Power protects against false reassurance. Low power can stem from a small sample, noisy measurement, weak manipulation, high attrition, or inappropriate analysis. A non-significant result in an underpowered study does not prove an intervention is ineffective; it means the evidence is limited. The strongest EPPP answer avoids overstatement in either direction.

Evidence-based practice (EBP) in psychology, per the APA policy, is the integration of (1) the best available research evidence, (2) clinical expertise, and (3) patient characteristics, culture, and preferences. EBP is not mechanical manualized delivery; the best answer usually selects, adapts, monitors, and documents care for the specific person and context, considering developmental status, comorbidity, setting, risk, and resources.

Program evaluation brings research methods into agencies and systems through four staged questions:

Needs assessment — what does the population require?

Process / fidelity evaluation — is the program delivered as designed?

Outcome evaluation — did the targeted changes occur?

Cost / efficiency evaluation — do the benefits justify the resources?

Measurement quality governs all four. If a clinic claims success because attendance rose, the next questions are whether client outcomes improved, whether services were delivered with fidelity , and whether access improved for the intended groups. If only satisfied completers answer a survey, response/survivor bias inflates positive conclusions; if staff change documentation midyear, instrumentation distorts trends.

Treat every applied research item as a chain: the design creates the evidence, statistics summarize magnitude and uncertainty, clinical significance asks whether the change matters, and EBP asks how the finding should be used with a specific client or program.

The Evidence Hierarchy and a Final Integration

The EPPP expects familiarity with the rough hierarchy of research evidence , while recognizing that design quality, not just design type, determines trustworthiness:

  • Level Design Strength for causal claims
  • Highest Systematic review / meta-analysis of RCTs Strongest; pools effects, examines moderators
  • High Single well-conducted RCT Strong internal validity
  • Moderate Quasi-experimental / cohort Useful; confounding remains a risk
  • Lower Case-control / correlational Association, prediction, hypothesis generation
  • Lowest Case study / expert opinion Descriptive; weak for causal inference

A meta-analysis aggregates effect sizes across studies to yield a pooled estimate and to test moderators, but it inherits the flaws of its inputs ("garbage in, garbage out") and can suffer publication bias , the tendency for significant results to be published while null results stay in the file drawer, which inflates the apparent effect. Recognizing publication bias, and tools such as the funnel plot used to detect it, is a high-yield exam point.

Two applied cautions round out the domain. First, statistical regression and selection routinely masquerade as program success in uncontrolled evaluations; a program that enrolls only the most impaired clients will look effective even if it does nothing, because the most extreme scores drift toward average. A comparison group is the antidote.

Second, fidelity and dosage mediate every outcome claim: if a manualized treatment was delivered with poor adherence or in too few sessions, a null outcome may reflect implementation failure rather than an ineffective treatment, which is why process and fidelity data must be inspected before interpreting outcomes.

Pulling the chapter together, the disciplined EPPP test-taker reasons in a chain for every applied research item. The design determines what causal weight the evidence can bear. The measurement determines whether the variables are trustworthy. The statistics summarize uncertainty (significance, confidence intervals) and magnitude (effect size). Clinical significance asks whether the change matters in a client's life. And evidence-based practice integrates that evidence with clinical expertise and the client's culture, values, and preferences.

Choosing the answer that honors every link in that chain, and rejecting the one that overreaches at any link, is the single most reliable strategy for this 7% domain and for the evidence-evaluation reasoning woven through the rest of the EPPP.