Study guide

7.3 Measurement, Reliability, and Validity

EPPP Study Guide Exam

Track your progress as you read

Finished sections get a check mark.

1 Orientation: EPPP Two-Part Exam, Eligibility, Fees, Authorization, Scoring, and Retakes

1.1 Two-Part 2026 EPPP and the Candidate Handbook 1.2 Jurisdiction Eligibility and Authorization to Test 1.3 Fees and Budget Control 1.4 Pearson VUE Appointments, Timing, and Identification 1.5 Scaled Scoring and Passing Recommendations 1.6 Retakes, Remediation, and Board Follow-Up

2 Part 1 and Part 2 Domain Map, Pretest Items, Pacing, and Study Strategy

2.1 Part 1-Knowledge Domain Map 2.2 Part 2-Skills Domain Map 2.3 Pretest Items and Exam Development 2.4 Timing, Pacing, and Review Discipline 2.5 Domain Weighting and Score Equating 2.6 Study Strategy Across Both Parts

3 Biological Bases and Cognitive-Affective Bases of Behavior

3.1 Part 1 Map for Biological and Cognitive-Affective Bases 3.2 Neuroanatomy, Neurotransmission, and Imaging 3.3 Psychopharmacology and Substance Effects 3.4 Genetics, Epigenetics, Endocrine Systems, and Health Behavior 3.5 Attention, Learning, Memory, and Executive Function 3.6 Emotion, Motivation, Stress, and Affect-Behavior Links

4 Social/Cultural Bases and Growth/Lifespan Development

4.1 Part 1 Map for Social/Cultural and Lifespan Domains 4.2 Social Cognition, Attitudes, and Attribution 4.3 Groups, Social Influence, and Relationships 4.4 Culture, Diversity, Identity, and Clinical Reasoning 4.5 Lifespan Theories, Developmental Tasks, and Aging 4.6 Risk, Protective Factors, and Developmental Psychopathology

5 Assessment and Diagnosis: Psychometrics, Differential Diagnosis, and Communication

5.1 Assessment Domain Orientation for EPPP Part 1 5.2 Psychometric Foundations: Reliability, Validity, Norms, and Error 5.3 Clinical Interviewing, Mental Status, Collateral Data, and Risk 5.4 Diagnostic Frameworks and Differential Diagnosis 5.5 Test Selection, Administration, Scoring, and Interpretation 5.6 Diversity-Responsive Assessment and Fair Interpretation 5.7 Assessment Reports, Feedback, and Communication of Findings

6 Treatment, Intervention, Prevention, Consultation, and Supervision Knowledge

6.1 Treatment Domain Orientation and Evidence-Based Practice 6.2 Case Formulation and Treatment Planning 6.3 Major Intervention Models and Mechanisms of Change 6.4 Prevention, Crisis Intervention, and Risk Management 6.5 Consultation, Interprofessional Work, and Systems Practice 6.6 Supervision Models, Competence, Evaluation, and Telepsychology

7 Research Methods, Statistics, and Evidence-Based Practice

7.1 Research Domain Map and Exam Logic 7.2 Designs, Sampling, and Variable Control 7.3 Measurement, Reliability, and Validity 7.4 Validity Threats and Causal Inference 7.5 Descriptive, Inferential, and Predictive Statistics 7.6 Effect Size, Power, Clinical Significance, and Program Evaluation

8 Ethical, Legal, and Professional Issues for Part 1

8.1 Ethics Domain, Sources, and Decision Model 8.2 Competence, Scope, Impairment, Consultation, and Referral 8.3 Informed Consent, Confidentiality, Privacy, and Records 8.4 Boundaries, Multiple Relationships, Conflicts, and Fees 8.5 Assessment, Intervention, Supervision, and Evidence Ethics 8.6 Telepsychology, Emerging Issues, Rights, and Jurisdiction

9 Part 2 Skills I: Scientific Orientation, Assessment, and Intervention

9.1 Scientific Orientation in Real Practice Decisions 9.2 Critical Appraisal and Evidence Fit 9.3 Assessment Method Selection and Measurement Planning 9.4 Interviewing, Observation, Collateral Data, and Diagnosis 9.5 Risk Assessment, Safety Planning, and Crisis Decisions 9.6 Intervention Planning, Adaptation, and Informed Consent 9.7 Progress Monitoring, Outcomes, and Course Correction

10 Part 2 Skills II: Relational Competence, Professionalism, and Ethical Practice

10.1 Relational Competence, Alliance, and Boundaries 10.2 Diversity, Culture, Language, and Bias in Practice 10.3 Self-Reflection, Competence, and Professional Limits 10.4 Professional Responsibility, Records, and Practice Management 10.5 Ethical Documentation, Consent, and Confidentiality 10.6 Billing, Multiple Relationships, and Ethical Consultation

11 Part 2 Skills III: Collaboration, Consultation, Supervision, and Systems Practice

11.1 Interdisciplinary Collaboration, Role Clarity, and Shared Decisions 11.2 Consultation Models, Referral Questions, and Boundaries 11.3 Supervision Structure, Alliance, Feedback, and Gatekeeping 11.4 Supervisee Compliance, Documentation, and Risk Response 11.5 Systems Practice, Program Evaluation, and Quality Improvement 11.6 Integrated Part 2 Decision Practice for Collaboration and Systems

12 Final EPPP Review: Test Day, Results, Score Transfer, and Licensure Next Steps

12.1 Final Two-Part Review and Official Fact Check 12.2 Authorization, Scheduling, Fees, and Identification 12.3 Test-Day Timing, Tutorial, Survey, and Pacing 12.4 Results, Scaled Scores, Feedback, and Score Meaning 12.5 Retakes, Score Transfer, and Board Follow-Up 12.6 Jurisprudence, Supervised Experience, and the Final Licensure File

7.3 Measurement, Reliability, and Validity

Key Takeaways Explain This Topic AI

Reliability concerns consistency of measurement; validity concerns the meaning and appropriate use of scores.

A measure can be reliable without being valid for a particular decision, but it cannot be valid without being reliable.

Validity evidence comes from content, criterion-related (predictive/concurrent), and construct sources (convergent and discriminant).

Sensitivity, specificity, and base rates govern classification accuracy and the meaning of positive screens.

Last updated: June 2026

Scores Are Evidence, Not Magic

Psychological research depends on measurement; a weak measure can sink an elegant design. EPPP measurement items ask whether a test, rating scale, observation system, or outcome measure is consistent enough and meaningful enough for the proposed use. The safest reasoning links the score to the decision being made.

Reliability is consistency. The four classic forms each estimate a different source of error:

  • Reliability type What it checks Typical statistic / cue
  • Test-retest Stability across time (stable trait) Correlation between two administrations
  • Interrater Agreement among observers/coders Cohen's kappa, intraclass correlation
  • Internal consistency Do items hang together? Cronbach's alpha, split-half
  • Alternate-forms Equivalence of two versions Correlation between Form A and Form B

A reliability coefficient is evidence about consistency under specified conditions, not a moral rating of a test. Reliability is bounded by error: high random measurement error lowers all observed correlations and attenuates effect estimates, which is why an unreliable measure can hide a real effect.

Validity concerns whether evidence and theory support the interpretation and use of scores. Validity is not a permanent property of a test; it is conditional on population and purpose. A depression screener may be valid for symptom screening in primary care yet inadequate for diagnosis, disability determination, or forensic conclusions. The EPPP frequently rewards the option that asks whether the measure was validated for this population and this decision.

Validity Evidence and Classification Accuracy

Modern psychometrics treats validity as a unified judgment supported by several sources of evidence:

Content validity evidence — do the items adequately sample the construct's domain? Subject-matter experts review coverage and relevance.

Criterion-related evidence — does the score relate to an external criterion? It is predictive when the score forecasts a later outcome (admissions test predicting GPA) and concurrent when it relates to a present criterion (a new screener correlated with an established one).

Construct validity evidence — does the measure behave as the construct predicts? Convergent evidence means it correlates with similar constructs; discriminant evidence means it does not correlate strongly with unrelated constructs (the multitrait-multimethod logic).

Reliability is necessary but not sufficient for validity. A bathroom scale that is always five pounds heavy is perfectly consistent yet inaccurate. A psychometrically tight scale can still fail if items misrepresent the construct, language is inappropriate for the client group, or the score is stretched beyond its validation evidence.

Classification measures add sensitivity and specificity :

Sensitivity = proportion of true cases correctly identified (true-positive rate). Screeners prioritize sensitivity because missing a serious condition is costly.

Specificity = proportion of true non-cases correctly identified (true-negative rate). Confirmatory decisions prioritize specificity to limit false positives.

Base rates modulate both. Positive predictive value (PPV) — the chance a positive screen reflects a true case — falls sharply when the disorder is rare, even with excellent sensitivity. Screening a low-prevalence population can produce many false positives, which is why a positive screen warrants confirmatory assessment rather than immediate diagnosis. For exam questions, slow down when an option says valid without saying valid for what ; the stronger option names the construct, population, decision, and evidence.

Score Interpretation and Standardized Metrics

Measurement on the EPPP also covers how raw scores become interpretable. Standardization places a score within a reference distribution. A z score has a mean of 0 and standard deviation of 1. A T score has a mean of 50 and SD of 10 (used by the MMPI and many clinical inventories), so a T of 70 is two SD above the mean. A standard IQ/index score typically has a mean of 100 and SD of 15, so a score of 130 sits two SD above the mean, around the 98th percentile.

Percentile ranks report the percentage of the norm group scoring at or below a value; they are not equal-interval, so percentile differences are compressed in the middle and stretched at the tails of a normal curve.

  • Metric Mean SD A score 2 SD above mean
  • z score 0 1 +2.0
  • T score 50 10 70
  • IQ / index score 100 15 130
  • Wechsler subtest scaled score 10 3 16

Two concepts govern the precision of an individual score. The standard error of measurement (SEM) estimates the band of error around an observed score; it shrinks as reliability rises, and a confidence interval built from the SEM (observed score plus or minus about 1.96 SEM for 95%) communicates how much a score might fluctuate on retest. The EPPP rewards reporting a score with its confidence band rather than as a fixed point, because two clients whose scores differ by a few points may not differ reliably.

Finally, beware norm-referenced versus criterion-referenced interpretation. A norm-referenced score (percentile, T score) says how a person compares to others; a criterion-referenced score says whether the person met an absolute standard (mastered the skill, exceeded a cutoff). A measure can be excellent for one purpose and inappropriate for the other, and using outdated norms (the Flynn effect , the gradual rise in population IQ over decades, inflates scores against old norms) is a recurring fairness and validity concern.

The exam-ready habit is to tie every score to its norm group, its purpose, and the error around it before drawing a conclusion.