Study guide
5.2 Psychometric Foundations: Reliability, Validity, Norms, and Error
EPPP Study Guide Exam
Track your progress as you read
Finished sections get a check mark.
1 Orientation: EPPP Two-Part Exam, Eligibility, Fees, Authorization, Scoring, and Retakes
1.1 Two-Part 2026 EPPP and the Candidate Handbook 1.2 Jurisdiction Eligibility and Authorization to Test 1.3 Fees and Budget Control 1.4 Pearson VUE Appointments, Timing, and Identification 1.5 Scaled Scoring and Passing Recommendations 1.6 Retakes, Remediation, and Board Follow-Up
2 Part 1 and Part 2 Domain Map, Pretest Items, Pacing, and Study Strategy
2.1 Part 1-Knowledge Domain Map 2.2 Part 2-Skills Domain Map 2.3 Pretest Items and Exam Development 2.4 Timing, Pacing, and Review Discipline 2.5 Domain Weighting and Score Equating 2.6 Study Strategy Across Both Parts
3 Biological Bases and Cognitive-Affective Bases of Behavior
3.1 Part 1 Map for Biological and Cognitive-Affective Bases 3.2 Neuroanatomy, Neurotransmission, and Imaging 3.3 Psychopharmacology and Substance Effects 3.4 Genetics, Epigenetics, Endocrine Systems, and Health Behavior 3.5 Attention, Learning, Memory, and Executive Function 3.6 Emotion, Motivation, Stress, and Affect-Behavior Links
4 Social/Cultural Bases and Growth/Lifespan Development
4.1 Part 1 Map for Social/Cultural and Lifespan Domains 4.2 Social Cognition, Attitudes, and Attribution 4.3 Groups, Social Influence, and Relationships 4.4 Culture, Diversity, Identity, and Clinical Reasoning 4.5 Lifespan Theories, Developmental Tasks, and Aging 4.6 Risk, Protective Factors, and Developmental Psychopathology
5 Assessment and Diagnosis: Psychometrics, Differential Diagnosis, and Communication
5.1 Assessment Domain Orientation for EPPP Part 1 5.2 Psychometric Foundations: Reliability, Validity, Norms, and Error 5.3 Clinical Interviewing, Mental Status, Collateral Data, and Risk 5.4 Diagnostic Frameworks and Differential Diagnosis 5.5 Test Selection, Administration, Scoring, and Interpretation 5.6 Diversity-Responsive Assessment and Fair Interpretation 5.7 Assessment Reports, Feedback, and Communication of Findings
6 Treatment, Intervention, Prevention, Consultation, and Supervision Knowledge
6.1 Treatment Domain Orientation and Evidence-Based Practice 6.2 Case Formulation and Treatment Planning 6.3 Major Intervention Models and Mechanisms of Change 6.4 Prevention, Crisis Intervention, and Risk Management 6.5 Consultation, Interprofessional Work, and Systems Practice 6.6 Supervision Models, Competence, Evaluation, and Telepsychology
7 Research Methods, Statistics, and Evidence-Based Practice
7.1 Research Domain Map and Exam Logic 7.2 Designs, Sampling, and Variable Control 7.3 Measurement, Reliability, and Validity 7.4 Validity Threats and Causal Inference 7.5 Descriptive, Inferential, and Predictive Statistics 7.6 Effect Size, Power, Clinical Significance, and Program Evaluation
8 Ethical, Legal, and Professional Issues for Part 1
8.1 Ethics Domain, Sources, and Decision Model 8.2 Competence, Scope, Impairment, Consultation, and Referral 8.3 Informed Consent, Confidentiality, Privacy, and Records 8.4 Boundaries, Multiple Relationships, Conflicts, and Fees 8.5 Assessment, Intervention, Supervision, and Evidence Ethics 8.6 Telepsychology, Emerging Issues, Rights, and Jurisdiction
9 Part 2 Skills I: Scientific Orientation, Assessment, and Intervention
9.1 Scientific Orientation in Real Practice Decisions 9.2 Critical Appraisal and Evidence Fit 9.3 Assessment Method Selection and Measurement Planning 9.4 Interviewing, Observation, Collateral Data, and Diagnosis 9.5 Risk Assessment, Safety Planning, and Crisis Decisions 9.6 Intervention Planning, Adaptation, and Informed Consent 9.7 Progress Monitoring, Outcomes, and Course Correction
10 Part 2 Skills II: Relational Competence, Professionalism, and Ethical Practice
10.1 Relational Competence, Alliance, and Boundaries 10.2 Diversity, Culture, Language, and Bias in Practice 10.3 Self-Reflection, Competence, and Professional Limits 10.4 Professional Responsibility, Records, and Practice Management 10.5 Ethical Documentation, Consent, and Confidentiality 10.6 Billing, Multiple Relationships, and Ethical Consultation
11 Part 2 Skills III: Collaboration, Consultation, Supervision, and Systems Practice
11.1 Interdisciplinary Collaboration, Role Clarity, and Shared Decisions 11.2 Consultation Models, Referral Questions, and Boundaries 11.3 Supervision Structure, Alliance, Feedback, and Gatekeeping 11.4 Supervisee Compliance, Documentation, and Risk Response 11.5 Systems Practice, Program Evaluation, and Quality Improvement 11.6 Integrated Part 2 Decision Practice for Collaboration and Systems
12 Final EPPP Review: Test Day, Results, Score Transfer, and Licensure Next Steps
12.1 Final Two-Part Review and Official Fact Check 12.2 Authorization, Scheduling, Fees, and Identification 12.3 Test-Day Timing, Tutorial, Survey, and Pacing 12.4 Results, Scaled Scores, Feedback, and Score Meaning 12.5 Retakes, Score Transfer, and Board Follow-Up 12.6 Jurisprudence, Supervised Experience, and the Final Licensure File
5.2 Psychometric Foundations: Reliability, Validity, Norms, and Error
Key Takeaways Explain This Topic AI
Reliability concerns consistency of measurement; validity concerns whether evidence supports the intended interpretation and use of a score.
A test can be reliable without being valid for a specific referral question, population, language, or decision.
Standard error of measurement, base rates, sensitivity, specificity, and predictive values all change how a score should be interpreted.
EPPP items usually ask for the best interpretation of imperfect assessment data, not a memorized definition.
Last updated: June 2026
Psychometrics as Clinical Risk Management
Psychometrics keeps assessment from becoming impressionistic. Every score is a sample of behavior obtained under specific conditions, so the psychologist must ask whether the score is consistent enough to matter, whether the interpretation is supported, and whether the score should drive the decision at hand.
Reliability is consistency. Test-retest reliability concerns stability over time; interrater reliability concerns agreement among scorers; internal consistency (often summarized by Cronbach's alpha ) concerns whether items measure a related construct; and alternate-form reliability concerns equivalence across versions. As a rough EPPP heuristic, reliability coefficients around .90 or higher are expected for high-stakes individual decisions, while values near .70 to .80 are acceptable for group research but shaky for clinical calls about one person.
Low reliability widens error and weakens confidence in any individual conclusion.
Validity is the body of evidence supporting a particular interpretation and use. Content validity asks whether the test samples the relevant domain; criterion-related validity (concurrent or predictive) asks whether scores relate to an outcome; construct validity asks whether the test behaves as theory predicts, with convergent evidence (correlating with similar measures) and discriminant evidence (not correlating with unrelated ones). Consequential considerations ask whether use of the test predictably helps or harms in a setting.
A test can be highly reliable yet invalid for a given purpose. A depression inventory may consistently measure current distress and still tell you nothing valid about parenting capacity, malingering, or neurocognitive decline. The EPPP answer is frequently the one that limits the conclusion to the available evidence.
- Concept Meaning Practice implication
- Reliability Consistency of measurement Lower reliability means wider uncertainty around a score
- Validity Evidence for interpretation and use Evidence must match the specific referral question
- Norms The comparison sample for scores Norm group must fit age, language, culture, education
Standard error of measurement Expected imprecision of an observed score Report confidence intervals, not bare point scores
Base rate How common a condition is in the population Rare conditions create more false positives on broad screens
Norms are not decoration. A score is meaningful only against an appropriate reference group or criterion. Most cognitive and personality measures report scores in familiar metrics: a standard score with mean 100 and standard deviation 15 (so 85 to 115 is the average range, plus or minus one SD), T-scores with mean 50 and SD 10 (so 65 and above often flags clinical elevation, two SDs up), scaled scores with mean 10 and SD 3, and percentile ranks .
Age, education, language proficiency, disability, acculturation, and medical status can all shift the meaning of performance, so mismatched norms must be qualified, replaced, or supplemented with converging evidence.
The standard error of measurement (SEM) reminds candidates that observed scores are estimates. A single score should never be treated as exact, especially near a cut point or in a high-stakes decision. A 95% confidence interval spans roughly plus or minus two SEMs; an IQ of 98 with an SEM of 3 has a confidence band of about 92 to 104, which can straddle a classification boundary. Regression to the mean further warns that extreme scores tend to move toward average on retest.
Sensitivity and specificity appear constantly in screening items. Sensitivity is the proportion of true cases the test correctly flags; specificity is the proportion of non-cases it correctly clears. Positive predictive value (PPV) and negative predictive value (NPV) depend on the base rate, so the same instrument performs differently in a specialty clinic (high base rate, high PPV) than in a low-prevalence community screen (low PPV, many false positives).
When you see a sensitive screen used in a low-base-rate population, expect the EPPP to reward the answer that says a positive result needs confirmatory follow-up before diagnosis.
Response-style and validity indicators require the same restraint. Overreporting, underreporting, inconsistency, defensiveness, random responding, fatigue, low literacy, or cultural mismatch can all distort scores. The correct move is rarely to discard every datum; it is to interpret cautiously, document the limit, and seek additional evidence when the referral question still matters.
For exam scenarios, run this checklist:
Identify the construct and the decision being made.
Ask what reliability evidence the decision demands.
Ask what validity evidence supports the proposed interpretation.
Confirm the norm group, language, and education fit the examinee.
Account for SEM, base rates, and response style.
Integrate the score with interview, observation, records, and collateral data.
Psychometric competence protects clients and institutions from overconfidence and improves communication: a clear report states what a score supports, what it does not support, how much uncertainty remains, and what additional data would change the conclusion.
Common Psychometric Traps the EPPP Sets
Several psychometric distinctions appear so often that they deserve explicit drilling. The first is reliability versus validity : a coefficient near .95 tells you the instrument is consistent, never that it measures the right thing for the present decision. Whenever an option says a test is valid 'because it is reliable,' that option is wrong. A second trap concerns the ceiling on validity : a test's validity is bounded by its reliability, because you cannot validly measure a construct you cannot measure consistently.
This is why low reliability is fatal for individual high-stakes decisions even when group-level validity studies look acceptable.
A third frequent trap involves base rates and predictive value . Candidates who memorize that a test has '90% sensitivity' may forget that in a low-prevalence setting most positive results are still false positives. The EPPP rewards the reasoning that prevalence drives positive predictive value, so a positive screen for a rare condition warrants a confirmatory evaluation rather than an immediate diagnosis. A fourth trap is treating an observed score as exact. The presence of a confidence interval or standard error of measurement in an option usually signals the more defensible answer, because it acknowledges imprecision near a cut score.
A fifth area is score metrics and their relationships . Know that a percentile rank is not an interval scale, so the difference between the 50th and 60th percentile is not the same amount of ability as the difference between the 90th and 99th percentile; scores bunch in the middle of a normal distribution. Standard scores, T-scores, scaled scores, and z-scores are interval and can be compared with one another once converted to a common metric.
Roughly 68% of a normal distribution falls within one standard deviation of the mean, about 95% within two, and about 99.7% within three, which is the logic behind flagging a T-score of 70 (two SDs up) or a standard score of 70 (two SDs down) as clinically notable. Anchoring these conversions early prevents arithmetic errors under exam time pressure, where a single misread metric can flip an entire answer.