Study guide
13.4 Validity, Reliability, and Measurement Basics for Program Planning
Praxis School Counselor 5422
Track your progress as you read
Finished sections get a check mark.
1 Chapter 1: Exam Overview & Study Strategy
1.1 Praxis School Counselor (5422) Exam Specifications & Format 1.2 Test-Taking Strategies & Study Planning for School Counselors
2 Chapter 2: History, Role, and Professional Standards of the School Counselor
2.1 History and Evolution of Professional School Counseling 2.2 Appropriate vs. Inappropriate Roles and Responsibilities 2.3 Leadership, Advocacy, and Systemic Change in Schools 2.4 Professional Identity: Associations, Professional Development, Bias Awareness, and Wellness
3 Chapter 3: Human Growth, Learning, and Developmental Theories
3.1 Cognitive and Sociocultural Development (Piaget, Vygotsky) 3.2 Psychosocial and Moral Development (Erikson, Kohlberg, Gilligan) 3.3 Attachment, Behavioral, and Ecological Systems Theories 3.4 Personality, Emotional, and Holistic Development: Maslow, Freud, SEL, and Family Systems
4 Chapter 4: Career Development Theories and Postsecondary Planning
4.1 Foundational Career Theories: Trait-and-Factor and Developmental 4.2 Contemporary Career Theories: Cognitive and Social Learning 4.3 Career Exploration, Assessment Tools, and Postsecondary Pathways
5 Chapter 5: Legal Frameworks and Ethical Standards
5.1 ASCA Ethical Standards for School Counselors 5.2 Student Privacy, Education Records, and FERPA Compliance 5.3 Special Education Law, Civil Rights, and Student Protections 5.4 Confidentiality, Privileged Communication, and the Duty to Warn 5.5 Students' Constitutional Rights and Changing Education Law
6 Chapter 6: Direct Services: School Counseling Core Curriculum
6.1 ASCA Student Standards: Mindsets & Behaviors for Student Success 6.2 Curriculum Design, Scope and Sequence, and Lesson Planning 6.3 Classroom Instruction and Classroom Management for Counselors
7 Chapter 7: Direct Services: Individual Student Planning, Diverse Learners, and Test Interpretation
7.1 Academic Advising, Graduation Tracking, and Course Placement 7.2 Individual Goal Setting, Transition Planning, and College/Career Readiness 7.3 Serving Students Across Ability Levels 7.4 Cultural, Social, and Environmental Influences on Student Outcomes 7.5 Interpreting Achievement Tests: Fairness, Culture, and Accommodations
8 Chapter 8: Direct Services: Individual Counseling and Clinical Approaches
8.1 Solution-Focused Brief Counseling (SFBT) in Schools 8.2 Cognitive Behavioral Therapy (CBT) and Reality/Choice Therapy in Schools 8.3 Person-Centered and Adlerian Counseling Approaches with Youth 8.4 More Individual Counseling Approaches: Motivational Interviewing, Gestalt, REBT, Play, and Narrative Methods
9 Chapter 9: Direct Services: Group Counseling in Schools
9.1 Group Counseling Dynamics, Purpose, and Types in K-12 9.2 Group Selection, Screening, Informed Consent, and Ethical Considerations 9.3 Stages of Group Development and Facilitation Techniques
10 Chapter 10: Responsive Services: Crisis Response, Safety, and Prevention
10.1 Suicide Risk Assessment, Safety Planning, and Legal Duties 10.2 School-Wide Crisis Response, Psychological First Aid, and Bereavement 10.3 Child Abuse Reporting Mandates, Neglect, and Trauma-Informed Response 10.4 Peer Mediation and Conflict Resolution Programs 10.5 Preventing and Addressing Stress, Anxiety, Substance Use, and Bullying
11 Chapter 11: Indirect Services: Consultation Models and Practices
11.1 Models of Consultation (Triadic-Dependent, Collaborative, Mental Health) 11.2 Teacher and Staff Consultation and Behavior Intervention Strategies 11.3 Parent and Family Consultation, Education, and Engagement
12 Chapter 12: Indirect Services: Collaboration, MTSS, and Referrals
12.1 Multi-Tiered System of Supports (MTSS), RTI, and PBIS Frameworks 12.2 Community Partnerships, Mental Health Agency Referrals, and Care Coordination
13 Chapter 13: Program Focus, Student Outcome Goals, and Measurement
13.1 Program Beliefs, Philosophy, and Equity Commitments 13.2 Developing Vision and Mission Statements 13.3 Writing SMART Annual Student Outcome Goals for Achievement, Attendance, and Discipline 13.4 Validity, Reliability, and Measurement Basics for Program Planning
14 Chapter 14: Organizational Tools: Time Allocation, Administrative Conferences, and Advisory Councils
14.1 Use-of-Time Analysis and the ASCA 80/20 Direct/Indirect Standard 14.2 The Annual Administrative Conference and Caseload Management 14.3 Establishing and Facilitating the School Counseling Advisory Council 14.4 Annual and Weekly Calendars for Program Organization
15 Chapter 15: Action Plans and Closing-the-Gap Interventions
15.1 Classroom and Group Mindsets & Behaviors Action Plans 15.2 Closing-the-Gap Action Plans and Targeted Interventions 15.3 Technology Tools, Student Information Systems, and Data Security
16 Chapter 16: Data-Driven Accountability: Data Types and Results Reporting
16.1 Participation, Mindsets & Behaviors, and Outcome Data in the ASCA Model 16.2 Classroom and Group Results Reports Analysis 16.3 Closing-the-Gap Results Reports and Opportunity Gap Analysis 16.4 Sharing Program Results and Advocating with Stakeholders
17 Chapter 17: Program Evaluation, Counselor Appraisal, and Continuous Improvement
17.1 The ASCA School Counseling Program Assessment 17.2 School Counselor Professional Competencies and Performance Appraisal 17.3 Data-Informed Program Modification and Continuous Quality Improvement
13.4 Validity, Reliability, and Measurement Basics for Program Planning
Key Takeaways Explain This Topic AI
Reliability is consistency (test-retest, alternate forms, internal consistency, inter-rater); validity is whether evidence supports using a score for its purpose.
A test can be reliable without being valid, but it cannot be valid without being reliable.
Pre/post items must match the lesson's objectives and selected ASCA standard (content validity); ASCA suggests three to five items per measure.
Stanines run from 1 to 9 with a mean of 5 and a standard deviation of 2; about 68% of scores fall within one standard deviation of the mean.
A drop in chronic absenteeism from 20% to 15% is a 5 percentage-point decrease and a 25% relative decrease.
Last updated: September 2026
13.4 Validity, Reliability, and Measurement Basics for Program Planning
Quick Summary: The Manage domain asks you to know validity and reliability as applied to program planning and to be familiar with basic measurement principles—trends, stanines, percentile ranks, validity, and reliability. Counselors use these ideas when choosing career and achievement instruments, writing pre/post assessments and needs-assessment surveys, and reading school data.
Reliability: Consistency
Reliability is the consistency of scores: a reliable measure gives similar results under similar conditions.
- Type Question It Answers School Example
- Test-retest Are scores stable over time? An interest inventory given twice, three weeks apart
Alternate (parallel) forms Do two versions give similar results? Form A as the pre-test and Form B as the post-test
Internal consistency (split-half, Cronbach's alpha, KR-20) Do the items measure the same thing? Five items on a school-belonging scale
Inter-rater Do different scorers agree? Two counselors scoring role-plays with the same rubric
Reliability coefficients range from 0 to 1; higher is better, and decisions about individual students call for higher reliability than evaluations of a whole program. The standard error of measurement turns reliability into a score band: SEM = SD × √(1 − r). For example, ETS reports an SEM of 5.1 for the Praxis 5422.
Validity: Accuracy of Interpretation
Validity is the degree to which evidence supports using a score for a particular purpose—in plain terms, whether a test measures what it is intended to measure. That is exactly what the ETS sample describes when a counselor wants a career assessment that "actually measures what it intends to measure."
Type of Evidence Meaning Example
Content Items represent the domain taught or measured A post-test on graduation requirements covers credits, GPA, and required courses—not unrelated career facts
Criterion-related (concurrent or predictive) Scores relate to an outside measure now or later PSAT scores predicting AP exam success
Construct (convergent and discriminant) Scores behave as the theory predicts An anxiety scale correlates with other anxiety measures but not with math ability
Face validity The test looks appropriate to takers (not true evidence) Items obviously about study habits
Key relationships: a test can be reliable without being valid (a scale that is consistently five pounds off), but it cannot be valid without being reliable. Validity is specific to a purpose and a population.
Applying Validity and Reliability to Program Planning
Choosing instruments: check the manual for reliability, validity evidence, and a norm group that represents your students (ASCA A.14).
Writing pre/post assessments: match every item to the learning objective and the selected ASCA standard (content validity); keep measures short—ASCA suggests three to five questions or prompts; give the same items before and after; and administer them the same way each time.
Needs assessments: surveys of students, staff, and families identify priorities; the ETS study companion names a needs assessment as the best additional source when a counselor plans next year's academic supports after reviewing school data. Use clear, neutral wording; avoid double-barreled and leading questions; reach every group (translate for families); and follow PPRA rules when surveys touch protected topics.
Program decisions: do not overreact to a single data point—look for consistent evidence across sources and years.
Basic Statistics for Reading School Data
Central tendency: the mean (average) is pulled by extreme scores; the median (middle score) is better for skewed data; the mode is the most frequent score.
Variability: the range and the standard deviation (SD) .
Normal curve: about 68% of scores fall within ±1 SD of the mean, about 95% within ±2 SD, and about 99.7% within ±3 SD.
Percentile rank: the percentage of the norm group scoring at or below a score. The intervals are unequal, so small raw-score changes near the middle move percentiles a lot.
Stanines: nine bands with a mean of 5 and an SD of 2 ; 1–3 are below average, 4–6 average, and 7–9 above average.
Correlation (r): ranges from −1 to +1 and shows the strength and direction of a relationship, not causation.
Trends, Percent Change, and Percentage Points
Three or more years of data show whether a change is real or random fluctuation. Know the difference between two common ways of reporting change:
Chronic absenteeism falls from 20% to 15% : that is a 5 percentage-point decrease and a 25% relative decrease (5 ÷ 20).
In the ETS goal example, failing grades fall from 82 to 41 : a 50% decrease .
Report the number of students along with percentages, and compare with a baseline or a comparison group before claiming the program caused the change.
Praxis Application
Scenario: A counselor writes a ten-question post-test for a conflict-resolution unit, but four questions ask about college admissions.
Analysis: The test has a content-validity problem: those items do not match the unit's objectives or its selected standard. The counselor should replace them with items that measure the conflict-resolution knowledge and skills the lessons taught.