Study guide

5.3 Indicators, Measures, Reliability, and Validity

CHES Study Guide Exam

Track your progress as you read

Finished sections get a check mark.

1 Orientation: Current Exam Format, Eligibility, Scoring, and Study Model

1.1 Current CHES Purpose and Blueprint 1.2 Format, Delivery, and Time Rules 1.3 Blocks, Breaks, and Navigation 1.4 Scoring, Pass Point, and Results 1.5 Eligibility, Fees, and Scheduling 1.6 Confidentiality, Ethics, and Study Model

2 Area I: Assessment of Needs and Capacity

2.1 Area I Role and Assessment Logic 2.2 Priority Populations, Stakeholders, and Participation 2.3 Primary, Secondary, Qualitative, and Quantitative Data 2.4 Epidemiology, Determinants, and Data Interpretation 2.5 Assets, Capacity, and Community Readiness 2.6 Prioritization, Gaps, and Moving from Assessment to Planning

3 Area II: Planning: Goals, Objectives, Theory, and Program Design

3.1 Planning in the CHES Program Cycle 3.2 Goals and SMART Objectives 3.3 Logic Models and Program Theory 3.4 Selecting Theory and Matching Constructs 3.5 Evidence-Informed Strategies and Intervention Mix 3.6 Resources, Timelines, Work Plans, and Feasibility

4 Area III: Implementation: Strategies, Learning Methods, and Fidelity

4.1 Implementation in the CHES Program Cycle 4.2 Educational Strategies and Learning Methods 4.3 Health Literacy, Cultural Fit, and Accessibility During Delivery 4.4 Recruitment, Retention, and Participant Support 4.5 Fidelity, Adaptation, and Quality Monitoring 4.6 Delivery Barriers, Safety, Referrals, and Documentation

5 Area IV: Evaluation and Research: Designs, Measures, and Data Use

5.1 Evaluation Purpose and Types 5.2 Research Designs and Causal Logic 5.3 Indicators, Measures, Reliability, and Validity 5.4 Data Collection and Management 5.5 Analysis, Interpretation, and Data Use 5.6 Ethics, Reporting, and Continuous Improvement

6 Area V: Advocacy: Policy, Coalitions, and Systems Change

6.1 Advocacy Role and Planning 6.2 Stakeholders, Power, and Decision Makers 6.3 Policy Process and Systems Thinking 6.4 Coalition Building and Partnerships 6.5 Media Advocacy and Message Strategy 6.6 Advocacy Evaluation and Professional Boundaries

7 Area VI: Communication: Health Literacy, Media, Risk, and Audience Fit

7.1 Audience Analysis and Segmentation 7.2 Plain Language and Health Literacy 7.3 Teach-Back, Accessibility, and Inclusive Materials 7.4 Social Marketing and Message Strategy 7.5 Risk Communication and Crisis Messages 7.6 Digital Media, Message Testing, and Evaluation

8 Area VII: Leadership and Management: Resources, Partnerships, and Quality

8.1 Leadership Roles and Styles 8.2 Project Management, Work Plans, and Timelines 8.3 Budgeting, Resource Management, and Grant Basics 8.4 Staffing, Supervision, and Professional Development 8.5 Partnerships, Coalitions, and Collaboration 8.6 Continuous Quality Improvement and Program Sustainability

9 Area VIII: Ethics and Professionalism: Credential Use and Confidentiality

9.1 Health Education Code of Ethics and Entry-Level Judgment 9.2 Confidentiality, Privacy, and Data Protection 9.3 Exam Security, Nondisclosure, and Proprietary Content 9.4 Credential Use, Competence, and Professional Development 9.5 Equity, Fairness, Boundaries, and Power 9.6 Conflicts of Interest, Reporting Concerns, and Accountability

10 Cross-Area Scenarios: Program Cycle Integration and Decision-Making

10.1 Assessment-to-Planning Chain 10.2 Planning-to-Implementation Chain 10.3 Implementation-to-Evaluation Chain 10.4 Advocacy, Communication, and Leadership Integration 10.5 Ethics and Confidentiality Across Scenarios 10.6 Next-Best-Step Scenario Method

11 Timed Exam Strategy: Two-Block Workflow, Diagnostics, and Remediation

11.1 Build a 180-Minute Map for 165 Items 11.2 Work the Two-Block Navigation Rule 11.3 Guessing, Elimination, and Answer Changes 11.4 Convert Diagnostics Into a Study Plan 11.5 Use Practice Sets Without Chasing Memorized Questions 11.6 Run Focused Remediation Sprints by Area

12 Final Review: Recertification, Career Paths, and Next Steps

12.1 Two-Week Final Review Plan 12.2 Official Checklist and PSI Logistics 12.3 Test-Day Execution From Check-In to Exit 12.4 After-Score Steps and Retest Planning 12.5 Recertification, Annual Renewal, and CECH Planning 12.6 Career Paths, MCHES Direction, and Next Steps

5.3 Indicators, Measures, Reliability, and Validity

Key Takeaways Explain This Topic AI

Indicators translate objectives into observable evidence such as attendance, fidelity, knowledge scores, behavior, policy, or health status.

Reliability is consistency of measurement; validity is whether the measure captures the intended construct.

Validated instruments are preferred when they fit the population's language, literacy, culture, and the evaluation question.

Operational definitions specify exactly what will be counted, observed, or scored, preventing inconsistent data across staff and sites.

Last updated: June 2026

From Objectives to Indicators

An indicator is the observable sign that an objective was met or a process occurred. If an objective says participants will demonstrate correct inhaler technique, the indicator cannot be general satisfaction; it must be a checklist score , demonstration rating, or similar evidence. The exam frequently tests whether you can choose the indicator closest to the verb in the objective.

Indicators may be quantitative (counts, percentages, means, rates, scores) or qualitative (themes from interviews, observations, open-ended comments). Neither is automatically better; the best indicator answers the evaluation question with enough accuracy for the decision.

  • Objective level Example indicator
  • Process 4 of 6 sessions delivered with trained facilitators
  • Output 250 brochures distributed; 80 referrals made
  • Short-term outcome Mean self-efficacy score rises from 3.1 to 4.0
  • Behavioral outcome Percent screened in 6 months
  • Impact Clinic-level HbA1c control rate
  • Reliability: Consistency

Reliability is the consistency of a measure when the underlying trait has not changed.

Interrater reliability - two observers scoring the same demonstration agree.

Test-retest reliability - a stable concept yields similar scores at two time points.

Internal consistency - items meant to measure one construct correlate (often reported as Cronbach's alpha).

Validity: Meaning

Validity is whether the measure captures what it intends to.

Content validity - items cover the full concept.

Criterion validity - scores relate to an accepted standard (concurrent or predictive).

Construct validity - the measure behaves as theory predicts relative to other variables.

Face validity - the measure looks appropriate to respondents, but appearance alone is never sufficient.

A measure can be reliable yet invalid: a miscalibrated scale that reads 5 pounds heavy is perfectly consistent but wrong. It cannot be valid while unreliable, because random inconsistency obscures the true value.

Operational Definitions

An operational definition makes a concept concrete. Rather than "participation," define whether it means attending one session, attending four of six, completing homework, or actively practicing a skill. Rather than "healthy food access," define distance, price, store type, hours, or availability of specific items. Operational definitions let different staff, sites, and time points produce the same meaning.

Fit With the Priority Population

Measurement must fit the people. A validated English instrument may lose validity after an informal translation. A 40-item survey may be unrealistic in a busy clinic where a validated 10-item version still captures the construct. A digital-only survey excludes people without reliable internet. The CHES-level judgment preserves measurement quality while respecting literacy, language, disability access, culture, burden, and confidentiality. Burden is part of quality : the shorter valid tool that participants actually complete beats the longer one they abandon.

SMART Objectives Drive Indicators

Indicators flow directly from well-written objectives, which on the CHES exam follow the SMART standard: Specific, Measurable, Achievable, Relevant, and Time-bound. An objective such as "By the end of the six-week class, at least 75% of enrolled adults will correctly demonstrate four of five inhaler steps on a return-demonstration checklist" hands you the indicator (checklist score), the target (75%), and the timing (end of week six). A vague objective such as "improve asthma management" supplies no indicator at all.

When a scenario shows a fuzzy objective and a clean one, the measurable indicator belongs to the SMART version; the exam rewards selecting the objective that already specifies how success will be observed.

Levels of Measurement

The level of measurement constrains both the indicator and the later analysis, so it appears in Area IV items.

  • Level Description Example Typical summary
  • Nominal Unordered categories Insurance type Frequencies, mode
  • Ordinal Ranked, unequal gaps Likert agreement 1-5 Median, frequencies
  • Interval Equal gaps, no true zero Temperature in F Mean, standard deviation
  • Ratio Equal gaps, true zero Sessions attended, weight Mean, ratios

Knowing the level prevents errors such as averaging a nominal variable. You can count how many participants chose each insurance type, but you cannot compute a meaningful "average insurance type." Ratio data such as servings of vegetables or number of referrals support the widest range of statistics because zero is meaningful.

Sensitivity, Specificity, and Screening Indicators

When the indicator is a screening or test result, two properties decide its usefulness. Sensitivity is the share of people who truly have the condition that the test correctly flags (true positive rate); a sensitive test rarely misses cases. Specificity is the share of people who truly do not have the condition that the test correctly clears (true negative rate); a specific test rarely raises false alarms. A community blood-pressure screening tuned for high sensitivity will catch nearly everyone with hypertension but will refer some people who turn out fine, creating follow-up burden.

The exam may describe a screening tool and ask which property matters most for the program goal: when missing a case is dangerous, prioritize sensitivity; when false positives are costly or alarming, weigh specificity. These are reliability- and validity-adjacent concepts applied to measurement of a health condition.

Why Reliability and Validity Both Matter Together

Picture a target. A measure that is reliable but not valid clusters its shots tightly but off-center: consistent and wrong. A measure that is valid but not reliable scatters around the bullseye on average but is erratic on any single use, which is rarely achievable in practice because random noise undermines accuracy. The practical lesson for evaluation is to prefer instruments with published reliability and validity evidence in a population similar to yours, then confirm they still fit your participants' language and reading level before deciding the measure is trustworthy for your decision.

Reading the Verb

In applied items, scan the objective's verb. Words such as list, identify, demonstrate, attend, refer, adopt, and reduce point to different indicators. Demonstrate implies an observation checklist, attend implies an attendance log, refer implies a referral record, and reduce implies a before-and-after rate. Then ask whether the measure would yield the same meaning across staff, sites, languages, and time. A convenient but poorly matched measure can make an effective program look weak or an ineffective program look successful, which is why aligning the indicator to the verb is a recurring exam skill.