Study guide
Data Collection Instruments, Validated Methods, and Survey Design
Certified in Public Health CPH
Track your progress as you read
Finished sections get a check mark.
1 Foundations of Public Health Data and Analytics
Primary vs Secondary Data: Sources, Applications, and Selection Data Collection Instruments, Validated Methods, and Survey Design Data Cleaning, Management, and Descriptive Statistics for Validity
2 Disease Frequency, Interpretation, and Informatics
Mortality, Morbidity, Prevalence, Incidence, and Risk Data Interpretation Interpreting Quantitative and Qualitative Results in Public Health Studies Surveillance Systems, Registries, Data Synthesis, Visualization, and Informatics
3 Communication Foundations and Planning
Professional Communication, Needs Assessment, and Communication Plans Health Literacy and Culturally Appropriate Communication Approaches Risk Communication and Crisis Communication Models and Principles
4 Media, Ethics, and Data Translation in Communication
Social, Digital, and Traditional Media in Public Health Communication Communication Evaluation, Ethics, Facilitation Skills, and Data Translation for Diverse Audiences
5 Infectious and Chronic Disease Prevention
Health Hazard Identification: Frequency and Impact Assessment Infectious Disease Prevention: Transmission Modes, Risk, and Protective Factors Chronic Disease Prevention: Risk and Protective Factors
6 Environmental Health, Injury, and Emergency Management
Environmental Hazards and Mental Health/Substance Use Disorder Prevention Unintentional and Intentional Injury Prevention Public Health Emergency Management Principles and Response
7 Program Planning and Intervention Design
Needs Assessment, Context-Specific Intervention Design, and Health Equity Lens Objectives, Evaluation Metrics, and Project Management for Program Planning Formative, Process, and Outcome Evaluation Types
8 Evaluation Methods, Implementation, and Resources
Quantitative, Qualitative, and Mixed Evaluation Methods and Report Quality Using Evaluation Results, Implementation Fidelity, and Resource Evaluation
9 Collaboration, Partnership, and Community Engagement
Cross-Sector Partnerships and Stakeholder Engagement The Broader Public Health System and Governmental Agency Partnerships Collaboration Strategies and Community Collective Action Evaluating Coalition and Partnership Effectiveness
10 Health Equity and Social Justice
Culturally Appropriate Assessment and Engagement with Diverse Communities Values, Perspectives, and Health Behaviors in Diverse Populations Health Disparities, Systemic Racism, and Discrimination Access to Services, Environmental Justice, and Human Rights Principles
11 Leadership: Strategy, Change, and Teams
Strategic Planning, Resource Allocation, and Organizational Performance Evaluation Change Management, Conflict Management, and Negotiation Skills Team Building, Performance Standards, Motivation, and Innovation
12 Leadership: Decision Making, Capacity, and CQI
Data-Driven Decision Making, Collaborative Problem Solving, and Capacity Building Vision Communication and Continuous Quality Improvement
13 Program and Resource Management
Budgeting, Financial Proposals, and Contract Management Operations Management, Resource Forecasting, and Program Sustainability CHA/CHIP Implementation and Project Team Coordination Personnel Management, Constructive Feedback, and Retention
14 Law and Ethics
Privacy, Confidentiality, and Regulatory Compliance Ethical Principles, Data Ethics, and Conflicts of Interest International Health Regulations and Health Impact Assessment of Laws
15 Policy in Public Health
The Governmental Policy-Making Process and Policy Implementation Policy Analysis: Evidence, Feasibility, and Impact Assessment Advocacy, Defending Policies, Educating Decision Makers, and Equitable Policy Design
Data Collection Instruments, Validated Methods, and Survey Design
Key Takeaways Explain This Topic AI
Validity (face, content, construct, criterion) and reliability (test-retest, inter-rater, internal consistency measured by Cronbach's alpha at or above 0.70) govern whether an instrument is usable.
Recognized validated instruments include SF-36/SF-12, PHQ-9, GAD-7, AUDIT/AUDIT-C, the Beck Depression Inventory, and the USDA Food Security Module.
Designing a new tool requires plain-language single-barreled items, mutually exclusive response options, sensitive items placed last, and cognitive pretesting.
Probability sampling supports population inference; convenience sampling does not, regardless of how strong the instrument is.
Mode of administration (phone, web, in-person, mail, mixed) affects who responds and how answers are given through social desirability bias.
Last updated: July 2026
Quick Answer: Validated instruments are measurement tools with documented evidence for reliability and validity in a target population; the CPH exam tests your ability to identify them (SF-36, PHQ-9, BRFSS modules, AUDIT) and to design new data collection tools that follow sound question-writing, sampling, and pretesting practices.
Validity and Reliability Foundations
Before using any instrument, confirm two properties. Validity is whether the instrument measures what it claims to measure: face validity (looks right to experts), content validity (covers the construct's domains), construct validity (correlates with related measures as expected), and criterion validity (agrees with a gold standard, expressed as sensitivity and specificity for screening tools). Reliability is consistency of measurement: test-retest reliability (stable answers on repeat administration), inter-rater reliability (agreement between observers, often measured by kappa), and internal consistency (items in a scale move together, measured by Cronbach's alpha, with 0.70 or above generally acceptable for group-level use).
Widely Used Validated Instruments
The exam names specific instruments you should recognize:
SF-36 and SF-12: generic health-related quality-of-life scales.
PHQ-9: nine-item depression screen with established cut points (a score of 10 or above suggests moderate depression).
GAD-7: seven-item generalized anxiety screen.
AUDIT and AUDIT-C: World Health Organization alcohol use disorder screens.
Beck Depression Inventory (BDI): 21-item self-report depression severity scale.
USDA Food Security Module: household food insecurity scale used in federal nutrition monitoring.
BRFSS optional modules: state-selected validated question sets on topics such as adverse childhood experiences, cognitive decline, and food insecurity.
Using a validated instrument is preferable to writing your own because the psychometric work is already done, results are comparable across studies, and reviewers trust established tools. The trade-off is that the instrument may not fit your construct exactly, and translated or cultural adaptations require their own validation evidence in the new population before cut points can be applied.
Designing a New Data Collection Tool
When no validated instrument fits, you design your own. The process: define the construct, draft items in plain language at or below a 6th-grade reading level, avoid double-barreled questions ("Do you smoke and drink?"), avoid leading or loaded wording, provide mutually exclusive and exhaustive response options, order sensitive items last, and pretest with cognitive interviewing to confirm respondents interpret items as intended.
- Step Purpose Common Error
- Define construct Decide what you measure Vague "well-being" without dimensions
- Draft items Translate construct to questions Double-barreled items
- Response options Fix the measurement scale Overlapping or missing categories
- Ordering Build trust, reduce fatigue Sensitive items placed first
- Cognitive testing Check interpretation Skipping the pretest
- Field test / pilot Estimate reliability and burden Piloting only the instrument, not the sampling
- Survey Sampling Essentials
A survey is only as good as its sampling frame. Probability samples (simple random, stratified, cluster, systematic) allow statistical inference to the target population. Non-probability samples (convenience, purposive, snowball) are acceptable for formative or qualitative work but cannot generalize without strong assumptions. Sample size is driven by the desired precision (margin of error), the expected prevalence, and the design effect from clustering and weighting. Non-response bias is addressed through weighting, follow-up contacts, and reporting the response rate using AAPOR standards.
Mode of Administration
Mode shapes who responds and how. Telephone surveys (BRFSS) reach broad populations but exclude households without phones and are increasingly affected by cell-phone-only households. Web surveys are cheap and fast but skew toward the digitally connected. In-person surveys achieve the highest response rates and allow physical examination (NHANES) but are costly. Mail surveys work for address-based frames. Mixed-mode designs combine modes to improve coverage while managing mode effects on responses, and the analysis must adjust for mode to avoid biased estimates.
Worked Scenario
A local health department needs to assess depression among Spanish-speaking agricultural workers. The team selects the PHQ-9, which has a validated Spanish translation, and administers it in person during a farmworker health fair. Because the fair crowd is a convenience sample, results describe attendees, not the full worker population; the report must state that limitation. If the department wanted county-level estimates, it would need a probability frame such as employer rosters stratified by crop type, or a household survey in agricultural census tracts. The validated instrument cannot rescue an unrepresentative sample.
Exam Traps
Treating "validated" as a marketing label. A single published study in one population does not generalize the instrument to all populations; cross-cultural validity must be demonstrated.
Confusing sensitivity and specificity with reliability. Screening test metrics describe criterion validity against a gold standard, not consistency of repeated measurement.
Assuming longer instruments are more valid. Adding items can lower response rates and does not automatically improve measurement.
Forgetting that mode changes answers. The same question asked by phone versus self-administered web can yield different distributions due to social desirability.
Treating Cronbach's alpha as a measure of validity. Alpha reflects internal consistency only; a scale can be highly consistent and still measure the wrong construct.