Study guide

1.7 Evidence-Based Practice and Research Methodologies

ANCC Psychiatric-Mental Health Nurse Practitioner PMHNP-BC

Track your progress as you read

Finished sections get a check mark.

1 Chapter 1: Scientific Foundation

1.1 Neuroanatomy and Brain Function 1.2 Neurotransmitters and Synaptic Transmission 1.3 Neurodevelopmental and Neuroendocrine Mechanisms 1.4 Psychbehavioral Genetics and Epigenetics 1.5 Psychoneuroimmunology and Inflammatory Pathways 1.6 Psychopathology and Diagnostic Foundations 1.7 Evidence-Based Practice and Research Methodologies 1.8 Lifespan Growth and Development Theories 1.9 Health Promotion and Disease Prevention

2 Chapter 2: Advanced Practice Skills

2.1 Comprehensive Psychiatric Interview and Health History 2.2 Mental Status Examination (MSE) Concepts and Clinical Application 2.3 Physical and Neurological Assessment in Psychiatry 2.4 Diagnostic Laboratory and Imaging Interpretation 2.5 Suicide Risk Assessment and Safety Formulation 2.6 Violence and Homicide Risk Assessment 2.7 Substance Use, Intoxication, and Withdrawal Assessment 2.8 Cultural Competence and Social Determinants of Mental Health 2.9 Therapeutic Alliance and Clinical Communication 2.10 Functional and Diagnostic Risk Stratification

3 Chapter 3: Diagnosis and Treatment

3.1 Neurodevelopmental and Schizophrenia Spectrum Disorders 3.2 Bipolar and Related Disorders 3.3 Depressive Disorders 3.4 Anxiety Disorders, OCD, and Trauma-Related Disorders 3.5 Substance-Related and Addictive Disorders 3.6 Neurocognitive Disorders 3.7 Personality Disorders 3.8 Feeding/Eating, Sleep-Wake, and Somatic Symptom Disorders 3.9 Psychopharmacology Foundations: Antipsychotics and Mood Stabilizers 3.10 Psychopharmacology Foundations: Antidepressants, Anxiolytics, and Stimulants

4 Chapter 4: Psychotherapy and Related Theories

4.1 Cognitive Behavioral Therapy (CBT) and Dialectical Behavior Therapy (DBT) 4.2 Psychodynamic and Psychoanalytic Theories 4.3 Humanistic, Person-Centered, and Motivational Interviewing 4.4 Family and Group Psychotherapy Modalities 4.5 Integrative and Complementary Mental Health Approaches

5 Chapter 5: Ethics, Legal Principles, and Cultural Care

5.1 Patient Autonomy, Informed Consent, and Capacity 5.2 Involuntary Commitment and Patient Rights 5.3 Confidentiality, HIPAA, and Duty to Protect 5.4 Professional Scope of Practice and Prescriptive Authority 5.5 Malpractice, Liability, and Risk Management 5.6 Health Policy, Advocacy, and Mental Health Parity 5.7 Quality Improvement, Patient Safety, and Interprofessional Collaboration 5.8 Telepsychiatry, Technology, and Ethical Care Delivery

1.7 Evidence-Based Practice and Research Methodologies

Key Takeaways Explain This Topic AI

Level I evidence (Systematic Reviews and Meta-Analyses of Randomized Controlled Trials) represents the gold standard for guiding PMHNP clinical decision-making.

Statistical significance (p < 0.05) indicates that a study finding is unlikely due to chance, but does NOT guarantee clinical significance or meaningful functional improvement for the patient.

Number Needed to Treat (NNT = 1 / Absolute Risk Reduction) measures clinical treatment efficacy; an ideal NNT is low (e.g., < 5). Number Needed to Harm (NNH = 1 / Absolute Risk Increase) measures risk; an ideal NNH is high.

Incidence measures the rate of NEW cases appearing in a population over a specific timeframe, whereas Prevalence measures the TOTAL (new + existing) cases active in a population.

The 7-step Evidence-Based Practice process relies on formulating clear PICOT questions (Population, Intervention, Comparison, Outcome, Timeframe) and critically appraising literature using validated instruments like AGREE II and CASP.

Last updated: July 2026

Evidence-Based Practice and Research Methodologies

Evidence-Based Practice (EBP) is the conscientious, explicit, and judicious integration of the best research evidence with clinical expertise and patient values and preferences . For the Psychiatric-Mental Health Nurse Practitioner (PMHNP), competence in research design, statistical interpretation, and critical appraisal is essential. ANCC examination questions test your ability to evaluate clinical literature, interpret epidemiological risk metrics, calculate therapeutic effect sizes, and translate clinical practice guidelines (CPGs) into safe patient care.

The Hierarchy of Evidence

Clinical evidence is structured hierarchically based on study design rigor and susceptibility to bias. PMHNPs must prioritize higher-level evidence when formulating clinical protocols. /\ Level I: Systematic Reviews & Meta-Analyses of RCTs

  • / \----------------------------------------------------
  • / \ Level II: Individual Randomized Controlled Trials (RCTs)
  • / \----------------------------------------------------
  • / \ Level III: Controlled Trials Without Randomization
  • / \----------------------------------------------------
  • / \ Level IV: Case-Control and Cohort Studies
  • / \----------------------------------------------------
  • / \ Level V: Systematic Reviews of Descriptive Studies
  • / \----------------------------------------------------
  • / \ Level VI: Single Descriptive or Qualitative Studies
  • / \----------------------------------------------------
  • / \ Level VII: Expert Opinion, Guidelines, Case Reports
  • ---------------------------

Detailed Breakdown of Levels:

Level I (Highest): Systematic Reviews and Meta-Analyses of Randomized Controlled Trials (RCTs). Meta-analyses pool quantitative data across multiple RCTs to increase sample size, enhance statistical power, and produce a definitive effect size.

Level II: At least one properly designed, double-blind, randomized controlled trial. RCTs minimize selection bias through random assignment and control for confounding variables.

Level III: Well-designed controlled trials without randomization (quasi-experimental studies, non-randomized pre-post designs).

Level IV: Well-designed observational studies: Cohort Studies (longitudinal, tracking exposed vs. unexposed groups forward over time for incidence) and Case-Control Studies (retrospective, comparing individuals with a condition to controls without, calculating Odds Ratios).

Level V: Systematic reviews of descriptive, qualitative, or epidemiological studies.

Level VI: A single descriptive study, qualitative inquiry (e.g., phenomenology, grounded theory), or quality improvement project.

Level VII (Lowest): Expert opinion of prominent authorities, clinical consensus panel reports, or single case reports.

Study Design Key Characteristics Primary Metric / Output Major Limitations

Meta-Analysis Statistical pooling of multiple RCTs Pooled Effect Size, Forest Plot, I 2 I^2 I 2 Heterogeneity Publication bias, heterogeneity

Randomized Controlled Trial Random assignment, control group, double-blinding Relative Risk (RR), ARR, NNT High cost, strict exclusion criteria

Cohort Study Follows exposed vs. unexposed over time Relative Risk (RR), Incidence Rate Attrition bias, loss to follow-up

Case-Control Study Retrospective analysis matching cases & controls Odds Ratio (OR) Recall bias, selection bias

Qualitative Study Explores lived experiences, themes, perceptions Thematic saturation, narrative analysis Non-generalizable, subjective

  • Quantitative Research & Statistical Principles
  • Statistical Significance vs. Clinical Significance

Statistical Significance: Measured by the p-value . A value of p < 0.05 p < 0.05 p < 0.05 indicates a less than 5% probability that the observed difference between treatment groups occurred purely by random chance (rejecting the null hypothesis). However, statistical significance is heavily influenced by sample size ( N N N ). In large trials, a 1-point reduction on the Hamilton Depression Rating Scale (HAM-D) may reach p < 0.001 p < 0.001 p < 0.001 , but carry no meaningful functional benefit.

Clinical Significance: Refers to whether an intervention produces a noticeable, meaningful improvement in a patient's symptoms, daily functioning, or quality of life. Clinical significance is evaluated using Effect Size measures (e.g., Cohen's d d d ) and clinical response/remission thresholds.

Effect Size & Confidence Intervals

Cohen’s d d d : Quantifies the magnitude of difference between two means in standard deviation units.

  • d = 0.2 d = 0.2 d = 0.2 : Small effect
  • d = 0.5 d = 0.5 d = 0.5 : Medium effect
  • d = 0.8 d = 0.8 d = 0.8 : Large effect

95% Confidence Interval (CI): Represents the range of values within which the true population parameter is expected to fall 95% of the time.

Critical Exam Rule: If a 95% CI for a ratio metric (Odds Ratio or Relative Risk) includes 1.0 , the result is NOT statistically significant (e.g., OR = 1.4, 95% CI [0.95, 2.10] is non-significant).

If a 95% CI for a difference in means includes 0 , the result is NOT statistically significant .

Type I and Type II Errors

Type I Error ( α \alpha α ): A false positive. Rejecting the null hypothesis when it is actually true (claiming a drug works when it does not). Alpha is typically set at 0.05.

Type II Error ( β \beta β ): A false negative. Failing to reject the null hypothesis when it is actually false (missing a true drug effect). Statistical Power is defined as 1 − β 1 - \beta 1 − β ; acceptable power in clinical research is ≥ 0.80 \ge 0.80 ≥ 0.80 (80%).

Key Epidemiological Metrics

Epidemiology measures how disease is distributed across populations. PMHNPs must distinguish between incidence and prevalence. Incidence Rate = Number of NEW cases occurring in a specific time period Population at risk during that time period × k \text{Incidence Rate} = \frac{\text{Number of NEW cases occurring in a specific time period}}{\text{Population at risk during that time period}} \times k Incidence Rate = Population at risk during that time period Number of NEW cases occurring in a specific time period ​ × k Prevalence Rate = TOTAL number of existing (new + old) cases at a given time Total population at that time × k \text{Prevalence Rate} = \frac{\text{TOTAL number of existing (new + old) cases at a given time}}{\text{Total population at that time}} \times k Prevalence Rate = Total population at that time TOTAL number of existing (new + old) cases at a given time ​ × k

Incidence: Reflects the risk of contracting a disease. Useful for evaluating the efficacy of primary prevention programs.

Prevalence: Reflects the overall burden of disease on the healthcare system. Factors that prolong chronic illness without curing it (e.g., effective maintenance antipsychotic therapy) increase prevalence while keeping incidence constant.

Therapeutic Metrics: Calculating NNT and NNH

Evaluating the clinical utility of psychiatric medications requires understanding Number Needed to Treat (NNT) and Number Needed to Harm (NNH) .

Absolute Risk Reduction (ARR) & NNT

Absolute Risk Reduction is the difference in event rates between the control group ( C E R CER CER ) and the experimental group ( E E R EER EER ). A R R = C E R − E E R ARR = CER - EER A RR = CER − EER N N T = 1 A R R = 1 C E R − E E R NNT = \frac{1}{ARR} = \frac{1}{CER - EER} NNT = A RR 1 ​ = CER − EER 1 ​

Interpretation: NNT is the number of patients that must receive a specific treatment for one patient to achieve the desired outcome (e.g., symptom remission) who would not have achieved it otherwise.

Target Value: Lower NNT values indicate higher clinical efficacy. An NNT < 5 < 5 < 5 is considered clinically robust in psychopharmacology.

Absolute Risk Increase (ARI) & NNH

Absolute Risk Increase is the excess risk of an adverse event in the treatment group compared to control. A R I = E E R adverse − C E R adverse ARI = EER_{\text{adverse}} - CER_{\text{adverse}} A R I = EE R adverse ​ − CE R adverse ​ N N H = 1 A R I = 1 E E R adverse − C E R adverse NNH = \frac{1}{ARI} = \frac{1}{EER_{\text{adverse}} - CER_{\text{adverse}}} NN H = A R I 1 ​ = EE R adverse ​ − CE R adverse ​ 1 ​

Interpretation: NNH is the number of patients treated for one patient to experience a specific adverse event .

Target Value: Higher NNH values indicate a safer medication. An NNH of 100 means only 1 out of 100 treated patients experiences the side effect.

Clinical Calculation Example

Trial Data: In a 12-week placebo-controlled trial of a novel atypical antipsychotic for acute bipolar mania:

Mania Remission Rate: Drug Group = 50% ( 0.50 0.50 0.50 ), Placebo Group = 30% ( 0.30 0.30 0.30 ).

Severe Weight Gain Rate (>7% body weight): Drug Group = 15% ( 0.15 0.15 0.15 ), Placebo Group = 5% ( 0.05 0.05 0.05 ).

Calculations:

  • A R R = 0.50 − 0.30 = 0.20 ARR = 0.50 - 0.30 = 0.20 A RR = 0.50 − 0.30 = 0.20 (20% reduction)
  • N N T = 1 0.20 = 5 NNT = \frac{1}{0.20} = 5 NNT = 0.20 1 ​ = 5
  • A R I = 0.15 − 0.05 = 0.10 ARI = 0.15 - 0.05 = 0.10 A R I = 0.15 − 0.05 = 0.10 (10% increase)
  • N N H = 1 0.10 = 10 NNH = \frac{1}{0.10} = 10 NN H = 0.10 1 ​ = 10

Clinical Interpretation: The PMHNP must treat 5 patients with the drug for 1 patient to achieve mania remission who would not have remitted on placebo. However, for every 10 patients treated, 1 patient will develop severe weight gain directly due to the drug.

Loading diagram... Evidence Appraisal and Translation Process