Study guide
9.1 Fundamentals of Hypothesis Testing: Null vs. Alternative, Alpha & Beta Risks
CSSC Certified Six Sigma Green Belt Exam
Track your progress as you read
Finished sections get a check mark.
1 Chapter 1: Six Sigma Overview & Exam Fundamentals
1.1 CSSC Certification Overview, Exam Structure & Body of Knowledge 1.2 History & Evolution of Six Sigma 1.3 Six Sigma Organizational Roles & Belts Hierarchy 1.4 The DMAIC Methodology Architecture vs. DMADV / DFSS 1.5 Other Process Improvement & Quality Methods, and When to Choose Six Sigma
2 Chapter 2: Quality Fundamentals & Defect Metrics
2.1 Critical to Quality (CTQ) Characteristics & VOC Translation 2.2 Defect Metrics: DPU, DPO, DPMO, & the 1.5-Sigma Shift 2.3 First Time Yield (FTY) & Rolled Throughput Yield (RTY) 2.4 Cost of Quality (COQ) & Cost of Poor Quality (COPQ)
3 Chapter 3: Lean Principles & Waste Elimination
3.1 Foundations of Lean & The Toyota Production System (TPS) 3.2 The Eight Wastes: CSSC's Seven Muda, TIMWOODS, and Muri/Mura 3.3 The 5S Visual Workplace Methodology 3.4 Value Stream Mapping (VSM), Cycle Time & Takt Time
4 Chapter 4: Project Selection & Team Management
4.1 Six Sigma Project Selection & Business Case Development 4.2 Project Charter Architecture 4.3 Stakeholder Management & Communication Planning 4.4 Team Dynamics & Tuckman's Team Development Stages 4.5 The 15-Point Project Viability Model & Process-Level Selection
5 Chapter 5: Define Phase & Process Mapping
5.1 High-Level Process Mapping with SIPOC 5.2 Flowcharts, Swimlane Diagrams & Process Value Analysis 5.3 Quality Function Deployment (QFD) & The House of Quality 5.4 Critical to Quality (CTQ) Flowdown & Operational Definitions 5.5 The CSSC Define Toolset: Ground Rules, In/Out of the Box, Is–Is Not & Tollgate Checklists
6 Chapter 6: Measure Phase & Measurement Systems
6.1 Data Types: Continuous (Variable) vs. Discrete (Attribute) Data 6.2 Data Collection Planning & Sampling Strategies 6.3 Measurement System Analysis (MSA) Foundations & Calibration 6.4 Variable & Attribute Gage R&R Studies
7 Chapter 7: Analyze Phase & Root Cause Analysis
7.1 Qualitative Root Cause Tools: 5 Whys & Cause-and-Effect (Fishbone) Diagrams 7.2 Failure Mode and Effects Analysis (FMEA) & RPN Calculation 7.3 Pareto Analysis & The 80/20 Rule 7.4 Graphical Data Exploration: Histograms, Box Plots, & Multi-Vari Charts 7.5 The Root Cause Verification Matrix
8 Chapter 8: Descriptive Statistics & Distributions
8.1 Measures of Central Tendency & Dispersion 8.2 The Normal Distribution & The Empirical Rule (68-95-99.7) 8.3 Standard Normal Distribution, Z-Scores & Probability Calculations 8.4 Common Non-Normal Distributions: Binomial, Poisson & Chi-Square
9 Chapter 9: Inferential Statistics & Hypothesis Testing
9.1 Fundamentals of Hypothesis Testing: Null vs. Alternative, Alpha & Beta Risks 9.2 One-Sample and Two-Sample t-Tests for Means 9.3 Paired t-Tests & Non-Parametric Alternatives 9.4 Analysis of Variance (One-Way & Two-Way ANOVA) & Chi-Square Contingency Tests 9.5 Sample Size Determination for Hypothesis Tests
10 Chapter 10: Correlation, Regression, & Experimentation
10.1 Linear Correlation & Pearson's Correlation Coefficient (r) 10.2 Simple Linear Regression & Coefficient of Determination (R^2) 10.3 Introduction to Design of Experiments (DOE) & Factorial Designs 10.4 Analyzing Experimental Results: Main Effects & Interaction Plots
11 Chapter 11: Improve Phase & Solution Implementation
11.1 Brainstorming, Creative Thinking & Solution Selection Matrices 11.2 Piloting Solutions & Conducting Risk Assessments 11.3 Implementation Planning & Change Management (ADKAR) 11.4 Mistake-Proofing (Poka-Yoke) & Standard Work
12 Chapter 12: Control Phase, SPC, & Process Capability
12.1 Statistical Process Control (SPC) & Shewhart Control Rules 12.2 Variable Control Charts: I-MR, X-bar & R, X-bar & S 12.3 Attribute Control Charts: p, np, c, and u Charts 12.4 Process Capability & Performance Indices: Cp, Cpk, Pp, Ppk 12.5 Communicating Statistical Results to Business Audiences
9.1 Fundamentals of Hypothesis Testing: Null vs. Alternative, Alpha & Beta Risks
Key Takeaways Explain This Topic AI
Hypothesis testing provides an objective, probabilistic decision framework that evaluates whether observed process differences are statistically significant or merely attributable to random sampling noise, operating under the legal presumption of the null hypothesis (H0 presumed true).
The Null Hypothesis (H0) represents the status quo or baseline of no effect and must always contain mathematical equality (=, ≤, ≥), whereas the Alternative Hypothesis (Ha) represents the experimental claim of difference and strictly utilizes inequalities (≠, >, <).
A Type I Error (α / Producer's Risk) occurs when a true null hypothesis is rejected (false alarm), while a Type II Error (β / Consumer's Risk) occurs when a false null hypothesis fails to be rejected (missed opportunity or defect escape).
Statistical Power (1 - β) is the probability of correctly detecting and rejecting a false null hypothesis; power is maximized by increasing sample size n, increasing effect size δ, raising α, and reducing process noise σ.
The p-value decision rule dictates that if p ≤ α, reject H0 ('if p is low, H0 must go'); Green Belts must always distinguish statistical significance from practical, operational, and economic significance.
Last updated: September 2026
9.1 Fundamentals of Hypothesis Testing: Null vs. Alternative, Alpha & Beta Risks
Quick Summary: In the Analyze and Improve phases of DMAIC, Six Sigma continuous improvement teams must prove whether an observed change in process performance or a difference between operational groups ( X X X ) is genuine or merely an artifact of random sampling noise. Hypothesis testing provides an objective, mathematical protocol for making this decision. Mirroring a courtroom trial, the Null Hypothesis ( H 0 H_0 H 0 ) is presumed true (representing equality, the baseline, or the status quo) until empirical sample evidence proves beyond a reasonable doubt that the Alternative Hypothesis ( H a H_a H a ) holds. Practitioners manage two critical operational failure modes: Type I Error ( α \alpha α , Producer's Risk, false alarms) and Type II Error ( β \beta β , Consumer's Risk, missed defects), while maximizing Statistical Power ( 1 − β 1 - \beta 1 − β ).
The Role of Hypothesis Testing in the DMAIC Framework
During the Measure phase, Green Belts collect baseline data and calculate descriptive statistics—such as sample means ( x ˉ \bar{x} x ˉ ), sample standard deviations ( s s s ), and defect counts. However, descriptive statistics describe only the immediate sample units measured; they cannot confirm whether an observed improvement represents a permanent, systemic shift in the population or merely temporary luck.
Consider an industrial plastics extrusion line where baseline scrap rate averages 8.0 % 8.0\% 8.0% . A project team implements an optimized barrel heating profile on Tuesday, and scrap drops to 6.2 % 6.2\% 6.2% over a sample of 200 parts. Two competing explanations exist:
Random Sampling Noise: The heating profile had zero physical effect, and the apparent reduction from 8.0 % 8.0\% 8.0% to 6.2 % 6.2\% 6.2% was simply fortunate random variation.
True Systemic Shift: The heating profile produced a statistically significant reduction in scrap rate that will persist across future production.
Hypothesis testing provides the quantitative mechanism to adjudicate between these two explanations, preventing teams from spending capital on ineffective solutions or discarding breakthrough improvements.
The Courtroom Analogy of Hypothesis Testing
The fundamental logic of statistical hypothesis testing directly mirrors the Anglo-American criminal justice system: The Courtroom Analogy
- CRIMINAL TRIAL STATISTICAL HYPOTHESIS TEST
- ┌─────────────────────────────────┐ ┌─────────────────────────────────┐
- │ Defendant is presumed innocent │ ──▶ │ Null Hypothesis (H0) presumed │
- │ until proven guilty. │ │ true (no effect, no difference).│
- ├─────────────────────────────────┤ ├─────────────────────────────────┤
- │ Prosecution carries burden of │ ──▶ │ Six Sigma team carries burden of│
- │ producing evidence. │ │ collecting empirical data. │
- ├─────────────────────────────────┤ ├─────────────────────────────────┤
- │ Standard: Beyond a reasonable │ ──▶ │ Significance Level (α = 0.05): │
- │ doubt. │ │ Less than 5% probability by luck│
- ├─────────────────────────────────┤ ├─────────────────────────────────┤
- │ Verdict: 'Guilty' or │ ──▶ │ Decision: 'Reject H0' or │
- │ 'Not Guilty' (Never 'Innocent') │ │ 'Fail to Reject H0' │
- └─────────────────────────────────┘ └─────────────────────────────────┘
- Why We Never "Accept" the Null Hypothesis
A critical exam concept: in a court of law, when a jury delivers a verdict of "Not Guilty," they are not declaring that the defendant has been proven innocent. They are stating that the prosecution failed to produce sufficient evidence to overcome the presumption of innocence.
Similarly, in Six Sigma, a statistical test never "accepts" H 0 H_0 H 0 or proves that two populations are mathematically identical. We either:
Reject H 0 H_0 H 0 (sufficient sample evidence exists to conclude a statistically significant difference or effect), or
Fail to Reject H 0 H_0 H 0 (insufficient sample evidence exists to conclude a difference; the status quo remains unsupported by counter-evidence).
Absence of evidence is not evidence of absence. Stating "we accept the null hypothesis" on an exam is an immediate red flag. A high p p p -value simply means our sample was insufficiently powered or the effect was too small to distinguish from background variation.
Formulating Null and Alternative Hypotheses
Every statistical test requires formulating two mutually exclusive and collectively exhaustive mathematical statements:
1. The Null Hypothesis ( H 0 H_0 H 0 )
Represents the status quo , historical baseline, default assumption, or position of scientific skepticism.
Posits that there is no difference , no effect, no relationship, or that any observed disparity is purely due to random chance.
Universal Rule: H 0 H_0 H 0 must always contain the condition of equality ( = = = , ≤ \le ≤ , or ≥ \ge ≥ ).
2. The Alternative Hypothesis ( H a H_a H a or H 1 H_1 H 1 )
Represents the claim , the project objective, or the new theory that the Six Sigma team is attempting to establish with empirical data.
Posits that there is a real difference , a significant shift, or an operational effect.
Universal Rule: H a H_a H a never contains equality ; it always utilizes strict inequality ( ≠ \ne = , > > > , or < < < ).
Directionality: Two-Tailed vs. One-Tailed Tests
The formulation of H a H_a H a determines the directionality of the test and how the risk threshold ( α \alpha α ) is allocated across the sampling distribution: Two-Tailed vs. One-Tailed Tests
- TWO-TAILED (≠) ONE-TAILED (>) ONE-TAILED (<)
- Rejection in Both Tails Upper Tail Rejection Lower Tail Rejection
- α/2 α/2 α α
- ┌───┐ ┌───┐ ┌───┐ ┌───┐
- ───┴───┴─────┴───┴─── ─────────────┴───┴─── ───┴───┴─────────────
- Reject H0 Reject H0 Reject Reject H0
Test Type Null Hypothesis ( H 0 H_0 H 0 ) Alternative Hypothesis ( H a H_a H a ) Rejection Region Practical Application
Two-Tailed (Non-directional) H 0 : μ = μ 0 H_0: \mu = \mu_0 H 0 : μ = μ 0 H a : μ ≠ μ 0 H_a: \mu \ne \mu_0 H a : μ = μ 0 Split equally: α / 2 \alpha / 2 α /2 in both tails Verifying if a precision CNC lathe calibration has drifted either too high or too low.
One-Tailed Upper (Right-tailed) H 0 : μ ≤ μ 0 H_0: \mu \le \mu_0 H 0 : μ ≤ μ 0 H a : μ > μ 0 H_a: \mu > \mu_0 H a : μ > μ 0 Entire α \alpha α in upper (right) tail Testing if a new resin curing catalyst increases tensile strength beyond specification.
One-Tailed Lower (Left-tailed) H 0 : μ ≥ μ 0 H_0: \mu \ge \mu_0 H 0 : μ ≥ μ 0 H a : μ < μ 0 H_a: \mu < \mu_0 H a : μ < μ 0 Entire α \alpha α in lower (left) tail Testing if a Lean kaizen project reduced customer waiting time below the historical baseline.
Exam Tip: One-tailed tests have greater statistical power to detect a difference in the specified direction because the entire α \alpha α risk is concentrated in a single tail. However, if the process actually shifts in the opposite direction, a one-tailed test cannot detect it. Use two-tailed tests unless there is a clear, directional operational rationale.
The Decision Matrix: Type I and Type II Errors
Whenever a statistical decision is made based on sample data, there is a risk of error due to sampling variation. The interaction between Reality (the true state of nature) and the Statistical Decision produces a 2 × 2 2 \times 2 2 × 2 decision matrix: The 2x2 Decision Matrix
- ACTUAL PROCESS REALITY
- H0 is TRUE H0 is FALSE
- (No Real Difference) (Real Difference Exists)
- ┌───────────────────────────┬───────────────────────────┐
- FAIL TO REJECT H0 │ CORRECT DECISION │ TYPE II ERROR │
- (Claim No Difference) │ Confidence (1 - α) │ Consumer's Risk (β) │
- STATISTICAL │ True negative (OK) │ False negative (Miss) │
- DECISION ├───────────────────────────┼───────────────────────────┤
- REJECT H0 │ TYPE I ERROR │ CORRECT DECISION │
- (Claim Difference) │ Producer's Risk (α) │ Statistical Power │
- │ False positive (Alarm) │ (1 - β) │
- └───────────────────────────┴───────────────────────────┘
- Deep Dive: Type I Error ( α \alpha α / Producer's Risk)
Definition : Rejecting the null hypothesis when H 0 H_0 H 0 is actually true.
Colloquial Term : False Alarm or False Positive.
Symbol : α \alpha α (alpha), also called the Significance Level .
Operational Meaning (Producer's Risk) : In quality engineering, H 0 H_0 H 0 typically represents "the manufactured lot meets specifications." If testing mistakenly rejects this conforming lot, the producer suffers the financial loss of needlessly scrapping, reworking, or re-inspecting perfectly acceptable product.
Standard Industry Benchmark : α \alpha α is conventionally set at 0.05 0.05 0.05 ( 5 % 5\% 5% ), meaning practitioners accept a 1-in-20 chance of a false alarm.
Deep Dive: Type II Error ( β \beta β / Consumer's Risk)
Definition : Failing to reject the null hypothesis when H 0 H_0 H 0 is actually false.
Colloquial Term : Missed Detection or False Negative.
Symbol : β \beta β (beta).
Operational Meaning (Consumer's Risk) : If a manufactured lot is severely defective ( H 0 H_0 H 0 is false), but the sample test fails to detect the defect and passes the lot, the defective product ships to the consumer . The consumer experiences product failure, safety risks, or warranty downtime.
Standard Industry Benchmark : β \beta β is conventionally targeted between 0.10 0.10 0.10 and 0.20 0.20 0.20 ( 10 % 10\% 10% to 20 % 20\% 20% ).
The Inverse Tradeoff Between α \alpha α and β \beta β
For any fixed sample size n n n , α \alpha α and β \beta β are inversely related :
If you lower α \alpha α (e.g., from 0.05 0.05 0.05 to 0.01 0.01 0.01 to avoid false alarms), you make it harder to reject H 0 H_0 H 0 . Consequently, you increase β \beta β (making it easier to miss real differences).
If you lower β \beta β (to avoid missing defects), you widen the rejection region, which inflates α \alpha α .
Fundamental Rule: The only mathematical way to reduce both α \alpha α and β \beta β simultaneously is to increase sample size ( n n n ) .
Statistical Power ( 1 − β 1 - \beta 1 − β )
Statistical Power ( 1 − β 1 - \beta 1 − β ) is the probability of correctly rejecting the null hypothesis when a true difference or effect exists. It quantifies the test's sensitivity in detecting a real operational change.
In Six Sigma, the standard target for statistical power is at least 0.80 0.80 0.80 (80%) , with 0.90 0.90 0.90 (90%) preferred for safety-critical processes.
If a test has only 50 % 50\% 50% power, conducting the experiment is equivalent to flipping a coin to detect a vital engineering breakthrough.
The Four Levers of Statistical Power The Four Levers of Statistical Power
- LEVER DIRECTION OF LEVER EFFECT ON POWER (1 - β)
- ┌─────────────────────┬───────────────────────────────┬─────────────────────────┐
- │ 1. Sample Size (n) │ Increase n (e.g., 20 ──▶ 80) │ POWER INCREASES (▲▲▲) │
- │ 2. Effect Size (δ) │ Larger difference (|μ1 - μ2|) │ POWER INCREASES (▲▲▲) │
- │ 3. Alpha Level (α) │ Increase α (e.g., 0.01 ──▶0.05)│ POWER INCREASES (▲) │
- │ 4. Process Noise (σ)│ Decrease process variability │ POWER INCREASES (▲▲) │
- └─────────────────────┴───────────────────────────────┴─────────────────────────┘
Sample Size ( n n n ) : As n n n increases, Standard Error ( S E = σ / n SE = \sigma / \sqrt{n} SE = σ / n ) contracts, narrowing the sampling distributions and dramatically reducing overlap between H 0 H_0 H 0 and H a H_a H a .
Effect Size ( δ = ∣ μ − μ 0 ∣ \delta = |\mu - \mu_0| δ = ∣ μ − μ 0 ∣ ) : Detecting a massive shift (e.g., cutting defect rates by 80 % 80\% 80% ) requires far less statistical power than detecting a subtle 2 % 2\% 2% shift.
Significance Level ( α \alpha α ) : Setting α = 0.10 \alpha = 0.10 α = 0.10 makes rejecting H 0 H_0 H 0 easier than setting α = 0.01 \alpha = 0.01 α = 0.01 , increasing power (at the expense of higher false alarm risk).
Process Standard Deviation ( σ \sigma σ ) : Reducing measurement noise and extraneous process variation sharpens the signal-to-noise ratio, raising power without requiring larger samples.
The P-Value Decision Rule
The p p p -value (probability value) is the most widely utilized metric in computer-generated statistical output (Minitab, JMP, Python).
Formal Definition of P-Value
The p p p -value is the exact probability of obtaining a test statistic at least as extreme as the one observed in the sample data, assuming that the null hypothesis ( H 0 H_0 H 0 ) is strictly true .
The Universal Decision Rule
To make a statistical decision, compare the software-calculated p p p -value directly against the pre-determined significance level α \alpha α (typically α = 0.05 \alpha = 0.05 α = 0.05 ): If p ≤ α ⟹ R e j e c t H 0 ( Statistically Significant Difference ) \text{If } p \le \alpha \implies \mathbf{Reject\ H_0} \quad (\text{Statistically Significant Difference}) If p ≤ α ⟹ Reject H 0 ( Statistically Significant Difference ) If p > α ⟹ F a i l t o R e j e c t H 0 ( Insufficient Evidence of Difference ) \text{If } p > \alpha \implies \mathbf{Fail\ to\ Reject\ H_0} \quad (\text{Insufficient Evidence of Difference}) If p > α ⟹ Fail to Reject H 0 ( Insufficient Evidence of Difference ) The P-Value Decision Spectrum
- 0.000 α = 0.05 1.000
- ├───┼───────────────────────────────┼───────────────────────────────┤
- │◀─── REJECT H0 ───────────────────▶│◀────── FAIL TO REJECT H0 ────▶│
- │ Statistically Significant │ Not Statistically Significant│
- │ 'If p is low, H0 must go!' │ 'If p is high, H0 flies!' │
Example A: A t t t -test yields p = 0.012 p = 0.012 p = 0.012 . Since 0.012 ≤ 0.05 0.012 \le 0.05 0.012 ≤ 0.05 , Reject H 0 H_0 H 0 . Conclude there is a statistically significant difference.
Example B: An ANOVA test yields p = 0.284 p = 0.284 p = 0.284 . Since 0.284 > 0.05 0.284 > 0.05 0.284 > 0.05 , Fail to Reject H 0 H_0 H 0 . The observed differences are readily explainable by normal random variation.
Practical Significance vs. Statistical Significance
A critical hallmark of an effective Green Belt is the ability to distinguish statistical significance from practical (engineering) significance .
Statistical Significance simply means that an observed difference is unlikely to have occurred by random sampling chance at a specified α \alpha α level ( p ≤ α p \le \alpha p ≤ α ).
Practical Significance asks: Does the magnitude of this difference matter to the business, customer, or bottom line?
The Dual Perils of Sample Size Distortion Sample Size Distortions in Hypothesis Testing
- MASSIVE SAMPLES (n = 100,000) TINY SAMPLES (n = 5)
- ┌─────────────────────────────────────┐ ┌─────────────────────────────────────┐
- │ • Microscopic differences │ │ • Massive, commercially vital shifts│
- │ (e.g., 0.001 sec cycle time) │ │ (e.g., 15% scrap reduction) │
- │ • Yields p < 0.0001 │ │ • Yields p = 0.12 > 0.05 │
- │ • STATISTICALLY SIGNIFICANT, │ │ • PRACTICALLY VITAL, │
- │ BUT PRACTICALLY USELESS. │ │ BUT STATISTICALLY UNDERPOWERED. │
- └─────────────────────────────────────┘ └─────────────────────────────────────┘
The Large-Sample Trap ( p p p -Value Manipulation) : With enormous sample sizes ( n = 500 , 000 n = 500,000 n = 500 , 000 ), standard error approaches zero. As a result, the test will flag trivial, irrelevant deviations (e.g., a 0.02 % 0.02\% 0.02% change in paint gloss) as "statistically significant" ( p < 0.0001 p < 0.0001 p < 0.0001 ). An organization could waste millions implementing a fix that delivers zero economic value.
The Small-Sample Trap (Underpowered Tests) : When sample sizes are too small ( n = 6 n = 6 n = 6 ), standard error is wide and power is abysmally low ( 1 − β < 0.30 1 - \beta < 0.30 1 − β < 0.30 ). A breakthrough process improvement that slashes cycle time by 20 % 20\% 20% might yield p = 0.14 p = 0.14 p = 0.14 . Inexperienced teams would declare "no difference" and abandon a viable multimillion-dollar improvement.
Step-by-Step Worked Calculation: Sample Size for Power
Problem: A quality engineering team at an automated packaging facility wants to determine whether a newly designed sealing element reduces seal defect rates. Historical seal leak rate is p 0 = 0.10 p_0 = 0.10 p 0 = 0.10 ( 10 % 10\% 10% ). The team wants to detect a reduction to p 1 = 0.05 p_1 = 0.05 p 1 = 0.05 ( 5 % 5\% 5% ) with a significance level of α = 0.05 \alpha = 0.05 α = 0.05 and a statistical power of 1 − β = 0.90 1 - \beta = 0.90 1 − β = 0.90 ( β = 0.10 \beta = 0.10 β = 0.10 ).
For a two-sample or one-sample proportion test, the required sample size formula is: n = ( Z α p 0 ( 1 − p 0 ) + Z β p 1 ( 1 − p 1 ) p 0 − p 1 ) 2 n = \left( \frac{Z_{\alpha} \sqrt{p_0(1-p_0)} + Z_{\beta} \sqrt{p_1(1-p_1)}}{p_0 - p_1} \right)^2 n = ( p 0 − p 1 Z α p 0 ( 1 − p 0 ) + Z β p 1 ( 1 − p 1 ) ) 2
Step 1: Identify critical Z Z Z -values
For a one-tailed test at α = 0.05 \alpha = 0.05 α = 0.05 , Z α = 1.645 Z_{\alpha} = 1.645 Z α = 1.645 .
For power 1 − β = 0.90 1 - \beta = 0.90 1 − β = 0.90 ( β = 0.10 \beta = 0.10 β = 0.10 ), Z β = 1.282 Z_{\beta} = 1.282 Z β = 1.282 .
Step 2: Evaluate components
p 0 ( 1 − p 0 ) = 0.10 × 0.90 = 0.09 = 0.30 \sqrt{p_0(1-p_0)} = \sqrt{0.10 \times 0.90} = \sqrt{0.09} = 0.30 p 0 ( 1 − p 0 ) = 0.10 × 0.90 = 0.09 = 0.30
p 1 ( 1 − p 1 ) = 0.05 × 0.95 = 0.0475 ≈ 0.2179 \sqrt{p_1(1-p_1)} = \sqrt{0.05 \times 0.95} = \sqrt{0.0475} \approx 0.2179 p 1 ( 1 − p 1 ) = 0.05 × 0.95 = 0.0475 ≈ 0.2179
Difference: δ = p 0 − p 1 = 0.10 − 0.05 = 0.05 \delta = p_0 - p_1 = 0.10 - 0.05 = 0.05 δ = p 0 − p 1 = 0.10 − 0.05 = 0.05
Step 3: Compute numerator
Numerator = ( 1.645 × 0.30 ) + ( 1.282 × 0.2179 ) = 0.4935 + 0.2793 = 0.7728 \text{Numerator} = (1.645 \times 0.30) + (1.282 \times 0.2179) = 0.4935 + 0.2793 = 0.7728 Numerator = ( 1.645 × 0.30 ) + ( 1.282 × 0.2179 ) = 0.4935 + 0.2793 = 0.7728
Step 4: Compute sample size
n = ( 0.7728 0.05 ) 2 = ( 15.456 ) 2 ≈ 238.9 n = \left( \frac{0.7728}{0.05} \right)^2 = (15.456)^2 \approx 238.9 n = ( 0.05 0.7728 ) 2 = ( 15.456 ) 2 ≈ 238.9
Rounding up: n = 239 n = 239 n = 239 units per group are required to achieve 90 % 90\% 90% power.
If the team had sampled only n = 50 n = 50 n = 50 units, power would drop below 35 % 35\% 35% , leading to a high probability of committing a Type II error (falsely concluding the new seal does not help).
Critical CSSC Exam Traps
Trap 1: Stating We "Accept" the Null Hypothesis — When p > α p > \alpha p > α , the correct verdict is always Fail to Reject H 0 H_0 H 0 . We never prove H 0 H_0 H 0 true; we merely find insufficient evidence to overthrow it.
Trap 2: Placing Equality in the Alternative Hypothesis — H a H_a H a must always be strict inequality ( ≠ , > , < \ne, >, < = , > , < ). Any formulation with ≤ \le ≤ or ≥ \ge ≥ in H a H_a H a is automatically incorrect.
Trap 3: Believing p p p -Value is the Probability H 0 H_0 H 0 is True — The p p p -value is P ( Data ∣ H 0 is True ) P(\text{Data} \mid H_0 \text{ is True}) P ( Data ∣ H 0 is True ) , NOT P ( H 0 is True ∣ Data ) P(H_0 \text{ is True} \mid \text{Data}) P ( H 0 is True ∣ Data ) . It assumes H 0 H_0 H 0 is completely true from the start.
Trap 4: Confusing Producer's Risk ( α \alpha α ) with Consumer's Risk ( β \beta β ) — Producer's risk is the false alarm (rejecting good product). Consumer's risk is the missed defect (accepting bad product and shipping it to the customer).