Study guide
7.4 Hypothesis Testing Terminology, Errors, and Single-Sample Tests
ASQ Certified Six Sigma Black Belt CSSBB
Track your progress as you read
Finished sections get a check mark.
1 Chapter 1: Introduction & CSSBB Exam Strategy
1.1 CSSBB Exam Format, Scoring, and Testing Windows 1.2 Eligibility, Project Affidavits, Application, and Recertification 1.3 Open-Book Strategy, Reference Materials, and a 16-Week Study Plan
2 Chapter 2: Organization-Wide Planning and Deployment
2.1 Fundamentals of Six Sigma and Lean Methodologies 2.2 Selecting the Right Methodology: DMAIC, DFSS, and Lean 2.3 Business Systems, Processes, and Stakeholder Relationships 2.4 Strategic Planning and Deployment of Six Sigma Initiatives 2.5 Six Sigma Roles and Responsibilities 2.6 Organizational Barriers and Common Causes of Six Sigma Failure 2.7 Change Management: Stakeholder Analysis, Readiness, and Communication
3 Chapter 3: Organizational Process Management and Measures
3.1 Impact of Six Sigma Projects on Customers, Suppliers, and Stakeholders 3.2 Benchmarking Types and Performance Goal Setting 3.3 Performance Measures: Balanced Scorecard, KPIs, KBIs, OKRs, and Line of Sight 3.4 Leading and Lagging Indicators and Performance Dashboards 3.5 Financial Measures: Revenue Growth, Margin, NPV, ROI, and Cost-Benefit Analysis 3.6 Cost of Poor Quality and Hard versus Soft Savings
4 Chapter 4: Team Management
4.1 Team Types and Constraints 4.2 Team Roles, Responsibilities, and Member Selection 4.3 Team Success Factors and Ground Rules 4.4 Motivational Techniques and Overcoming Demotivators 4.5 Stages of Team Development and Conflict Resolution 4.6 Team Communication Plans 4.7 Team Leadership Models: Direct, Coach, Support, and Delegate 4.8 Group Behaviors, Conflict Resolution, and Meeting Management 4.9 Facilitation Techniques and Team Decision-Making Methods 4.10 Team Training: Needs Assessment, Delivery, and Evaluation
5 Chapter 5: Define Phase
5.1 Customer Identification and Segmentation 5.2 Customer Data Collection: Methods, Validity, and Reliability 5.3 Customer Requirements: CTX, CTQ Trees, and Operational Definitions 5.4 The Kano Model and Quality Function Deployment 5.5 SIPOC and Process Mapping 5.6 Business Case Justification 5.7 The Project Charter and the Problem Statement 5.8 Project Scope and Boundaries 5.9 SMART Goals and Project Performance Measurements 5.10 Project Charter Reviews and Toll-Gate Governance 5.11 Project Management Tools: Gantt Charts, Toll-Gate Reviews, WBS, and RACI 5.12 Analytical Tools Used Throughout the DMAIC Cycle
6 Chapter 6: Measure Phase
6.1 Process Flow Metrics and the Hidden Factory 6.2 Process Analysis Tools and Value Stream Mapping 6.3 Types of Data and Measurement Scales 6.4 Sampling Concepts, Methods, and Sample Size for Estimation 6.5 Data Collection Plans and Common Pitfalls 6.6 Gage R&R for Variable Measurement Systems 6.7 Attribute Agreement Analysis and Audit MSA 6.8 Measurement Systems Across the Organization, and Metrology 6.9 Population Parameters, Sample Statistics, and Valid Statistical Conclusions 6.10 Descriptive Statistics: Central Tendency, Dispersion, and Shape 6.11 Graphical Methods for Exploratory Data Analysis 6.12 Probability Concepts, Common Distributions, and the Central Limit Theorem 6.13 Additional Distributions: Hypergeometric, Exponential, Lognormal, Weibull, and Bivariate 6.14 Process Capability and Performance Indices 6.15 Capability Studies, Attributes Capability, Yield Metrics, and Long-Term Capability
7 Chapter 7: Analyze Phase
7.1 The Correlation Coefficient, Its Confidence Interval, and Causation 7.2 Linear Regression and Residual Analysis 7.3 Multivariate Tools: Factor Analysis, Discriminant Analysis, and MANOVA 7.4 Hypothesis Testing Terminology, Errors, and Single-Sample Tests 7.5 Statistical Versus Practical Significance 7.6 Sample Size for Hypothesis Tests 7.7 Point Estimates, Confidence, Prediction, and Tolerance Intervals 7.8 Tests for Means, Variances, and Proportions 7.9 Analysis of Variance 7.10 Chi-Square Goodness-of-Fit and Tests of Independence 7.11 Types of Risk and Failure Mode and Effects Analysis 7.12 Gap Analysis and Root Cause Analysis 7.13 Waste Analysis: The Seven Classic Wastes and Resource Under-Utilization
8 Chapter 8: Improve Phase
8.1 Design of Experiments: Objectives, Terminology, and Effects 8.2 DOE Design Principles: Randomization, Blocking, Replication, and Resolution 8.3 Planning and Evaluating Designed Experiments 8.4 One-Factor Experiments: Completely Randomized, Randomized Block, and Latin Square Designs 8.5 Full Factorial Experiments and Design Selection 8.6 Two-Level Fractional Factorial Experiments and Confounding 8.7 Response Surface Methodology and Optimization 8.8 Waste Elimination: Pull Systems, Kanban, 5S, and Poka-Yoke 8.9 Cycle-Time Reduction: Continuous Flow, SMED, and Heijunka 8.10 Kaizen, Kaizen Blitz, Theory of Constraints, and OEE 8.11 Implementation Planning, Piloting, and Solution Selection
9 Chapter 9: Control Phase
9.1 SPC Objectives, Variable Selection, and Rational Subgrouping 9.2 Control Charts for Variables Data 9.3 Control Charts for Attributes Data 9.4 Short-Run SPC and Moving Average Charts 9.5 Control Chart Analysis: Common Cause, Special Cause, and Run Rules 9.6 Total Productive Maintenance and Visual Controls 9.7 Measurement System Reanalysis 9.8 Control Plan Development and Process Owner Handoff 9.9 Lessons Learned, Documentation, and Training for Sustainment 9.10 Ongoing Evaluation of the Improved Process
10 Chapter 10: Design for Six Sigma (DFSS)
10.1 DFSS Frameworks: DMADV, DMADOV, and Design Transfer 10.2 Design for X (DFX) 10.3 Robust Design, Parameter Design, and Verification 10.4 Tolerance Design and Statistical Tolerancing
7.4 Hypothesis Testing Terminology, Errors, and Single-Sample Tests
Key Takeaways Explain This Topic AI
Type I error (alpha, producer's risk) is the probability of incorrectly rejecting a true null hypothesis, whereas Type II error (beta, consumer's risk) is failing to reject a false null hypothesis.
Statistical Power (1 - beta) is the probability of correctly detecting a true effect; power increases with larger sample size n, larger effect size delta, higher alpha, and lower variability sigma.
The p-value decision rule states: if p-value <= alpha, reject H0 (statistically significant); if p-value > alpha, fail to reject H0.
A 1-sample z-test requires known population standard deviation sigma, whereas a 1-sample t-test uses sample standard deviation s with df = n - 1 degrees of freedom.
1-proportion z-tests evaluate binomial success rates assuming sample size validity conditions n p0 >= 5 and n (1-p0) >= 5 are met.
Last updated: August 2026
Hypothesis testing provides a rigorous, objective framework for making data-driven statistical decisions in the Analyze phase. It allows Six Sigma Black Belts to determine whether observed differences between process parameters (means, variances, proportions) and target benchmarks represent genuine physical effects or merely random sampling variation.
- Fundamentals of Hypothesis Testing
- The 7-Step Hypothesis Testing Roadmap
State the Operational Problem : Define the business question in clear process terms.
Formulate Null ( H 0 H_0 H 0 ) and Alternative ( H a H_a H a ) Hypotheses : Express the question mathematically.
Select Significance Level ( α \alpha α ) : Define acceptable Type I risk (typically α = 0.05 \alpha = 0.05 α = 0.05 ).
Check Statistical Assumptions : Confirm data type, independence, stability, and normality.
Calculate Sample Size & Statistical Power : Ensure n n n is sufficient to detect target effect δ \delta δ .
Compute Test Statistic & p p p -Value : Execute mathematical test formula on sample data.
State Statistical & Operational Conclusion : Compare p p p -value against α \alpha α and translate into business action.
Null ( H 0 H_0 H 0 ) vs. Alternative ( H a H_a H a ) Hypotheses
Null Hypothesis ( H 0 H_0 H 0 ) : The default baseline statement of "no effect," "no difference," or "status quo." It always contains an equality sign ( = , ≤ , ≥ =, \le, \ge = , ≤ , ≥ ).
Alternative Hypothesis ( H a H_a H a or H 1 H_1 H 1 ) : The research hypothesis the Black Belt seeks to prove (e.g., "the process mean has changed" or "new tooling reduces cycle time"). It contains inequalities ( ≠ , < , > \neq, <, > = , < , > ).
Decision Risks & Error Matrix
Statistical decision-making carries two distinct types of decision errors:
Reality \ Decision Fail to Reject H 0 H_0 H 0 (Conclude No Difference) Reject H 0 H_0 H 0 (Conclude Difference Exists)
H 0 H_0 H 0 is True (No real effect) Correct Decision ( 1 − α 1 - \alpha 1 − α ); Confidence Level Type I Error ( α \alpha α ) ; Producer's Risk / False Positive
H 0 H_0 H 0 is False (Real effect exists) Type II Error ( β \beta β ) ; Consumer's Risk / False Negative Correct Decision ( 1 − β 1 - \beta 1 − β ) ; Statistical Power
Type I Error ( α \alpha α ) : Rejecting a true null hypothesis. The significance level α \alpha α (typically set to 0.05 0.05 0.05 or 5 % 5\% 5% ) represents the maximum allowable probability of committing a Type I error.
Type II Error ( β \beta β ) : Failing to reject a false null hypothesis when a true process difference exists.
Statistical Power ( 1 − β 1 - \beta 1 − β ) : The probability of correctly detecting a true treatment effect of size δ \delta δ . Power is typically targeted at ≥ 0.80 \ge 0.80 ≥ 0.80 ( 80 % 80\% 80% ).
Factors Influencing Statistical Power
Sample Size ( n n n ) : Increasing n n n reduces standard error ( SE = σ n \text{SE} = \frac{\sigma}{\sqrt{n}} SE = n σ ), significantly increasing power.
Effect Size ( δ = ∣ μ − μ 0 ∣ \delta = |\mu - \mu_0| δ = ∣ μ − μ 0 ∣ ) : Larger physical differences are easier to detect, yielding higher power.
Significance Level ( α \alpha α ) : Increasing α \alpha α (e.g., from 0.01 0.01 0.01 to 0.05 0.05 0.05 ) increases power but elevates Type I risk.
Process Variability ( σ \sigma σ ) : Lower process noise/variance increases statistical power.
The p p p -Value Decision Rule
The p p p -value is the exact probability of obtaining a test statistic at least as extreme as the observed sample value, assuming the null hypothesis H 0 H_0 H 0 is true.
If p p p -value ≤ α \le \alpha ≤ α : Reject H 0 H_0 H 0 . The result is statistically significant.
If p p p -value > α > \alpha > α : Fail to reject H 0 H_0 H 0 . Insufficient evidence to claim a significant effect.
Single-Sample Hypothesis Tests
Single-sample tests evaluate whether a sample parameter differs significantly from a known benchmark or target value ( μ 0 \mu_0 μ 0 , σ 0 2 \sigma_0^2 σ 0 2 , or p 0 p_0 p 0 ).
1. One-Sample z z z -Test for Mean (Known σ \sigma σ )
Used when sample data are continuous, normally distributed, and population standard deviation ( σ \sigma σ ) is known .
Test Statistic : z 0 = x ˉ − μ 0 σ n z_0 = \frac{\bar{x} - \mu_0}{\frac{\sigma}{\sqrt{n}}} z 0 = n σ x ˉ − μ 0
Critical Region (Two-Tailed at α = 0.05 \alpha = 0.05 α = 0.05 ) : Reject H 0 H_0 H 0 if ∣ z 0 ∣ > 1.96 |z_0| > 1.96 ∣ z 0 ∣ > 1.96 .
2. One-Sample t t t -Test for Mean (Unknown σ \sigma σ )
Used when population standard deviation σ \sigma σ is unknown and estimated using sample standard deviation ( s s s ).
Test Statistic : t 0 = x ˉ − μ 0 s n t_0 = \frac{\bar{x} - \mu_0}{\frac{s}{\sqrt{n}}} t 0 = n s x ˉ − μ 0
Degrees of Freedom : df = n − 1 \text{df} = n - 1 df = n − 1 .
Distribution : Student's t t t -distribution, featuring heavier tails than Z Z Z for small sample sizes, converging to Z Z Z as df → ∞ \text{df} \to \infty df → ∞ .
Worked 1-Sample t t t -Test Example
A team tests if a new injection molding machine meets a target cycle time μ 0 = 45.0 seconds \mu_0 = 45.0\text{ seconds} μ 0 = 45.0 seconds . Sample size n = 25 n = 25 n = 25 , sample mean x ˉ = 43.2 seconds \bar{x} = 43.2\text{ seconds} x ˉ = 43.2 seconds , sample standard deviation s = 4.0 seconds s = 4.0\text{ seconds} s = 4.0 seconds , α = 0.05 \alpha = 0.05 α = 0.05 .
Hypotheses: H 0 : μ = 45.0 H_0: \mu = 45.0 H 0 : μ = 45.0 vs. H a : μ ≠ 45.0 H_a: \mu \neq 45.0 H a : μ = 45.0 .
Standard Error: SE = 4.0 25 = 4.0 5 = 0.80 \text{SE} = \frac{4.0}{\sqrt{25}} = \frac{4.0}{5} = 0.80 SE = 25 4.0 = 5 4.0 = 0.80 .
Test Statistic: t 0 = 43.2 − 45.0 0.80 = − 1.80 0.80 = − 2.25 t_0 = \frac{43.2 - 45.0}{0.80} = \frac{-1.80}{0.80} = -2.25 t 0 = 0.80 43.2 − 45.0 = 0.80 − 1.80 = − 2.25 .
Critical Value ( t 0.025 , 24 t_{0.025, 24} t 0.025 , 24 ): ± 2.064 \pm 2.064 ± 2.064 .
Conclusion: Since ∣ − 2.25 ∣ > 2.064 |-2.25| > 2.064 ∣ − 2.25∣ > 2.064 ( p = 0.0338 < 0.05 p = 0.0338 < 0.05 p = 0.0338 < 0.05 ), Reject H 0 H_0 H 0 . The new machine cycle time is significantly lower than 45.0 seconds.
3. One-Sample Proportion z z z -Test
Evaluates whether a sample binomial success proportion ( p ^ = x n \hat{p} = \frac{x}{n} p ^ = n x ) differs significantly from a target baseline proportion ( p 0 p_0 p 0 ).
Test Statistic : z 0 = p ^ − p 0 p 0 ( 1 − p 0 ) n z_0 = \frac{\hat{p} - p_0}{\sqrt{\frac{p_0(1-p_0)}{n}}} z 0 = n p 0 ( 1 − p 0 ) p ^ − p 0
Validity Assumptions : n p 0 ≥ 5 n p_0 \ge 5 n p 0 ≥ 5 and n ( 1 − p 0 ) ≥ 5 n (1-p_0) \ge 5 n ( 1 − p 0 ) ≥ 5 .
4. One-Sample Chi-Square Test for Variance ( σ 2 \sigma^2 σ 2 )
Evaluates whether process variance ( s 2 s^2 s 2 ) differs from a target baseline variance ( σ 0 2 \sigma_0^2 σ 0 2 ): χ 0 2 = ( n − 1 ) s 2 σ 0 2 \chi^2_0 = \frac{(n - 1) s^2}{\sigma_0^2} χ 0 2 = σ 0 2 ( n − 1 ) s 2
Degrees of Freedom : df = n − 1 \text{df} = n - 1 df = n − 1 . Follows a Chi-Square distribution with n − 1 n-1 n − 1 degrees of freedom.
Summary of Single-Sample Test Formulas
Sample Parameter Tested Population Data Assumptions Test Statistic Formula Degrees of Freedom (df)
Mean ( μ \mu μ ), Known σ \sigma σ Continuous, Normal, Known σ \sigma σ Z 0 = x ˉ − μ 0 σ / n Z_0 = \frac{\bar{x} - \mu_0}{\sigma / \sqrt{n}} Z 0 = σ / n x ˉ − μ 0 N/A (Standard Normal)
Mean ( μ \mu μ ), Unknown σ \sigma σ Continuous, Normal, Unknown s s s t 0 = x ˉ − μ 0 s / n t_0 = \frac{\bar{x} - \mu_0}{s / \sqrt{n}} t 0 = s / n x ˉ − μ 0 df = n − 1 \text{df} = n - 1 df = n − 1
Proportion ( p p p ) Discrete Binomial ( n p 0 ≥ 5 np_0 \ge 5 n p 0 ≥ 5 ) Z 0 = p ^ − p 0 p 0 ( 1 − p 0 ) / n Z_0 = \frac{\hat{p} - p_0}{\sqrt{p_0(1-p_0)/n}} Z 0 = p 0 ( 1 − p 0 ) / n p ^ − p 0 N/A (Standard Normal)
Variance ( σ 2 \sigma^2 σ 2 ) Continuous, Normal χ 0 2 = ( n − 1 ) s 2 σ 0 2 \chi^2_0 = \frac{(n-1)s^2}{\sigma_0^2} χ 0 2 = σ 0 2 ( n − 1 ) s 2 df = n − 1 \text{df} = n - 1 df = n − 1