Study guide

9.5 Sample Size Determination for Hypothesis Tests

CSSC Certified Six Sigma Green Belt Exam

Track your progress as you read

Finished sections get a check mark.

1 Chapter 1: Six Sigma Overview & Exam Fundamentals

1.1 CSSC Certification Overview, Exam Structure & Body of Knowledge 1.2 History & Evolution of Six Sigma 1.3 Six Sigma Organizational Roles & Belts Hierarchy 1.4 The DMAIC Methodology Architecture vs. DMADV / DFSS 1.5 Other Process Improvement & Quality Methods, and When to Choose Six Sigma

2 Chapter 2: Quality Fundamentals & Defect Metrics

2.1 Critical to Quality (CTQ) Characteristics & VOC Translation 2.2 Defect Metrics: DPU, DPO, DPMO, & the 1.5-Sigma Shift 2.3 First Time Yield (FTY) & Rolled Throughput Yield (RTY) 2.4 Cost of Quality (COQ) & Cost of Poor Quality (COPQ)

3 Chapter 3: Lean Principles & Waste Elimination

3.1 Foundations of Lean & The Toyota Production System (TPS) 3.2 The Eight Wastes: CSSC's Seven Muda, TIMWOODS, and Muri/Mura 3.3 The 5S Visual Workplace Methodology 3.4 Value Stream Mapping (VSM), Cycle Time & Takt Time

4 Chapter 4: Project Selection & Team Management

4.1 Six Sigma Project Selection & Business Case Development 4.2 Project Charter Architecture 4.3 Stakeholder Management & Communication Planning 4.4 Team Dynamics & Tuckman's Team Development Stages 4.5 The 15-Point Project Viability Model & Process-Level Selection

5 Chapter 5: Define Phase & Process Mapping

5.1 High-Level Process Mapping with SIPOC 5.2 Flowcharts, Swimlane Diagrams & Process Value Analysis 5.3 Quality Function Deployment (QFD) & The House of Quality 5.4 Critical to Quality (CTQ) Flowdown & Operational Definitions 5.5 The CSSC Define Toolset: Ground Rules, In/Out of the Box, Is–Is Not & Tollgate Checklists

6 Chapter 6: Measure Phase & Measurement Systems

6.1 Data Types: Continuous (Variable) vs. Discrete (Attribute) Data 6.2 Data Collection Planning & Sampling Strategies 6.3 Measurement System Analysis (MSA) Foundations & Calibration 6.4 Variable & Attribute Gage R&R Studies

7 Chapter 7: Analyze Phase & Root Cause Analysis

7.1 Qualitative Root Cause Tools: 5 Whys & Cause-and-Effect (Fishbone) Diagrams 7.2 Failure Mode and Effects Analysis (FMEA) & RPN Calculation 7.3 Pareto Analysis & The 80/20 Rule 7.4 Graphical Data Exploration: Histograms, Box Plots, & Multi-Vari Charts 7.5 The Root Cause Verification Matrix

8 Chapter 8: Descriptive Statistics & Distributions

8.1 Measures of Central Tendency & Dispersion 8.2 The Normal Distribution & The Empirical Rule (68-95-99.7) 8.3 Standard Normal Distribution, Z-Scores & Probability Calculations 8.4 Common Non-Normal Distributions: Binomial, Poisson & Chi-Square

9 Chapter 9: Inferential Statistics & Hypothesis Testing

9.1 Fundamentals of Hypothesis Testing: Null vs. Alternative, Alpha & Beta Risks 9.2 One-Sample and Two-Sample t-Tests for Means 9.3 Paired t-Tests & Non-Parametric Alternatives 9.4 Analysis of Variance (One-Way & Two-Way ANOVA) & Chi-Square Contingency Tests 9.5 Sample Size Determination for Hypothesis Tests

10 Chapter 10: Correlation, Regression, & Experimentation

10.1 Linear Correlation & Pearson's Correlation Coefficient (r) 10.2 Simple Linear Regression & Coefficient of Determination (R^2) 10.3 Introduction to Design of Experiments (DOE) & Factorial Designs 10.4 Analyzing Experimental Results: Main Effects & Interaction Plots

11 Chapter 11: Improve Phase & Solution Implementation

11.1 Brainstorming, Creative Thinking & Solution Selection Matrices 11.2 Piloting Solutions & Conducting Risk Assessments 11.3 Implementation Planning & Change Management (ADKAR) 11.4 Mistake-Proofing (Poka-Yoke) & Standard Work

12 Chapter 12: Control Phase, SPC, & Process Capability

12.1 Statistical Process Control (SPC) & Shewhart Control Rules 12.2 Variable Control Charts: I-MR, X-bar & R, X-bar & S 12.3 Attribute Control Charts: p, np, c, and u Charts 12.4 Process Capability & Performance Indices: Cp, Cpk, Pp, Ppk 12.5 Communicating Statistical Results to Business Audiences

9.5 Sample Size Determination for Hypothesis Tests

Key Takeaways Explain This Topic AI

Sample size determination needs four inputs: alpha, beta (or power), delta (the critical difference worth detecting), and information about population variability.

CSSC's default guidelines are alpha = 0.05 and beta = 0.10 or 0.20, giving power of 0.90 or 0.80; delta is set from business need or expressed as a multiple of sigma such as 0.5, 1, or 2 sigma.

Delta must always be based on business need - the manual's test is how small a difference must be before it becomes practically insignificant to the customer.

CSSC lists nine sample size calculation methods, selected by what is being tested (means, variance, or proportions), how many data sets are involved, and how many factors act on x.

General survey sampling of an unknown population is the exception: start at alpha 0.05, beta 0.5, and delta matching a standard deviation of 1, then re-sample once the first sample reveals the population's statistics.

Last updated: September 2026

9.5 Sample Size Determination for Hypothesis Tests

Quick Summary: Sections 9.1–9.4 asked "given this sample, what can I conclude?" This section asks the question that must be answered first : "how large a sample do I need before the test is worth running?" Too small and a real improvement disappears into noise. Too large and the team burns weeks collecting data to detect differences no customer would notice. CSSC devotes an entire Body of Knowledge chapter to it, and the Measure tollgate requires that "the team has conducted appropriate sampling to allow for statistically valid conclusions in the next phase."

The Four Inputs

Every sample size calculation needs the same four pieces of information. Three are risk decisions the team makes; one is a property of the process.

Input Symbol What it is Who decides

Significance level α \alpha α Probability of a Type I error — concluding a change occurred when it did not The team, from business risk

Beta risk β \beta β Probability of a Type II error — failing to detect a change that did occur. Power = 1 − β = 1 - \beta = 1 − β The team, from business risk

Critical difference δ \delta δ (delta) The smallest difference worth detecting The team, from business need

Variability σ \sigma σ or p p p Process standard deviation, or baseline proportion for attribute data The process — from historical data or a pilot

Choosing alpha

Ask what the cost is of concluding that a statistical change occurred when it did not. In a non-manufacturing setting: are there dangers or costs associated with concluding a change occurred, and what are they?

Choosing beta

Ask what the potential cost of a Type II error is — of failing to reject a false null. CSSC's own framing is memorable: if a defective spoon is passed to the customer, the ultimate cost is minimal compared with a defective piece of medical equipment or a car engine . Also ask whether there are costs in lost time or resources from correcting a problem that arises out of a Type II error.

Choosing delta

This is where candidates lose points, because delta is a business decision dressed in statistical clothing. The manual's questions:

How small does the difference have to be before it becomes practically insignificant to the customer? The illustration is a pizza restaurant: a customer who orders a 14-inch pizza will care about receiving a 12-inch one, but is unlikely to care about 13.9 inches .

What is the smallest delta that exposes all benefits or information but is not so small as to be unfeasible? Smaller deltas mean larger sample sizes or tighter measurement requirements, and both take time to gather.

Ultimately: what margin of error is tolerable in the results? The test type, the decisions being made, and the process itself determine that.

CSSC states the rule directly: the delta, or critical difference, should always be based on business needs. It also notes that in Minitab it is helpful to express delta in terms of sigma — "we want to detect differences of 0.5 σ 0.5\sigma 0.5 σ or 2 σ 2\sigma 2 σ ."

Important

Statistical significance is not practical significance. A large enough sample will declare a 0.1 0.1 0.1 -inch pizza difference "significant." That is the machinery working correctly and the analyst asking the wrong question. Delta is the guardrail that keeps the two apart.

CSSC's Default Guidelines

Where business needs give no specific guidance, the manual publishes baseline values. Note the pattern: alpha and beta are stable across data types; only delta changes .

Situation α \alpha α β \beta β δ \delta δ

Testing means, continuous data (some population info incl. σ \sigma σ available) 0.05 0.10 or 0.20 Absolute value from business need, or as a function of σ \sigma σ ( 0.5 σ 0.5\sigma 0.5 σ , 1 σ 1\sigma 1 σ , 2 σ 2\sigma 2 σ )

Testing variance, continuous data 0.05 0.10 or 0.20 Greater than 1 , per business need, or as a function of σ \sigma σ

Testing proportions, discrete/binomial data 0.05 0.10 or 0.20 Set logically per business need, or as a function of σ \sigma σ

General survey sampling, unknown population 0.05 0.5 A proportion in keeping with a standard deviation of 1

A beta of 0.10 yields power 0.90 ; a beta of 0.20 yields power 0.80 . CSSC's note on the trade-off is exact: a power of 0.90 is less likely to produce a Type II error than a power of 0.80, but it will also require a much larger sample size in most cases .

The survey-sampling row is the odd one out and is worth memorizing precisely. General sampling on an unknown population requires a different approach : the beta of 0.5 and unit standard deviation produce an initial sample size that lets you understand the population, and additional sampling may be required based on the statistics calculated from that first sample. It is a two-stage procedure, not a one-shot calculation.

The Nine Calculation Methods

Just as there are numerous hypothesis tests for different data types and questions, there are numerous sample size calculations. CSSC lists them with selection criteria; all can be performed in Minitab under Stat > Power and Sample Size .

  • Calculation What is tested Data sets Selection cue
  • 1-Sample T Means One vs. a target value You already have sample statistics about the population

1-Sample Z Means One vs. a target You do not have sample statistics about the population (standard deviation not known)

  • 2-Sample T Means Two Comparing means from two sets of data
  • 1-Sample Variance Variance One vs. a target Comparing variance of one data set to a target
  • 2-Sample Variance Variance Two Comparing variance from two sets of data

1-Sample Proportion Proportions (rate, x per y) One vs. a target Comparing the rate of one data set to a target

  • 2-Sample Proportion Proportions (rate, x per y) Two Comparing rates from two sets of data
  • ANOVA Means More than 2 Only one factor for x
  • DOE Means More than 2 More than one factor for x

The selection logic reduces to three questions, in order: (1) Am I testing means, variance, or proportions? (2) How many data sets — one against a target, two, or more than two? (3) If more than two, how many factors act on x? One factor sends you to ANOVA; more than one sends you to DOE.

Note

A convention watch-out on 1-Sample T versus 1-Sample Z. CSSC's stated cue is reproduced above exactly as the manual gives it. Be aware that in general statistical practice the convention runs the other way: the Z test is used when the population standard deviation is known, and the t test when it is not and must be estimated from the sample. On an open-book CSSC item, answer from the manual's own wording. On the job, and on ASQ or IASSC items, apply the standard convention.

Worked Calculation 1: Sizing a Mean Estimate

Scenario. A Green Belt is baselining call-handling time at a service desk. Historical data gives σ = 12 \sigma = 12 σ = 12 minutes. Leadership wants the baseline mean estimated to within ± 2 \pm 2 ± 2 minutes at 95% confidence.

For estimating a mean to a stated margin of error E E E : n = ( Z α / 2 × σ E ) 2 n = \left( \frac{Z_{\alpha/2} \times \sigma}{E} \right)^2 n = ( E Z α /2 ​ × σ ​ ) 2 n = ( 1.96 × 12 2 ) 2 = ( 11.76 ) 2 = 138.3 n = \left( \frac{1.96 \times 12}{2} \right)^2 = (11.76)^2 = 138.3 n = ( 2 1.96 × 12 ​ ) 2 = ( 11.76 ) 2 = 138.3

Always round up. The team needs n = 139 n = 139 n = 139 calls. Note the inverse-square behaviour: halving the margin of error to ± 1 \pm 1 ± 1 minute would require ( 23.52 ) 2 = 553.2 → 554 (23.52)^2 = 553.2 \rightarrow 554 ( 23.52 ) 2 = 553.2 → 554 calls, a fourfold increase.

Worked Calculation 2: Sizing a Two-Sample Comparison

Scenario. The team wants to know whether a revised script changes handling time. It will compare the revised script against the current one and considers a 1 σ 1\sigma 1 σ shift the smallest business-relevant difference. Following CSSC's guidelines: α = 0.05 \alpha = 0.05 α = 0.05 (so Z α / 2 = 1.96 Z_{\alpha/2} = 1.96 Z α /2 ​ = 1.96 ) and β = 0.20 \beta = 0.20 β = 0.20 , giving power 0.80 0.80 0.80 (so Z β = 0.84 Z_\beta = 0.84 Z β ​ = 0.84 ).

For a two-sample test of means with equal group sizes: n per group = 2 ( Z α / 2 + Z β ) 2 σ 2 δ 2 n_{\text{per group}} = \frac{2(Z_{\alpha/2} + Z_\beta)^2 \sigma^2}{\delta^2} n per group ​ = δ 2 2 ( Z α /2 ​ + Z β ​ ) 2 σ 2 ​

With δ = 1 σ \delta = 1\sigma δ = 1 σ , the σ 2 \sigma^2 σ 2 terms cancel: n per group = 2 ( 1.96 + 0.84 ) 2 = 2 ( 2.80 ) 2 = 2 ( 7.84 ) = 15.68 → 16 per group n_{\text{per group}} = 2(1.96 + 0.84)^2 = 2(2.80)^2 = 2(7.84) = 15.68 \rightarrow \mathbf{16 \text{ per group}} n per group ​ = 2 ( 1.96 + 0.84 ) 2 = 2 ( 2.80 ) 2 = 2 ( 7.84 ) = 15.68 → 16 per group

Total sample: 32 calls , 16 under each script.

The cost of more power

Rerun the same problem at β = 0.10 \beta = 0.10 β = 0.10 (power 0.90, Z β = 1.28 Z_\beta = 1.28 Z β ​ = 1.28 ): n per group = 2 ( 1.96 + 1.28 ) 2 = 2 ( 3.24 ) 2 = 2 ( 10.4976 ) = 20.99 → 21 per group n_{\text{per group}} = 2(1.96 + 1.28)^2 = 2(3.24)^2 = 2(10.4976) = 20.99 \rightarrow \mathbf{21 \text{ per group}} n per group ​ = 2 ( 1.96 + 1.28 ) 2 = 2 ( 3.24 ) 2 = 2 ( 10.4976 ) = 20.99 → 21 per group

Raising power from 0.80 to 0.90 costs 5 extra observations per group here — about 31% more data. That is CSSC's "much larger sample size" caution in numbers, and the effect grows sharply as delta shrinks.

The cost of a smaller delta

Hold power at 0.80 and halve delta to 0.5 σ 0.5\sigma 0.5 σ : n per group = 2 ( 2.80 ) 2 ( 0.5 ) 2 = 15.68 0.25 = 62.72 → 63 per group n_{\text{per group}} = \frac{2(2.80)^2}{(0.5)^2} = \frac{15.68}{0.25} = 62.72 \rightarrow \mathbf{63 \text{ per group}} n per group ​ = ( 0.5 ) 2 2 ( 2.80 ) 2 ​ = 0.25 15.68 ​ = 62.72 → 63 per group

Halving delta quadrupled the sample. Delta, not alpha, is the dominant cost driver — which is exactly why CSSC insists it be set from business need rather than reflexively made small.

Worked Calculation 3: Sizing a Proportion Study

Scenario. A billing department's historical rework rate is about p = 0.10 p = 0.10 p = 0.10 . The team wants to estimate the current rate to within ± 3 \pm 3 ± 3 percentage points at 95% confidence. n = Z α / 2 2 × p ( 1 − p ) E 2 n = \frac{Z_{\alpha/2}^2 \times p(1 - p)}{E^2} n = E 2 Z α /2 2 ​ × p ( 1 − p ) ​ n = ( 1.96 ) 2 × ( 0.10 ) ( 0.90 ) ( 0.03 ) 2 = 3.8416 × 0.09 0.0009 = 0.345744 0.0009 = 384.2 → 385 invoices n = \frac{(1.96)^2 \times (0.10)(0.90)}{(0.03)^2} = \frac{3.8416 \times 0.09}{0.0009} = \frac{0.345744}{0.0009} = 384.2 \rightarrow \mathbf{385 \text{ invoices}} n = ( 0.03 ) 2 ( 1.96 ) 2 × ( 0.10 ) ( 0.90 ) ​ = 0.0009 3.8416 × 0.09 ​ = 0.0009 0.345744 ​ = 384.2 → 385 invoices

Compare that with the 139 calls needed for the continuous measurement in Worked Calculation 1. This is the same lesson Section 6.1 delivered from the other direction: attribute data is statistically expensive. Whenever a continuous measurement is available, taking it reduces the sample size dramatically.

Tip

When p p p is unknown. Use p = 0.5 p = 0.5 p = 0.5 . That maximizes p ( 1 − p ) p(1-p) p ( 1 − p ) at 0.25 0.25 0.25 and therefore produces the largest — most conservative — sample size. Here it would give n = 3.8416 × 0.25 / 0.0009 = 1,067.1 → 1,068 n = 3.8416 \times 0.25 / 0.0009 = 1{,}067.1 \rightarrow 1{,}068 n = 3.8416 × 0.25/0.0009 = 1 , 067.1 → 1 , 068 .

Realistic Exam Scenario

A Green Belt at a packaging plant is asked to confirm whether a new sealing head reduces leak rate. Baseline leak rate is 2%. The plant manager says a reduction below 1.5% would be worth the capital, and the plant produces 4,000 units per shift.

Work the four inputs in order. Proportions , not means, so the 1-Sample or 2-Sample Proportion calculation applies. Two data sets are being compared — old head versus new — so it is 2-Sample Proportion . Delta is not "any detectable reduction"; it is the business-defined 0.5 percentage points. Alpha and beta take the CSSC defaults of 0.05 and 0.20 unless leak escapes carry safety consequences, in which case beta should drop to 0.10 because the Type II error — shipping a leaking package — is expensive.

The instructive part is what the numbers then reveal: detecting a half-point shift in a 2% rate requires thousands of units per arm. The right recommendation may be to run the comparison over several shifts, or to find a continuous surrogate for leak resistance such as seal peel strength, which would collapse the sample size by an order of magnitude.

Common Exam Traps

Trap 1: Rounding sample size down. Always round up to the next whole unit. A calculation of 138.3 means 139.

Trap 2: Setting delta as small as possible. Halving delta roughly quadruples the sample. Delta comes from business need — the 13.9-inch pizza is not a defect.

Trap 3: Confusing beta with power. Power = 1 − β = 1 - \beta = 1 − β . A beta of 0.10 is power 0.90, and CSSC's guideline offers 0.10 or 0.20.

Trap 4: Applying the standard formula to survey sampling. General sampling of an unknown population uses α = 0.05 \alpha = 0.05 α = 0.05 , β = 0.5 \beta = 0.5 β = 0.5 , delta matching σ = 1 \sigma = 1 σ = 1 , and is a two-stage procedure requiring additional sampling afterward.

Trap 5: Choosing ANOVA when more than one factor acts on x. More than two data sets with one factor is ANOVA; more than two data sets with more than one factor is DOE.

Trap 6: Forgetting delta must exceed 1 for variance testing. That is the one delta guideline unique to variance tests.