Study guide
6.6 Specific Statistical Tests
Certified Quality Engineer CQE
Track your progress as you read
Finished sections get a check mark.
1 Chapter 1: Management and Leadership
1.1 Quality Philosophies & Foundations 1.2 Leadership & Organizational Systems 1.3 ASQ Code of Ethics & Professional Standards 1.4 Strategic Planning & Deployment 1.5 Management Infrastructure & Project Management 1.6 Quality Information Systems & Communication 1.7 Financial & Cost of Quality
2 Chapter 2: The Quality System
2.1 Quality Management System Elements & Standards 2.2 Quality Documentation Architecture 2.3 Quality Auditing Principles & Types 2.4 Audit Planning, Execution & Reporting 2.5 Corrective Action & Preventive Action Systems 2.6 Supplier Quality Management 2.7 Customer Relations & Customer Value 2.8 Quality Training Program Design & Effectiveness
3 Chapter 3: Product, Process, and Service Design
3.1 Design Input & Requirements 3.2 Design Review & Verification 3.3 Failure Mode and Effects Analysis 3.4 Design of Experiments Foundations 3.5 Robust Design & Taguchi Methods 3.6 Reliability & Maintainability Concepts 3.7 Reliability Modeling & System Evaluation 3.8 Technical Drawings, Specifications & GD&T
4 Chapter 4: Product and Process Control
4.1 Statistical Process Control Principles 4.2 Variable Control Charts 4.3 Attribute Control Charts 4.4 Process Capability & Performance Analysis 4.5 Acceptance Sampling Plans & Standards 4.6 Metrology, Calibration & Measurement Uncertainty 4.7 Measurement System Analysis (MSA) 4.8 Material Control, Traceability & MRB
5 Chapter 5: Continuous Improvement
5.1 Continuous Improvement Methodologies 5.2 Classic Quality Tools 5.3 Management & Planning Tools 5.4 Lean Tools & Waste Elimination 5.5 Problem-Solving Methodologies & Root Cause Analysis 5.6 Risk Management & Assessment 5.7 Change Management & Team Facilitation
6 Chapter 6: Quantitative Methods and Tools
6.1 Descriptive Statistics & Data Summarization 6.2 Probability Concepts & Distributions 6.3 Sampling Distributions & Central Limit Theorem 6.4 Point & Interval Estimation 6.5 Hypothesis Testing Fundamentals 6.6 Specific Statistical Tests 6.7 Regression & Correlation Analysis
7 Chapter 7: Risk Management & Advanced Quality Engineering
7.1 Risk Identification & Hazard Analysis 7.2 Quantitative Risk Analysis & Modeling 7.3 Risk Mitigation & Control Planning 7.4 Special Process Control & Advanced SPC 7.5 Advanced Statistical Design & Analysis 7.6 Computer Applications & Quality Engineering Software
6.6 Specific Statistical Tests
Key Takeaways Explain This Topic AI
One-sample and two-sample Z-tests and t-tests evaluate population means depending on whether the population standard deviation (σ) is known or unknown.
The paired t-test eliminates subject-to-subject variability by evaluating paired differences (d_i = x1_i - x2_i) with n - 1 degrees of freedom.
Two-sample t-tests utilize a pooled variance estimator (s_p²) under equal population variances, or Welch's approximation under unequal variances.
Chi-square (χ²) tests assess goodness-of-fit for categorical distributions (df = k - 1 - p) and independence in contingency tables (df = (r - 1)(c - 1)).
One-Way ANOVA evaluates the equality of three or more group means by comparing variance between groups (MSB) against variance within groups (MSW) using an F-test statistic (F = MSB / MSW).
Last updated: July 2026
6.6 Specific Statistical Tests
Selecting and properly executing the correct statistical test is a fundamental competency for Certified Quality Engineers. The choice of test depends on the nature of the data (continuous vs. discrete), the number of samples being compared, whether samples are independent or paired, and whether population parameters (such as σ \sigma σ ) are known.
1. Summary of Standard Statistical Tests
Test Name Data Type Purpose / Comparison Standard Statistic & Degrees of Freedom ( d f df df )
One-Sample Z Z Z -Test Continuous Compare sample mean to standard μ 0 \mu_0 μ 0 (known σ \sigma σ ) Z = x ˉ − μ 0 σ / n Z = \frac{\bar{x} - \mu_0}{\sigma / \sqrt{n}} Z = σ / n x ˉ − μ 0
One-Sample t t t -Test Continuous Compare sample mean to standard μ 0 \mu_0 μ 0 (unknown σ \sigma σ ) t = x ˉ − μ 0 s / n t = \frac{\bar{x} - \mu_0}{s / \sqrt{n}} t = s / n x ˉ − μ 0 , d f = n − 1 df = n - 1 df = n − 1
Two-Sample t t t -Test (Pooled) Continuous Compare two independent means (assume σ 1 2 = σ 2 2 \sigma_1^2 = \sigma_2^2 σ 1 2 = σ 2 2 ) t = x ˉ 1 − x ˉ 2 s p 1 n 1 + 1 n 2 t = \frac{\bar{x}_1 - \bar{x}_2}{s_p \sqrt{\frac{1}{n_1} + \frac{1}{n_2}}} t = s p n 1 1 + n 2 1 x ˉ 1 − x ˉ 2 , d f = n 1 + n 2 − 2 df = n_1 + n_2 - 2 df = n 1 + n 2 − 2
Paired t t t -Test Continuous Compare paired/matched samples (before vs. after) t = d ˉ − μ d s d / n t = \frac{\bar{d} - \mu_d}{s_d / \sqrt{n}} t = s d / n d ˉ − μ d , d f = n − 1 df = n - 1 df = n − 1
χ 2 \chi^2 χ 2 Goodness-of-Fit Categorical Compare observed counts to expected model χ 2 = ∑ ( O − E ) 2 E \chi^2 = \sum \frac{(O - E)^2}{E} χ 2 = ∑ E ( O − E ) 2 , d f = k − 1 − p df = k - 1 - p df = k − 1 − p
χ 2 \chi^2 χ 2 Independence Categorical Test independence of 2 variables in r × c r \times c r × c table χ 2 = ∑ ( O − E ) 2 E \chi^2 = \sum \frac{(O - E)^2}{E} χ 2 = ∑ E ( O − E ) 2 , d f = ( r − 1 ) ( c − 1 ) df = (r-1)(c-1) df = ( r − 1 ) ( c − 1 )
One-Way ANOVA Continuous Compare ≥ 3 \ge 3 ≥ 3 independent group means F = M S B M S W F = \frac{MSB}{MSW} F = MS W MSB , d f 1 = k − 1 , d f 2 = N − k df_1 = k - 1, df_2 = N - k d f 1 = k − 1 , d f 2 = N − k
- 2. One-Sample and Two-Sample Z Z Z -Tests and t t t -Tests for Means
- One-Sample t t t -Test
When population standard deviation σ \sigma σ is unknown, it is estimated using sample standard deviation s s s , introducing extra sampling variability. The test statistic follows Student's t t t -distribution with d f = n − 1 df = n - 1 df = n − 1 .
Two-Sample Independent t t t -Test (Equal Variances)
When comparing means from two independent groups assuming equal variances (verified via an F F F -test for variances), sample variances are combined into a pooled variance ( s p 2 s_p^2 s p 2 ): s p 2 = ( n 1 − 1 ) s 1 2 + ( n 2 − 1 ) s 2 2 n 1 + n 2 − 2 s_p^2 = \frac{(n_1 - 1)s_1^2 + (n_2 - 1)s_2^2}{n_1 + n_2 - 2} s p 2 = n 1 + n 2 − 2 ( n 1 − 1 ) s 1 2 + ( n 2 − 1 ) s 2 2 Test Statistic: t c a l c = x ˉ 1 − x ˉ 2 s p 2 ( 1 n 1 + 1 n 2 ) with d f = n 1 + n 2 − 2 \text{Test Statistic:} \quad t_{calc} = \frac{\bar{x}_1 - \bar{x}_2}{\sqrt{s_p^2 \left(\frac{1}{n_1} + \frac{1}{n_2}\right)}} \quad \text{with } df = n_1 + n_2 - 2 Test Statistic: t c a l c = s p 2 ( n 1 1 + n 2 1 ) x ˉ 1 − x ˉ 2 with df = n 1 + n 2 − 2
3. Paired t t t -Test for Dependent Samples
When data consists of paired measurements on the same experimental units (e.g., measuring roughness before and after polishing on n n n identical parts), subject-to-subject variation is eliminated by analyzing individual differences d i = x 1 i − x 2 i d_i = x_{1i} - x_{2i} d i = x 1 i − x 2 i .
Mean difference: d ˉ = ∑ d i n \bar{d} = \frac{\sum d_i}{n} d ˉ = n ∑ d i
Sample standard deviation of differences: s d = ∑ ( d i − d ˉ ) 2 n − 1 s_d = \sqrt{\frac{\sum (d_i - \bar{d})^2}{n - 1}} s d = n − 1 ∑ ( d i − d ˉ ) 2
Test statistic: t c a l c = d ˉ − μ d s d / n with d f = n − 1 t_{calc} = \frac{\bar{d} - \mu_d}{s_d / \sqrt{n}} \quad \text{with } df = n - 1 t c a l c = s d / n d ˉ − μ d with df = n − 1
CQE Tip: The paired t t t -test has n − 1 n - 1 n − 1 degrees of freedom (where n n n is the number of pairs), which is half the degrees of freedom of an independent two-sample test ( 2 n − 2 2n - 2 2 n − 2 ). However, by removing background variance between units, pairing dramatically reduces error variance and increases test sensitivity.
4. Chi-Square ( χ 2 \chi^2 χ 2 ) Tests: Goodness-of-Fit and Independence
Chi-square tests evaluate non-parametric categorical count data. Chi-Square Test Statistic: χ c a l c 2 = ∑ i = 1 k ( O i − E i ) 2 E i \text{Chi-Square Test Statistic:} \quad \chi^2_{calc} = \sum_{i=1}^{k} \frac{(O_i - E_i)^2}{E_i} Chi-Square Test Statistic: χ c a l c 2 = i = 1 ∑ k E i ( O i − E i ) 2
where O i O_i O i is the Observed frequency and E i E_i E i is the Expected frequency.
Goodness-of-Fit Test
Evaluates whether observed sample counts fit a theoretical distribution (e.g., Poisson, Normal, Binomial). Expected count E i = n ⋅ p i E_i = n \cdot p_i E i = n ⋅ p i . Degrees of freedom d f = k − 1 − p df = k - 1 - p df = k − 1 − p , where k k k is the number of categories and p p p is the number of parameters estimated from sample data.
Test of Independence (Contingency Tables)
Evaluates whether two categorical variables (e.g., defect type vs. manufacturing shift) are independent in an r × c r \times c r × c table. Expected frequencies are computed as: E i j = ( Row i Total ) × ( Column j Total ) Grand Total , d f = ( r − 1 ) ( c − 1 ) E_{ij} = \frac{(\text{Row } i \text{ Total}) \times (\text{Column } j \text{ Total})}{\text{Grand Total}}, \quad df = (r - 1)(c - 1) E ij = Grand Total ( Row i Total ) × ( Column j Total ) , df = ( r − 1 ) ( c − 1 )
5. One-Way Analysis of Variance (ANOVA) F F F -Test
When comparing k ≥ 3 k \ge 3 k ≥ 3 group means, running multiple pairwise t t t -tests causes alpha inflation : overall Type I error risk rises to α o v e r a l l = 1 − ( 1 − α ) C \alpha_{overall} = 1 - (1 - \alpha)^C α o v er a ll = 1 − ( 1 − α ) C , where C = k ( k − 1 ) 2 C = \frac{k(k-1)}{2} C = 2 k ( k − 1 ) . One-Way ANOVA avoids this by testing H 0 : μ 1 = μ 2 = ⋯ = μ k H_0: \mu_1 = \mu_2 = \dots = \mu_k H 0 : μ 1 = μ 2 = ⋯ = μ k simultaneously.
ANOVA partitions total sum of squares ( S S T SST SST ) into between-group variation ( S S B SSB SSB ) and within-group error variation ( S S W SSW SS W ): S S T = S S B + S S W SST = SSB + SSW SST = SSB + SS W
Between-Group Mean Square ( M S B MSB MSB ): M S B = S S B k − 1 MSB = \frac{SSB}{k - 1} MSB = k − 1 SSB
Within-Group Mean Square ( M S W MSW MS W ): M S W = S S W N − k MSW = \frac{SSW}{N - k} MS W = N − k SS W (where N = ∑ n i N = \sum n_i N = ∑ n i )
F F F -Statistic: F c a l c = M S B M S W F_{calc} = \frac{MSB}{MSW} F c a l c = MS W MSB with d f 1 = k − 1 df_1 = k - 1 d f 1 = k − 1 and d f 2 = N − k df_2 = N - k d f 2 = N − k
6. Worked Example: One-Way ANOVA for Machining Line Performance
Scenario: A quality engineer compares hole diameter measurements across k = 3 k = 3 k = 3 CNC machining lines. Sample size is n i = 5 n_i = 5 n i = 5 parts per line (Total N = 15 N = 15 N = 15 ).
- Line A mean = 10.2 mm = 10.2\text{ mm} = 10.2 mm
- Line B mean = 12.4 mm = 12.4\text{ mm} = 12.4 mm
- Line C mean = 13.4 mm = 13.4\text{ mm} = 13.4 mm
- Overall Grand Mean x ˉ . . = 12.0 mm \bar{x}_{..} = 12.0\text{ mm} x ˉ .. = 12.0 mm
Calculated S S B = 26.8 SSB = 26.8 SSB = 26.8 , and calculated S S W = 18.0 SSW = 18.0 SS W = 18.0 .
Test at α = 0.05 \alpha = 0.05 α = 0.05 ( F c r i t , 0.05 , 2 , 12 = 3.89 F_{crit, 0.05, 2, 12} = 3.89 F cr i t , 0.05 , 2 , 12 = 3.89 ) whether machine line means differ significantly.
Step-by-Step ANOVA Solution:
Degrees of Freedom:
- d f b e t w e e n = k − 1 = 3 − 1 = 2 df_{between} = k - 1 = 3 - 1 = 2 d f b e tw ee n = k − 1 = 3 − 1 = 2
- d f w i t h i n = N − k = 15 − 3 = 12 df_{within} = N - k = 15 - 3 = 12 d f w i t hin = N − k = 15 − 3 = 12
- d f t o t a l = N − 1 = 14 df_{total} = N - 1 = 14 d f t o t a l = N − 1 = 14
Mean Squares:
M S B = S S B d f b e t w e e n = 26.8 2 = 13.4 MSB = \frac{SSB}{df_{between}} = \frac{26.8}{2} = 13.4 MSB = d f b e tw ee n SSB = 2 26.8 = 13.4
M S W = S S W d f w i t h i n = 18.0 12 = 1.5 MSW = \frac{SSW}{df_{within}} = \frac{18.0}{12} = 1.5 MS W = d f w i t hin SS W = 12 18.0 = 1.5
Calculate F F F -Statistic: F c a l c = M S B M S W = 13.4 1.5 = 8.933 F_{calc} = \frac{MSB}{MSW} = \frac{13.4}{1.5} = 8.933 F c a l c = MS W MSB = 1.5 13.4 = 8.933
Decision: Since F c a l c = 8.933 > F c r i t = 3.89 F_{calc} = 8.933 > F_{crit} = 3.89 F c a l c = 8.933 > F cr i t = 3.89 , reject H 0 H_0 H 0 . There is statistically significant evidence at α = 0.05 \alpha = 0.05 α = 0.05 that at least one CNC machining line mean differs from the others.