Study guide

2.2 Hypothesis Testing, ANOVA, and Statistical Quality Control

NCEES Fundamentals of Engineering FE

Track your progress as you read

Finished sections get a check mark.

1 Chapter 1: Mathematics

1.1 Analytic Geometry, Algebra, and Trigonometry 1.2 Calculus and Differential Equations 1.3 Numerical Methods and Measurement Error

2 Chapter 2: Probability and Statistics

2.1 Probability Distributions, Central Tendency, and Regression 2.2 Hypothesis Testing, ANOVA, and Statistical Quality Control

3 Chapter 3: Engineering Sciences

3.1 Mechanics and Dynamics 3.2 Electrical Circuits and Laws

4 Chapter 4: Materials Science

4.1 Material Properties and Compatibilities 4.2 Corrosion, Polymers, Ceramics, and Composites

5 Chapter 5: Chemistry and Biology

5.1 Stoichiometry, Analytical Chemistry, and Chemical Equilibrium 5.2 Organic Chemistry and Nomenclature 5.3 Biological Systems and Kinetics

6 Chapter 6: Fluid Mechanics and Dynamics

6.1 Fluid Properties, Dimensionless Numbers, and Flow Regimes 6.2 Bernoulli Equation and Mechanical Energy Balances 6.3 Flow Measurement and Fluid Machinery 6.4 Compressible and Non-Newtonian Flows

7 Chapter 7: Thermodynamics

7.1 Thermodynamic Properties, Ideal Gas, and State Equations 7.2 Laws of Thermodynamics and Cyclic Processes 7.3 Vapor-Liquid Equilibrium (VLE) and Phase Equilibrium 7.4 Chemical Equilibrium, Heats of Reaction, and Mixing

8 Chapter 8: Material and Energy Balances

8.1 Steady-State Material Balances 8.2 Unsteady-State Mass Balances 8.3 Steady-State Energy Balances 8.4 Unsteady-State Energy Balances

9 Chapter 9: Heat Transfer

9.1 Conduction, Convection, and Radiation Fundamentals 9.2 Heat Transfer Coefficients, Fouling, and Overall U 9.3 Heat Exchanger Design

10 Chapter 10: Mass Transfer and Separation

10.1 Diffusion Fundamentals 10.2 Gas Absorption, Stripping, and Liquid-Liquid Extraction 10.3 Distillation and McCabe-Thiele Method 10.4 Continuous Contact Methods, Membrane Separations, and Evaporative Operations

11 Chapter 11: Solids Handling

11.1 Particle Properties and Solid Processing 11.2 Solids Transportation and Storage

12 Chapter 12: Chemical Reaction Engineering

12.1 Reaction Kinetics and Performance Metrics 12.2 Ideal Reactor Design 12.3 Multiple Reactions, Catalysis, and Heterogeneous Kinetics

13 Chapter 13: Economics

13.1 Time Value of Money and Project Selection 13.2 Profitability Analysis, Depreciation, and Break-Even

14 Chapter 14: Process Design

14.1 Process Flowsheets and Instrumentation 14.2 Equipment Selection, Sizing, and Cost Estimation 14.3 Process Optimization, Sustainability, and Inherently Safer Design

15 Chapter 15: Process Control

15.1 Process Dynamics and Transfer Functions 15.2 Feedback Control Loops, PID Tuning, and Control Hardware

16 Chapter 16: Safety, Health, and Environment

16.1 Flammability, Toxicity, and Industrial Hygiene 16.2 Hazard Identification and Risk Analysis 16.3 Overpressure Relief, Reactivity Hazards, and Waste Regulations

17 Chapter 17: Ethics and Professional Practice

17.1 Professional Codes of Ethics and Public Welfare 17.2 Intellectual Property, Contracts, and Professional Liability

2.2 Hypothesis Testing, ANOVA, and Statistical Quality Control

Key Takeaways Explain This Topic AI

Hypothesis testing compares a null hypothesis H_0 against an alternative hypothesis H_1, subject to Type I (alpha) and Type II (beta) errors.

Student's t-tests compare means: one-sample t-test for comparison with a baseline, two-sample independent t-test for two groups, and paired t-test for dependent measurements.

One-way ANOVA tests equality of means across three or more groups by comparing the variance between treatments to the variance within treatments using the F-statistic.

Expected value analysis guides decision making under uncertainty, while outlier detection identifies suspect data points using Dixon's Q-test or Grubbs' test.

Shewhart control charts monitor process stability: the X-bar chart tracks process centering, while the R chart tracks process dispersion.

Last updated: July 2026

Hypothesis Testing and Decision Errors

Chemical engineers must make decisions based on experimental data that are subject to uncertainty. Statistical hypothesis testing provides a mathematical framework required to distinguish random noise from true physical effects, such as catalyst enhancements, reactor performance variations, or product specification drifts.

A hypothesis test is a formal procedure to decide between two competing claims about a population parameter:

Null Hypothesis ( H 0 H_0 H 0 ​ ): The status quo or default assumption that there is no difference, change, or effect (e.g., a new catalyst yields the same mean conversion as the old catalyst, H 0 : μ = μ 0 H_0: \mu = \mu_0 H 0 ​ : μ = μ 0 ​ ).

Alternative Hypothesis ( H 1 H_1 H 1 ​ or H a H_a H a ​ ): The claim the engineer wants to prove (e.g., the new catalyst increases mean conversion, H 1 : μ > μ 0 H_1: \mu > \mu_0 H 1 ​ : μ > μ 0 ​ , which is a one-tailed test; or the conversion is simply different, H 1 : μ ≠ μ 0 H_1: \mu \neq \mu_0 H 1 ​ : μ  = μ 0 ​ , which is a two-tailed test).

When conducting hypothesis tests, two types of decision errors can occur:

Type I Error ( α \alpha α ): Rejecting the null hypothesis when it is actually true (false positive). The probability of a Type I error is the significance level α \alpha α , typically set at 0.05 0.05 0.05 or 0.01 0.01 0.01 .

Type II Error ( β \beta β ): Failing to reject the null hypothesis when it is actually false (false negative). The probability of a Type II error is denoted by β \beta β .

Power of the Test ( 1 − β 1 - \beta 1 − β ): The probability of correctly rejecting the null hypothesis when it is false. Increasing the sample size n n n generally increases the power of the test.

Student's t-Tests for Means Comparison

To compare sample means when the population standard deviation is unknown, Student's t-tests are applied. The choice of the test depends on the experimental design:

One-Sample t-Test: Compares the sample mean X ˉ \bar{X} X ˉ to a known reference value μ 0 \mu_0 μ 0 ​ : t calc = X ˉ − μ 0 s / n t_{\text{calc}} = \frac{\bar{X} - \mu_0}{s / \sqrt{n}} t calc ​ = s / n ​ X ˉ − μ 0 ​ ​ where s s s is the sample standard deviation and n n n is the sample size. The calculated value is compared to critical values from the t-distribution table with ν = n − 1 \nu = n-1 ν = n − 1 degrees of freedom. If ∣ t calc ∣ > t α / 2 , n − 1 |t_{\text{calc}}| > t_{\alpha/2, n-1} ∣ t calc ​ ∣ > t α /2 , n − 1 ​ (for a two-tailed test), the difference is statistically significant.

Two-Sample Independent t-Test (Equal Variances): Compares the means of two independent groups ( X ˉ 1 \bar{X}_1 X ˉ 1 ​ and X ˉ 2 \bar{X}_2 X ˉ 2 ​ ). The pooled standard deviation s p s_p s p ​ is calculated as: s p = ( n 1 − 1 ) s 1 2 + ( n 2 − 1 ) s 2 2 n 1 + n 2 − 2 s_p = \sqrt{\frac{(n_1 - 1)s_1^2 + (n_2 - 1)s_2^2}{n_1 + n_2 - 2}} s p ​ = n 1 ​ + n 2 ​ − 2 ( n 1 ​ − 1 ) s 1 2 ​ + ( n 2 ​ − 1 ) s 2 2 ​ ​ ​ The test statistic is: t calc = X ˉ 1 − X ˉ 2 s p 1 n 1 + 1 n 2 t_{\text{calc}} = \frac{\bar{X}_1 - \bar{X}_2}{s_p \sqrt{\frac{1}{n_1} + \frac{1}{n_2}}} t calc ​ = s p ​ n 1 ​ 1 ​ + n 2 ​ 1 ​ ​ X ˉ 1 ​ − X ˉ 2 ​ ​ with degrees of freedom ν = n 1 + n 2 − 2 \nu = n_1 + n_2 - 2 ν = n 1 ​ + n 2 ​ − 2 .

Paired t-Test: Used when comparing dependent observations (e.g., measuring reactor concentration before and after a catalyst change on the same system). The differences d i = X 1 , i − X 2 , i d_i = X_{1,i} - X_{2,i} d i ​ = X 1 , i ​ − X 2 , i ​ are calculated, and the test statistic is t calc = d ˉ − μ d s d / n t_{\text{calc}} = \frac{\bar{d} - \mu_d}{s_d / \sqrt{n}} t calc ​ = s d ​ / n ​ d ˉ − μ d ​ ​ with ν = n − 1 \nu = n-1 ν = n − 1 degrees of freedom, where d ˉ \bar{d} d ˉ is the mean of the differences and s d s_d s d ​ is their standard deviation.

Analysis of Variance (ANOVA)

Analysis of Variance (ANOVA) generalizes the comparison of means to three or more treatment groups (e.g., comparing reactor yields under three different temperature regimes). One-way ANOVA tests the null hypothesis that all group means are equal: H 0 : μ 1 = μ 2 = ⋯ = μ k H_0: \mu_1 = \mu_2 = \dots = \mu_k H 0 ​ : μ 1 ​ = μ 2 ​ = ⋯ = μ k ​ against the alternative H 1 H_1 H 1 ​ : at least one group mean is different.

ANOVA partitions the total variation in the data set into two components:

Sum of Squares for Treatments ( S S Treatments SS_{\text{Treatments}} S S Treatments ​ or S S Between SS_{\text{Between}} S S Between ​ ): Measures variation between the group means and the grand mean.

Sum of Squares for Error ( S S Error SS_{\text{Error}} S S Error ​ or S S Within SS_{\text{Within}} S S Within ​ ): Measures variation within each group due to random noise.

The total sum of squares is S S Total = S S Treatments + S S Error SS_{\text{Total}} = SS_{\text{Treatments}} + SS_{\text{Error}} S S Total ​ = S S Treatments ​ + S S Error ​ . Mean squares ( M S MS MS ) are calculated by dividing the sum of squares by their respective degrees of freedom ( d f df df ): M S Treatments = S S Treatments k − 1 MS_{\text{Treatments}} = \frac{SS_{\text{Treatments}}}{k-1} M S Treatments ​ = k − 1 S S Treatments ​ ​ and M S Error = S S Error n − k MS_{\text{Error}} = \frac{SS_{\text{Error}}}{n-k} M S Error ​ = n − k S S Error ​ ​ , where k k k is the number of groups and n n n is the total number of observations. The test statistic is the F-ratio: F calc = M S Treatments M S Error F_{\text{calc}} = \frac{MS_{\text{Treatments}}}{MS_{\text{Error}}} F calc ​ = M S Error ​ M S Treatments ​ ​

If F calc F_{\text{calc}} F calc ​ is greater than the critical value F α , k − 1 , n − k F_{\alpha, k-1, n-k} F α , k − 1 , n − k ​ from the F-distribution table in the FE Reference Handbook, the null hypothesis is rejected, indicating a statistically significant difference between the means.

Expected Value in Decision Analysis

Chemical engineers often face economic decisions under uncertainty, such as selecting a process design route, purchasing redundant equipment, or sizing emergency backup units. The expected value E ( X ) E(X) E ( X ) of a discrete random variable is the probability-weighted average of all possible outcomes: E ( X ) = ∑ i = 1 m x i P ( x i ) E(X) = \sum_{i=1}^{m} x_i P(x_i) E ( X ) = i = 1 ∑ m ​ x i ​ P ( x i ​ )

where x i x_i x i ​ represents the value of outcome i i i and P ( x i ) P(x_i) P ( x i ​ ) is the probability of that outcome.

For example, when evaluating whether to install a backup cooling water pump, the engineer compares the guaranteed cost of installation to the expected cost of production downtime caused by main pump failure: Expected Cost of Failure = P ( Failure ) × Cost of Halt \text{Expected Cost of Failure} = P(\text{Failure}) \times \text{Cost of Halt} Expected Cost of Failure = P ( Failure ) × Cost of Halt

If the backup pump costs $15,000 to install, and the expected cost of not installing it is 0.12 × 100 , 000 = 12 , 000 0.12 \times 100,000 = 12,000 0.12 × 100 , 000 = 12 , 000 USD, then on a purely expected value basis, the installation cost exceeds the expected failure cost, and the plant should not install the backup pump. However, engineers must often balance expected value calculations with safety margins and risk-averse strategies.

Outlier Testing (Q-Test and Grubbs' Test)

Outliers are extreme observations that deviate significantly from the rest of the data. They can arise from experimental error, equipment malfunction, or transcription mistakes. Engineers must test whether to statistically discard these points rather than let them bias calculations.

Dixon's Q-Test: Used for small data sets ( 3 ≤ n ≤ 30 3 \le n \le 30 3 ≤ n ≤ 30 ) to test a single suspect outlier. The data are arranged in ascending order, and the Q-ratio is calculated as: Q = gap range = ∣ x suspect − x nearest ∣ x max − x min Q = \frac{\text{gap}}{\text{range}} = \frac{|x_{\text{suspect}} - x_{\text{nearest}}|}{x_{\text{max}} - x_{\text{min}}} Q = range gap ​ = x max ​ − x min ​ ∣ x suspect ​ − x nearest ​ ∣ ​ If Q calc > Q critical Q_{\text{calc}} > Q_{\text{critical}} Q calc ​ > Q critical ​ (from the Q-table at a given confidence level, typically 95%), the outlier is discarded.

Grubbs' Test: Recommended for larger samples to detect a single outlier. The Grubbs test statistic G G G is: G = ∣ x suspect − X ˉ ∣ s G = \frac{|x_{\text{suspect}} - \bar{X}|}{s} G = s ∣ x suspect ​ − X ˉ ∣ ​ If G calc > G critical G_{\text{calc}} > G_{\text{critical}} G calc ​ > G critical ​ from Grubbs' table, the suspect data point is rejected. Once discarded, the mean and standard deviation must be recalculated using the remaining n − 1 n-1 n − 1 data points.

Statistical Quality Control and Control Charts

Statistical Quality Control (SQC) uses control charts to monitor a process over time to detect whether variation is due to common causes (random noise) or assignable causes (process drifts, feed changes, or equipment wear). For continuous variables (such as product viscosity or moisture content), engineers use Shewhart Control Charts , specifically the X ˉ \bar{X} X ˉ (mean) chart to monitor process centering and the R R R (range) chart to monitor process dispersion.

Subgroup Sampling: Samples of size n n n are taken at regular intervals. For each subgroup, the mean X ˉ j \bar{X}_j X ˉ j ​ and range R j R_j R j ​ are calculated.

Center Lines (CL): Grand Mean X ˉ ˉ = 1 m ∑ j = 1 m X ˉ j and Average Range R ˉ = 1 m ∑ j = 1 m R j \text{Grand Mean } \bar{\bar{X}} = \frac{1}{m} \sum_{j=1}^{m} \bar{X}_j \quad \text{and} \quad \text{Average Range } \bar{R} = \frac{1}{m} \sum_{j=1}^{m} R_j Grand Mean X ˉ ˉ = m 1 ​ j = 1 ∑ m ​ X ˉ j ​ and Average Range R ˉ = m 1 ​ j = 1 ∑ m ​ R j ​

Control Limits: 3-sigma control limits are established using standard control chart factor tables from the FE Reference Handbook:

X ˉ \bar{X} X ˉ Chart Limits: UCL X ˉ = X ˉ ˉ + A 2 R ˉ \text{UCL}_{\bar{X}} = \bar{\bar{X}} + A_2 \bar{R} UCL X ˉ ​ = X ˉ ˉ + A 2 ​ R ˉ and LCL X ˉ = X ˉ ˉ − A 2 R ˉ \text{LCL}_{\bar{X}} = \bar{\bar{X}} - A_2 \bar{R} LCL X ˉ ​ = X ˉ ˉ − A 2 ​ R ˉ

R R R Chart Limits: UCL R = D 4 R ˉ \text{UCL}_R = D_4 \bar{R} UCL R ​ = D 4 ​ R ˉ and LCL R = D 3 R ˉ \text{LCL}_R = D_3 \bar{R} LCL R ​ = D 3 ​ R ˉ where A 2 A_2 A 2 ​ , D 3 D_3 D 3 ​ , and D 4 D_4 D 4 ​ are constants dependent on the subgroup sample size n n n . If any subgroup mean or range falls outside these limits, the process is considered "out of control," prompting investigation.