7.1 Sampling Distributions, Central Limit Theorem, and Confidence Intervals

FE Industrial and Systems Study Guide Exam

Track your progress as you read

Finished sections get a check mark.

1 Chapter 1: Exam Overview, CBT Strategy & Handbook Navigation

1.1 FE Industrial Exam Structure, CBT Logistics, and Pacing 1.2 Using the NCEES FE Reference Handbook and Approved Calculators

2 Chapter 2: Mathematics for Industrial Engineers

2.1 Analytic Geometry, Coordinate Systems, and Trigonometry 2.2 Calculus: Differential, Integral, and Series Approximations 2.3 Linear Algebra: Matrix Operations, Systems of Equations, and Vectors

3 Chapter 3: Engineering Sciences Core

3.1 Thermodynamics Fundamentals and Fluid Flow Principles 3.2 Statics, Dynamics, and Mechanics of Materials Core 3.3 Electrical Circuits, DC/AC Analysis, and Power in Industrial Systems

4 Chapter 4: Ethics and Professional Practice

4.1 NCEES Model Rules of Professional Conduct and Technical Society Ethics 4.2 Engineering Licensure, Public Welfare, and Professional Liability 4.3 Engineering Contracts, Intellectual Property, and Conflicts of Interest

5 Chapter 5: Engineering Economics

5.1 Time Value of Money, Discount Factors, and Equivalence 5.2 Evaluating Alternatives: Present Worth, Equivalent Annual Cost, and IRR 5.3 Incremental Rate of Return, Replacement Analysis, and Break-Even 5.4 Depreciation Methods, MACRS, Income Taxes, and Inflation

6 Chapter 6: Probability Foundations & Distributions

6.1 Basic Probability Concepts, Conditional Probability, and Bayes' Theorem 6.2 Discrete Probability Distributions 6.3 Continuous Probability Distributions

7 Chapter 7: Statistical Inference, Regression & Design of Experiments

7.1 Sampling Distributions, Central Limit Theorem, and Confidence Intervals 7.2 Hypothesis Testing: Means, Proportions, and Variances 7.3 Linear Regression, Correlation Analysis, and Design of Experiments (ANOVA)

8 Chapter 8: Data, Logic, Modeling & Linear Programming

8.1 Optimization Modeling: Decision Variables, Objectives, and Constraints 8.2 Linear Programming: Graphical Solutions and Simplex Fundamentals 8.3 Duality, Sensitivity Analysis, and Integer Linear Programming 8.4 Data, Logic Development, and Analytics

9 Chapter 9: Stochastic Models & Simulation

9.1 Queuing Theory: Little's Law, M/M/1, and Multi-Server Systems 9.2 Discrete-Time Markov Chains: Transition Matrices and Steady-State Probabilities 9.3 Discrete-Event Simulation Principles and Monte Carlo Modeling

10 Chapter 10: Engineering Management, Project Planning & Performance Measurement

10.1 Organizational Structure, Leadership, and Worker Motivation Theories 10.2 Project Management: WBS, Critical Path Method (CPM), PERT, and Crashing 10.3 Earned Value Management (EVM), Decision Trees, and Risk Preference 10.4 Performance Measurement: Productivity, KPIs, Wage Systems, and the Balanced Scorecard

11 Chapter 11: Manufacturing & Production Systems

11.1 Manufacturing Processes, Material Processing, and Tolerancing 11.2 Assembly Line Balancing, Takt Time, Cycle Time, and Throughput 11.3 Sustainable Manufacturing, Waste Minimization, and Life-Cycle Assessment

12 Chapter 12: Production Planning, Inventory Control & Sequencing

12.1 Demand Forecasting Methods and Forecast Error Tracking 12.2 Aggregate Planning, Master Production Scheduling (MPS), and MRP 12.3 Deterministic Inventory Models: EOQ, EPQ, and Safety Stock 12.4 Job Sequencing, Dispatching Rules, and Flow Shop Scheduling

13 Chapter 13: Lean Systems & Theory of Constraints

13.1 Lean Foundations: Value Stream Mapping, Seven Wastes, and 5S 13.2 Pull Systems, Kanban, Just-In-Time (JIT), and SMED Setup Reduction 13.3 Theory of Constraints: Bottleneck Identification and Drum-Buffer-Rope

14 Chapter 14: Facilities Planning & Material Handling

14.1 Facility Location Analysis: Qualitative Factor Rating and Centroid Method 14.2 Facility Layout Design and Flow Analysis 14.3 Material Handling Equipment, Warehousing, and AS/RS

15 Chapter 15: Supply Chain Design & Logistics

15.1 Supply Chain Network Architecture and Transportation Modes 15.2 Distribution Strategies, Cross-Docking, and Vehicle Routing 15.3 The Bullwhip Effect, Risk Pooling, and Supply Chain Coordination

16 Chapter 16: Human Factors & Cognitive Ergonomics

16.1 Cognitive Engineering, Human-Machine Interface, Displays, and Controls 16.2 Anthropometric Principles, Percentile Design, and Biomechanical Posture 16.3 Environmental Ergonomics: Industrial Noise, Lighting, and Heat Stress

17 Chapter 17: Physical Ergonomics & Workplace Safety

17.1 Physical Ergonomics: The NIOSH Manual Lifting Equation 17.2 Cumulative Trauma Disorders and Postural Assessment 17.3 Workplace Safety: OSHA Standards, Hazard Analysis, and Control Hierarchy

18 Chapter 18: Work Design & Measurement

18.1 Methods Engineering, Process Charting, and Principles of Motion Economy 18.2 Direct Stopwatch Time Study: Observed Time, Performance Rating, and Allowances 18.3 Predetermined Time Systems, Work Sampling, and Learning Curves

19 Chapter 19: Quality Management, Six Sigma & Analytical Tools

19.1 Quality Philosophies, Total Quality Management, and Cost of Quality 19.2 Six Sigma DMAIC Methodology and Quality Function Deployment 19.3 The Seven Basic Quality Tools, Root Cause Analysis, and Taguchi Loss Function

20 Chapter 20: Statistical Process Control

20.1 Statistical Process Control Principles, Variation, and Run Rules 20.2 Variable Control Charts: X-bar & R, X-bar & S, and Individual-Moving Range 20.3 Attribute Control Charts: Defectives (p, np) and Defects (c, u)

21 Chapter 21: Process Capability & Acceptance Sampling

21.1 Process Capability Indices and Defect Levels 21.2 Acceptance Sampling Concepts and Operating Characteristic Curves 21.3 Sampling Risks, AQL, LTPD, and Standard Sampling Plans

22 Chapter 22: Systems Engineering & Life-Cycle Management

22.1 The Systems Engineering V-Model, Stakeholder Requirements, and Functional Architecture 22.2 Configuration Management, Interface Control, and Verification & Validation 22.3 Life-Cycle Costing, Maintainability, and System Availability

23 Chapter 23: Reliability Engineering & Risk Analysis

23.1 Reliability Mathematics, Hazard Rates, and the Bathtub Curve 23.2 System Reliability Configurations: Series, Parallel, and k-out-of-n Systems 23.3 Failure Modes and Effects Analysis and Fault Tree Analysis

7.1 Sampling Distributions, Central Limit Theorem, and Confidence Intervals

Key Takeaways Explain This Topic AI

Sample statistics (x̄, s², p̂) are random variables that estimate fixed population parameters (μ, σ², p); sample variance divides by n - 1 (Bessel's correction) to ensure an unbiased estimator such that E[s²] = σ².

The Central Limit Theorem (CLT) guarantees that the sampling distribution of the sample mean x̄ approaches a normal distribution N(μ, σ²/n) as sample size n increases (n ≥ 30 heuristic), regardless of the underlying population distribution shape.

When population standard deviation σ is unknown, substituting the sample standard deviation s introduces extra sampling variability, requiring Student's t-distribution with ν = n - 1 degrees of freedom.

Two-sample pooled t-intervals assume equal variances (σ₁² = σ₂²) with ν = n₁ + n₂ - 2 degrees of freedom, whereas Welch's t-intervals accommodate unequal variances via Satterthwaite's degrees of freedom; paired designs reduce dependent pairs to univariate differences with ν = n - 1.

Confidence intervals for population variance σ² utilize the asymmetric Chi-Square (χ²) distribution with ν = n - 1 degrees of freedom; dividing by the upper critical value χ²_(α/2, n-1) yields the lower confidence limit.

Last updated: September 2026

Statistical inference provides the mathematical bridge between empirical sample data and population-level decision-making in industrial and systems engineering. Whether establishing process capability baselines, validating cycle time reductions following lean Kaizen events, or verifying supplier material compliance, industrial engineers rarely possess full census data for an entire production population. Instead, decisions must be inferred from finite random samples. The NCEES FE Reference Handbook formalizes these estimation techniques under its Engineering Probability and Statistics section. Mastering sampling distributions, the Central Limit Theorem, and confidence interval construction is essential for both foundational statistical inference and advanced quality engineering on the FE examination.

1. Population Parameters vs. Sample Statistics

Statistical inference distinguishes sharply between the fixed, underlying characteristics of a population and the random quantities computed from observed samples.

Attribute Population Parameter (Fixed / Unknown) Sample Statistic (Random Variable / Estimator)

Mean μ = 1 N ∑ i = 1 N x i \mu = \frac{1}{N}\sum_{i=1}^N x_i μ = N 1 ​ ∑ i = 1 N ​ x i ​ x ˉ = 1 n ∑ i = 1 n x i \bar{x} = \frac{1}{n}\sum_{i=1}^n x_i x ˉ = n 1 ​ ∑ i = 1 n ​ x i ​

Variance σ 2 = 1 N ∑ i = 1 N ( x i − μ ) 2 \sigma^2 = \frac{1}{N}\sum_{i=1}^N (x_i - \mu)^2 σ 2 = N 1 ​ ∑ i = 1 N ​ ( x i ​ − μ ) 2 s 2 = 1 n − 1 ∑ i = 1 n ( x i − x ˉ ) 2 s^2 = \frac{1}{n - 1}\sum_{i=1}^n (x_i - \bar{x})^2 s 2 = n − 1 1 ​ ∑ i = 1 n ​ ( x i ​ − x ˉ ) 2

• Standard Deviation σ = σ 2 \sigma = \sqrt{\sigma^2} σ = σ 2 ​ s = s 2 s = \sqrt{s^2} s = s 2 ​
• Proportion p = X N p = \frac{X}{N} p = N X ​ p ^ = x n \hat{p} = \frac{x}{n} p ^ ​ = n x ​
• Unbiased Estimators and Bessel's Correction

An estimator θ ^ \hat{\theta} θ ^ is said to be unbiased for a parameter θ \theta θ if its mathematical expectation equals the true parameter value: E [ θ ^ ] = θ E[\hat{\theta}] = \theta E [ θ ^ ] = θ .

Sample Mean Unbiasedness : E [ X ˉ ] = μ E[\bar{X}] = \mu E [ X ˉ ] = μ .

Sample Variance Unbiasedness : If we were to divide by n n n rather than n − 1 n - 1 n − 1 , the expected value would be E [ S n 2 ] = n − 1 n σ 2 < σ 2 E[S_n^2] = \frac{n-1}{n}\sigma^2 < \sigma^2 E [ S n 2 ​ ] = n n − 1 ​ σ 2 < σ 2 , systematically underestimating true population variability. Dividing by n − 1 n - 1 n − 1 is known as Bessel's correction , which adjusts for the fact that sample deviations are measured relative to the sample mean x ˉ \bar{x} x ˉ (which itself minimizes squared deviations) rather than the true parameter μ \mu μ : E [ s 2 ] = E [ 1 n − 1 ∑ i = 1 n ( x i − x ˉ ) 2 ] = σ 2 E[s^2] = E\left[\frac{1}{n - 1}\sum_{i=1}^n (x_i - \bar{x})^2\right] = \sigma^2 E [ s 2 ] = E [ n − 1 1 ​ i = 1 ∑ n ​ ( x i ​ − x ˉ ) 2 ] = σ 2

• 2. Central Limit Theorem (CLT) and the Sampling Distribution of the Mean
• Mathematical Formulation

Let X 1 , X 2 , … , X n X_1, X_2, \dots, X_n X 1 ​ , X 2 ​ , … , X n ​ be an independent and identically distributed (i.i.d.) random sample drawn from any arbitrary population distribution having finite mean μ \mu μ and finite variance σ 2 \sigma^2 σ 2 . As the sample size n n n increases, the sampling distribution of the sample mean X ˉ \bar{X} X ˉ converges in distribution to a normal distribution: X ˉ ∼ N ( μ , σ 2 n ) \bar{X} \sim N\left(\mu, \, \frac{\sigma^2}{n}\right) X ˉ ∼ N ( μ , n σ 2 ​ )

The standardized sample mean statistic converges to the standard normal distribution Z ∼ N ( 0 , 1 ) Z \sim N(0, 1) Z ∼ N ( 0 , 1 ) : Z = X ˉ − μ σ / n → d N ( 0 , 1 ) Z = \frac{\bar{X} - \mu}{\sigma / \sqrt{n}} \xrightarrow{d} N(0, 1) Z = σ / n ​ X ˉ − μ ​ d ​ N ( 0 , 1 )

Standard Error of the Mean

The standard deviation of the sampling distribution of X ˉ \bar{X} X ˉ is designated as the Standard Error of the Mean ( SE \text{SE} SE ): σ x ˉ = σ n \sigma_{\bar{x}} = \frac{\sigma}{\sqrt{n}} σ x ˉ ​ = n ​ σ ​

Key Engineering Insight: The Inverse Square Root Law Because the standard error scales inversely with the square root of sample size ( n \sqrt{n} n ​ ), cutting estimation uncertainty in half requires quadrupling the sample size ( 4 n 4n 4 n ). Reducing error by a factor of 10 requires a 100-fold increase in sampling effort.

Applicability and the Rule of Thumb ( n ≥ 30 n \ge 30 n ≥ 30 )

Normally Distributed Populations : If the parent population is itself normally distributed, X ˉ \bar{X} X ˉ is exactly normally distributed for any sample size ( n ≥ 1 n \ge 1 n ≥ 1 ).

Non-Normal Populations : If the parent population is skewed, uniform, or bimodal, the distribution of X ˉ \bar{X} X ˉ becomes increasingly bell-shaped as n n n grows. By convention in engineering practice and the NCEES reference literature, a sample size of n ≥ 30 n \ge 30 n ≥ 30 is considered sufficiently large for the sampling distribution of X ˉ \bar{X} X ˉ to be approximated by a normal distribution.

3. Student's t-Distribution

In practical manufacturing and industrial environments, the true population standard deviation σ \sigma σ is almost never known. When the sample standard deviation s s s is substituted in place of σ \sigma σ , the standardized test statistic is: T = X ˉ − μ s / n T = \frac{\bar{X} - \mu}{s / \sqrt{n}} T = s / n ​ X ˉ − μ ​

Because s s s is itself a random variable subject to sampling fluctuations, T T T does not follow a standard normal distribution. Instead, when sampling from a normally distributed population, T T T follows Student's t t t -distribution with ν = n − 1 \nu = n - 1 ν = n − 1 degrees of freedom. Standard Normal Z (σ known)

• │
• ┌──┴──┐ Student's t (ν = 4, heavier tails)
• │ │ │
• ┌──┘ └──┐ ┌──┴──┐
• ┌─┘ └─┐ ┌─┘ └─┐
• ─────┴───────────────┴────────┴─────────┴─────
• Core Properties of Student's t-Distribution

Symmetry : Symmetric, continuous, unimodal bell curve centered at zero ( E [ T ] = 0 E[T] = 0 E [ T ] = 0 for ν > 1 \nu > 1 ν > 1 ).

Heavier Tails : The variance of the t t t -distribution is Var ( T ) = ν ν − 2 \text{Var}(T) = \frac{\nu}{\nu - 2} Var ( T ) = ν − 2 ν ​ for ν > 2 \nu > 2 ν > 2 . Because ν ν − 2 > 1 \frac{\nu}{\nu - 2} > 1 ν − 2 ν ​ > 1 , the t t t -distribution exhibits heavier tails than the standard normal distribution, reflecting the extra uncertainty introduced by estimating σ \sigma σ via s s s .

Asymptotic Convergence : As degrees of freedom ν → ∞ \nu \to \infty ν → ∞ , the sample variance s 2 s^2 s 2 converges in probability to σ 2 \sigma^2 σ 2 , and the t t t -distribution approaches the standard normal distribution Z Z Z : lim ⁡ ν → ∞ t α , ν = Z α \lim_{\nu \to \infty} t_{\alpha, \nu} = Z_\alpha ν → ∞ lim ​ t α , ν ​ = Z α ​

4. Confidence Intervals for a Single Population Mean (μ)

A confidence interval (CI) provides an estimated range of values calculated from sample data that is likely to include an unknown population parameter with a specified confidence level 100 ( 1 − α ) % 100(1 - \alpha)\% 100 ( 1 − α ) % .

Case 1: Population Variance σ Known (Z-Interval)

When σ \sigma σ is known and either the underlying population is normal or n ≥ 30 n \ge 30 n ≥ 30 : x ˉ ± Z α / 2 ( σ n ) \bar{x} \pm Z_{\alpha/2} \left(\frac{\sigma}{\sqrt{n}}\right) x ˉ ± Z α /2 ​ ( n ​ σ ​ )

Common critical values for standard normal two-sided intervals:

90 % 90\% 90% Confidence ( α = 0.10 , α / 2 = 0.05 \alpha = 0.10, \alpha/2 = 0.05 α = 0.10 , α /2 = 0.05 ): Z 0.05 = 1.645 Z_{0.05} = 1.645 Z 0.05 ​ = 1.645

95 % 95\% 95% Confidence ( α = 0.05 , α / 2 = 0.025 \alpha = 0.05, \alpha/2 = 0.025 α = 0.05 , α /2 = 0.025 ): Z 0.025 = 1.960 Z_{0.025} = 1.960 Z 0.025 ​ = 1.960

99 % 99\% 99% Confidence ( α = 0.01 , α / 2 = 0.005 \alpha = 0.01, \alpha/2 = 0.005 α = 0.01 , α /2 = 0.005 ): Z 0.005 = 2.576 Z_{0.005} = 2.576 Z 0.005 ​ = 2.576

Case 2: Population Variance σ Unknown (t-Interval)

When σ \sigma σ is unknown and estimated by sample standard deviation s s s (assuming an approximately normal population): x ˉ ± t α / 2 , n − 1 ( s n ) \bar{x} \pm t_{\alpha/2, \, n-1} \left(\frac{s}{\sqrt{n}}\right) x ˉ ± t α /2 , n − 1 ​ ( n ​ s ​ )

where t α / 2 , n − 1 t_{\alpha/2, \, n-1} t α /2 , n − 1 ​ represents the upper α / 2 \alpha/2 α /2 critical value from the Student's t t t -table with ν = n − 1 \nu = n - 1 ν = n − 1 degrees of freedom.

Rigorous Statistical Interpretation of Confidence Intervals A 95 % 95\% 95% confidence interval does not mean there is a 95 % 95\% 95% probability that the true parameter μ \mu μ falls within the computed numerical bounds. In frequentist statistics, μ \mu μ is a fixed, non-random constant. The correct interpretation is: If an identical sampling procedure is repeated an infinite number of times under identical conditions, 95 % 95\% 95% of the independently constructed confidence intervals will encapsulate the true population mean μ \mu μ .

5. Confidence Intervals for the Difference Between Two Means (μ₁ - μ₂)

Comparing two production lines, supplier batches, or process settings requires two-sample inference. The formulation depends fundamentally on whether samples are independent or paired (dependent) .

Independent Samples: Variances Known ( x ˉ 1 − x ˉ 2 ) ± Z α / 2 σ 1 2 n 1 + σ 2 2 n 2 (\bar{x}_1 - \bar{x}_2) \pm Z_{\alpha/2} \sqrt{\frac{\sigma_1^2}{n_1} + \frac{\sigma_2^2}{n_2}} ( x ˉ 1 ​ − x ˉ 2 ​ ) ± Z α /2 ​ n 1 ​ σ 1 2 ​ ​ + n 2 ​ σ 2 2 ​ ​ ​

Independent Samples: Variances Unknown but Assumed Equal (Pooled t-Interval)

When σ 1 2 = σ 2 2 = σ 2 \sigma_1^2 = \sigma_2^2 = \sigma^2 σ 1 2 ​ = σ 2 2 ​ = σ 2 is unknown, the two sample variances s 1 2 s_1^2 s 1 2 ​ and s 2 2 s_2^2 s 2 2 ​ are combined into a weighted average known as the pooled sample variance s p 2 s_p^2 s p 2 ​ : s p 2 = ( n 1 − 1 ) s 1 2 + ( n 2 − 1 ) s 2 2 n 1 + n 2 − 2 s_p^2 = \frac{(n_1 - 1)s_1^2 + (n_2 - 1)s_2^2}{n_1 + n_2 - 2} s p 2 ​ = n 1 ​ + n 2 ​ − 2 ( n 1 ​ − 1 ) s 1 2 ​ + ( n 2 ​ − 1 ) s 2 2 ​ ​

The confidence interval is: ( x ˉ 1 − x ˉ 2 ) ± t α / 2 , n 1 + n 2 − 2 ⋅ s p 1 n 1 + 1 n 2 (\bar{x}_1 - \bar{x}_2) \pm t_{\alpha/2, \, n_1+n_2-2} \cdot s_p \sqrt{\frac{1}{n_1} + \frac{1}{n_2}} ( x ˉ 1 ​ − x ˉ 2 ​ ) ± t α /2 , n 1 ​ + n 2 ​ − 2 ​ ⋅ s p ​ n 1 ​ 1 ​ + n 2 ​ 1 ​ ​

with pooled degrees of freedom ν = n 1 + n 2 − 2 \nu = n_1 + n_2 - 2 ν = n 1 ​ + n 2 ​ − 2 .

Independent Samples: Variances Unknown and Unequal (Welch's t-Interval)

When σ 1 2 ≠ σ 2 2 \sigma_1^2 \neq \sigma_2^2 σ 1 2 ​  = σ 2 2 ​ , pooling is invalid. The confidence interval utilizes the unpooled standard error: ( x ˉ 1 − x ˉ 2 ) ± t α / 2 , ν s 1 2 n 1 + s 2 2 n 2 (\bar{x}_1 - \bar{x}_2) \pm t_{\alpha/2, \, \nu} \sqrt{\frac{s_1^2}{n_1} + \frac{s_2^2}{n_2}} ( x ˉ 1 ​ − x ˉ 2 ​ ) ± t α /2 , ν ​ n 1 ​ s 1 2 ​ ​ + n 2 ​ s 2 2 ​ ​ ​

where the effective degrees of freedom ν \nu ν is determined via the Welch-Satterthwaite approximation (rounded down to the nearest integer): ν = ( s 1 2 n 1 + s 2 2 n 2 ) 2 ( s 1 2 / n 1 ) 2 n 1 − 1 + ( s 2 2 / n 2 ) 2 n 2 − 1 \nu = \frac{\left(\frac{s_1^2}{n_1} + \frac{s_2^2}{n_2}\right)^2}{\frac{(s_1^2/n_1)^2}{n_1 - 1} + \frac{(s_2^2/n_2)^2}{n_2 - 1}} ν = n 1 ​ − 1 ( s 1 2 ​ / n 1 ​ ) 2 ​ + n 2 ​ − 1 ( s 2 2 ​ / n 2 ​ ) 2 ​ ( n 1 ​ s 1 2 ​ ​ + n 2 ​ s 2 2 ​ ​ ) 2 ​

Paired (Dependent) Samples (Paired t-Interval)

When observations in sample 1 naturally pair with observations in sample 2 (e.g., measuring worker cycle time before and after ergonomic training on the same n n n operators), the bivariate problem collapses to a single sample of differences: d i = x 1 i − x 2 i , i = 1 , 2 , … , n d_i = x_{1i} - x_{2i}, \quad i = 1, 2, \dots, n d i ​ = x 1 i ​ − x 2 i ​ , i = 1 , 2 , … , n d ˉ = 1 n ∑ i = 1 n d i , s d = ∑ i = 1 n ( d i − d ˉ ) 2 n − 1 \bar{d} = \frac{1}{n}\sum_{i=1}^n d_i, \quad s_d = \sqrt{\frac{\sum_{i=1}^n (d_i - \bar{d})^2}{n - 1}} d ˉ = n 1 ​ i = 1 ∑ n ​ d i ​ , s d ​ = n − 1 ∑ i = 1 n ​ ( d i ​ − d ˉ ) 2 ​ ​

The paired confidence interval is constructed with ν = n − 1 \nu = n - 1 ν = n − 1 degrees of freedom: d ˉ ± t α / 2 , n − 1 ( s d n ) \bar{d} \pm t_{\alpha/2, \, n-1} \left(\frac{s_d}{\sqrt{n}}\right) d ˉ ± t α /2 , n − 1 ​ ( n ​ s d ​ ​ )

• 6. Confidence Intervals for Proportions and Differences in Proportions
• Single Population Proportion (p)

Let x x x be the number of successes (e.g., non-defective parts) observed in a random sample of size n n n , with point estimator p ^ = x / n \hat{p} = x / n p ^ ​ = x / n . When both n p ^ ≥ 10 n\hat{p} \ge 10 n p ^ ​ ≥ 10 and n ( 1 − p ^ ) ≥ 10 n(1 - \hat{p}) \ge 10 n ( 1 − p ^ ​ ) ≥ 10 , the normal approximation to the binomial distribution applies: p ^ ± Z α / 2 p ^ ( 1 − p ^ ) n \hat{p} \pm Z_{\alpha/2} \sqrt{\frac{\hat{p}(1 - \hat{p})}{n}} p ^ ​ ± Z α /2 ​ n p ^ ​ ( 1 − p ^ ​ ) ​ ​

Difference Between Two Proportions (p₁ - p₂)

For two independent random samples of sizes n 1 n_1 n 1 ​ and n 2 n_2 n 2 ​ : ( p ^ 1 − p ^ 2 ) ± Z α / 2 p ^ 1 ( 1 − p ^ 1 ) n 1 + p ^ 2 ( 1 − p ^ 2 ) n 2 (\hat{p}_1 - \hat{p}_2) \pm Z_{\alpha/2} \sqrt{\frac{\hat{p}_1(1 - \hat{p}_1)}{n_1} + \frac{\hat{p}_2(1 - \hat{p}_2)}{n_2}} ( p ^ ​ 1 ​ − p ^ ​ 2 ​ ) ± Z α /2 ​ n 1 ​ p ^ ​ 1 ​ ( 1 − p ^ ​ 1 ​ ) ​ + n 2 ​ p ^ ​ 2 ​ ( 1 − p ^ ​ 2 ​ ) ​ ​

7. Confidence Interval for Population Variance (σ²)

Estimating process consistency is central to Six Sigma and statistical tolerance design. When sampling from a normal population, the transformed variable follows a Chi-Square ( χ 2 \chi^2 χ 2 ) distribution with ν = n − 1 \nu = n - 1 ν = n − 1 degrees of freedom: ( n − 1 ) s 2 σ 2 ∼ χ n − 1 2 \frac{(n - 1)s^2}{\sigma^2} \sim \chi_{n-1}^2 σ 2 ( n − 1 ) s 2 ​ ∼ χ n − 1 2 ​

Because the Chi-Square distribution is non-negative and asymmetric (skewed right for small ν \nu ν ), the two-sided 100 ( 1 − α ) % 100(1 - \alpha)\% 100 ( 1 − α ) % confidence interval for σ 2 \sigma^2 σ 2 is bounded by two distinct critical values: ( n − 1 ) s 2 χ α / 2 , n − 1 2 ≤ σ 2 ≤ ( n − 1 ) s 2 χ 1 − α / 2 , n − 1 2 \frac{(n - 1)s^2}{\chi_{\alpha/2, \, n-1}^2} \le \sigma^2 \le \frac{(n - 1)s^2}{\chi_{1 - \alpha/2, \, n-1}^2} χ α /2 , n − 1 2 ​ ( n − 1 ) s 2 ​ ≤ σ 2 ≤ χ 1 − α /2 , n − 1 2 ​ ( n − 1 ) s 2 ​

Taking square roots provides the confidence interval for the population standard deviation σ \sigma σ .

Crucial Chi-Square Denominator Inversion Notice that the upper critical value χ α / 2 , n − 1 2 \chi_{\alpha/2, \, n-1}^2 χ α /2 , n − 1 2 ​ (the larger number from the right tail) divides the numerator to form the lower confidence limit , while the lower critical value χ 1 − α / 2 , n − 1 2 \chi_{1 - \alpha/2, \, n-1}^2 χ 1 − α /2 , n − 1 2 ​ (the smaller number from the left tail) divides the numerator to form the upper confidence limit .

8. Sample Size Determination for Specified Margin of Error

Designing sampling audits requires determining the minimum sample size n n n necessary to achieve an acceptable margin of error E E E at a specified confidence level 100 ( 1 − α ) % 100(1 - \alpha)\% 100 ( 1 − α ) % .

Sample Size for Estimating a Population Mean (μ)

The half-width margin of error is E = Z α / 2 σ n E = Z_{\alpha/2} \frac{\sigma}{\sqrt{n}} E = Z α /2 ​ n ​ σ ​ . Solving algebraically for n n n : n = ( Z α / 2 ⋅ σ E ) 2 n = \left( \frac{Z_{\alpha/2} \cdot \sigma}{E} \right)^2 n = ( E Z α /2 ​ ⋅ σ ​ ) 2

Rule : Always round n n n up to the nearest integer (ceiling function ⌈ n ⌉ \lceil n \rceil ⌈ n ⌉ ) to guarantee that the achieved margin of error does not exceed E E E .

Sample Size for Estimating a Population Proportion (p)

The half-width margin of error is E = Z α / 2 p ( 1 − p ) n E = Z_{\alpha/2} \sqrt{\frac{p(1 - p)}{n}} E = Z α /2 ​ n p ( 1 − p ) ​ ​ . Solving for n n n : n = ( Z α / 2 E ) 2 p ( 1 − p ) n = \left( \frac{Z_{\alpha/2}}{E} \right)^2 p(1 - p) n = ( E Z α /2 ​ ​ ) 2 p ( 1 − p )

If a reliable historical estimate of p p p is available, substitute that value.

If no preliminary estimate exists, use the conservative value p = 0.5 p = 0.5 p = 0.5 , which maximizes the product p ( 1 − p ) = 0.25 p(1 - p) = 0.25 p ( 1 − p ) = 0.25 , guaranteeing the resulting sample size will satisfy the margin of error regardless of the true proportion.

• 9. Step-by-Step Worked Engineering Examples
• Worked Example 7.1.1: CNC Lathe Shaft Tolerance and Sample Size Sizing

Problem : A precision machining cell turns steel drive shafts. Historical tool wear data indicates that shaft diameter standard deviation is σ = 0.040 mm \sigma = 0.040\text{ mm} σ = 0.040 mm .

A random sample of n = 16 n = 16 n = 16 shafts yields a sample mean of x ˉ = 25.018 mm \bar{x} = 25.018\text{ mm} x ˉ = 25.018 mm . Construct a 95 % 95\% 95% confidence interval for the true mean diameter μ \mu μ .

Quality management mandates that the true mean diameter must be estimated within a margin of error of E = ± 0.007 mm E = \pm 0.007\text{ mm} E = ± 0.007 mm with 95 % 95\% 95% confidence. What is the minimum sample size required?

Solution :

Confidence Interval Calculation :

Parameters: σ = 0.040 mm \sigma = 0.040\text{ mm} σ = 0.040 mm , n = 16 n = 16 n = 16 , x ˉ = 25.018 mm \bar{x} = 25.018\text{ mm} x ˉ = 25.018 mm , confidence level = 95 % = 95\% = 95% .

Critical value: Z α / 2 = Z 0.025 = 1.960 Z_{\alpha/2} = Z_{0.025} = 1.960 Z α /2 ​ = Z 0.025 ​ = 1.960 .

Standard error: σ x ˉ = σ n = 0.040 16 = 0.040 4 = 0.010 mm \sigma_{\bar{x}} = \frac{\sigma}{\sqrt{n}} = \frac{0.040}{\sqrt{16}} = \frac{0.040}{4} = 0.010\text{ mm} σ x ˉ ​ = n ​ σ ​ = 16 ​ 0.040 ​ = 4 0.040 ​ = 0.010 mm .

Margin of error: E = Z 0.025 ⋅ σ x ˉ = 1.960 × 0.010 = 0.0196 mm E = Z_{0.025} \cdot \sigma_{\bar{x}} = 1.960 \times 0.010 = 0.0196\text{ mm} E = Z 0.025 ​ ⋅ σ x ˉ ​ = 1.960 × 0.010 = 0.0196 mm .

Confidence Interval: CI = 25.018 ± 0.0196 = [ 24.9984 mm , 25.0376 mm ] \text{CI} = 25.018 \pm 0.0196 = [24.9984\text{ mm}, \, 25.0376\text{ mm}] CI = 25.018 ± 0.0196 = [ 24.9984 mm , 25.0376 mm ]

Sample Size Determination :

Target margin of error: E = 0.007 mm E = 0.007\text{ mm} E = 0.007 mm .

Using the sample size formula: n = ( Z α / 2 ⋅ σ E ) 2 = ( 1.960 × 0.040 0.007 ) 2 = ( 0.0784 0.007 ) 2 = ( 11.2 ) 2 = 125.44 n = \left( \frac{Z_{\alpha/2} \cdot \sigma}{E} \right)^2 = \left( \frac{1.960 \times 0.040}{0.007} \right)^2 = \left( \frac{0.0784}{0.007} \right)^2 = (11.2)^2 = 125.44 n = ( E Z α /2 ​ ⋅ σ ​ ) 2 = ( 0.007 1.960 × 0.040 ​ ) 2 = ( 0.007 0.0784 ​ ) 2 = ( 11.2 ) 2 = 125.44

Applying the integer ceiling rule: n = ⌈ 125.44 ⌉ = 126 n = \lceil 125.44 \rceil = 126 n = ⌈ 125.44 ⌉ = 126 .

Final Answer: A minimum sample of 126 126 126 shafts must be measured.

Worked Example 7.1.2: Ergonomic Workstation Re-Design Paired Study

Problem : An industrial engineer measures assembly cycle times (in seconds) for 6 6 6 operators before and after implementing a tilted fixture and gravity-fed parts bins. The observed differences ( d i = t before − t after d_i = t_{\text{before}} - t_{\text{after}} d i ​ = t before ​ − t after ​ ) are: + 4.2 s , + 1.8 s , + 3.5 s , − 0.5 s , + 2.6 s , + 3.4 s +4.2\text{ s}, \; +1.8\text{ s}, \; +3.5\text{ s}, \; -0.5\text{ s}, \; +2.6\text{ s}, \; +3.4\text{ s} + 4.2 s , + 1.8 s , + 3.5 s , − 0.5 s , + 2.6 s , + 3.4 s

Construct a 90 % 90\% 90% confidence interval for the true mean reduction in assembly cycle time μ d \mu_d μ d ​ .

Solution :

Compute Sample Statistics for Differences :

Sample size: n = 6 n = 6 n = 6 .

Sum of differences: ∑ d i = 4.2 + 1.8 + 3.5 − 0.5 + 2.6 + 3.4 = 15.0 s \sum d_i = 4.2 + 1.8 + 3.5 - 0.5 + 2.6 + 3.4 = 15.0\text{ s} ∑ d i ​ = 4.2 + 1.8 + 3.5 − 0.5 + 2.6 + 3.4 = 15.0 s .

Mean difference: d ˉ = 15.0 6 = 2.50 s \bar{d} = \frac{15.0}{6} = 2.50\text{ s} d ˉ = 6 15.0 ​ = 2.50 s .

Sum of squared deviations: ∑ ( d i − d ˉ ) 2 = ( 1.7 ) 2 + ( − 0.7 ) 2 + ( 1.0 ) 2 + ( − 3.0 ) 2 + ( 0.1 ) 2 + ( 0.9 ) 2 = 2.89 + 0.49 + 1.00 + 9.00 + 0.01 + 0.81 = 14.20 \sum (d_i - \bar{d})^2 = (1.7)^2 + (-0.7)^2 + (1.0)^2 + (-3.0)^2 + (0.1)^2 + (0.9)^2 = 2.89 + 0.49 + 1.00 + 9.00 + 0.01 + 0.81 = 14.20 ∑ ( d i ​ − d ˉ ) 2 = ( 1.7 ) 2 + ( − 0.7 ) 2 + ( 1.0 ) 2 + ( − 3.0 ) 2 + ( 0.1 ) 2 + ( 0.9 ) 2 = 2.89 + 0.49 + 1.00 + 9.00 + 0.01 + 0.81 = 14.20 .

Sample variance: s d 2 = 14.20 6 − 1 = 2.84 s 2 s_d^2 = \frac{14.20}{6 - 1} = 2.84\text{ s}^2 s d 2 ​ = 6 − 1 14.20 ​ = 2.84 s 2 .

Sample standard deviation: s d = 2.84 ≈ 1.6852 s s_d = \sqrt{2.84} \approx 1.6852\text{ s} s d ​ = 2.84 ​ ≈ 1.6852 s .

Identify Critical Value :

Degrees of freedom: ν = n − 1 = 6 − 1 = 5 \nu = n - 1 = 6 - 1 = 5 ν = n − 1 = 6 − 1 = 5 .

Confidence level: 90 % ⟹ α = 0.10 ⟹ α / 2 = 0.05 90\% \implies \alpha = 0.10 \implies \alpha/2 = 0.05 90% ⟹ α = 0.10 ⟹ α /2 = 0.05 .

From the Student's t t t -table: t 0.05 , 5 = 2.015 t_{0.05, \, 5} = 2.015 t 0.05 , 5 ​ = 2.015 .

Compute Confidence Interval : Margin of Error = t 0.05 , 5 ( s d n ) = 2.015 ( 1.6852 6 ) = 2.015 × 0.6880 ≈ 1.386 s \text{Margin of Error} = t_{0.05, 5} \left(\frac{s_d}{\sqrt{n}}\right) = 2.015 \left(\frac{1.6852}{\sqrt{6}}\right) = 2.015 \times 0.6880 \approx 1.386\text{ s} Margin of Error = t 0.05 , 5 ​ ( n ​ s d ​ ​ ) = 2.015 ( 6 ​ 1.6852 ​ ) = 2.015 × 0.6880 ≈ 1.386 s CI = 2.50 ± 1.386 = [ 1.114 s , 3.886 s ] \text{CI} = 2.50 \pm 1.386 = [1.114\text{ s}, \, 3.886\text{ s}] CI = 2.50 ± 1.386 = [ 1.114 s , 3.886 s ]

Engineering Conclusion : Because the entire interval is strictly positive ( 1.11 s 1.11\text{ s} 1.11 s to 3.89 s 3.89\text{ s} 3.89 s ), the engineer can conclude with 90 % 90\% 90% confidence that the ergonomic fixture provides a statistically significant mean cycle time reduction of at least 1.11 1.11 1.11 seconds per cycle.

10. NCEES Reference Handbook Tips & Realistic Exam Traps

Sample Size Rounding Trap : Never round sample size determinations down. In Worked Example 7.1.1, rounding 125.44 125.44 125.44 down to 125 125 125 would yield an actual margin of error slightly larger than the prescribed 0.007 mm 0.007\text{ mm} 0.007 mm , violating the engineering specification. Always round up to the next whole integer.

Z-Test vs. t-Test Selection : Look carefully at the problem statement. If the problem specifies "a sample of 15 15 15 items has a standard deviation of 0.5 0.5 0.5 ", that is s s s (sample standard deviation), requiring a t t t -distribution. Only use Z Z Z if the problem explicitly says "the population standard deviation is known to be σ \sigma σ " or if sample size n n n is very large.

Paired vs. Independent Two-Sample Traps : If the same subjects, machines, or parts are tested before-and-after or under two operating conditions, do not use the two-sample pooled t t t -test. You must treat it as a paired t t t -test ( n − 1 n - 1 n − 1 degrees of freedom, not 2 n − 2 2n - 2 2 n − 2 ). Failing to account for pairing inflates the standard error by ignoring the covariance between paired observations.

Chi-Square Upper/Lower Tail Identification : The FE reference handbook tables often list χ α , ν 2 \chi^2_{\alpha, \nu} χ α , ν 2 ​ as the upper tail area. Be certain to verify whether your table lists upper-tail percentiles or cumulative probabilities so you do not accidentally invert the confidence bounds.