Study guide
3.4 Design of Experiments Foundations
Certified Quality Engineer CQE
Track your progress as you read
Finished sections get a check mark.
1 Chapter 1: Management and Leadership
1.1 Quality Philosophies & Foundations 1.2 Leadership & Organizational Systems 1.3 ASQ Code of Ethics & Professional Standards 1.4 Strategic Planning & Deployment 1.5 Management Infrastructure & Project Management 1.6 Quality Information Systems & Communication 1.7 Financial & Cost of Quality
2 Chapter 2: The Quality System
2.1 Quality Management System Elements & Standards 2.2 Quality Documentation Architecture 2.3 Quality Auditing Principles & Types 2.4 Audit Planning, Execution & Reporting 2.5 Corrective Action & Preventive Action Systems 2.6 Supplier Quality Management 2.7 Customer Relations & Customer Value 2.8 Quality Training Program Design & Effectiveness
3 Chapter 3: Product, Process, and Service Design
3.1 Design Input & Requirements 3.2 Design Review & Verification 3.3 Failure Mode and Effects Analysis 3.4 Design of Experiments Foundations 3.5 Robust Design & Taguchi Methods 3.6 Reliability & Maintainability Concepts 3.7 Reliability Modeling & System Evaluation 3.8 Technical Drawings, Specifications & GD&T
4 Chapter 4: Product and Process Control
4.1 Statistical Process Control Principles 4.2 Variable Control Charts 4.3 Attribute Control Charts 4.4 Process Capability & Performance Analysis 4.5 Acceptance Sampling Plans & Standards 4.6 Metrology, Calibration & Measurement Uncertainty 4.7 Measurement System Analysis (MSA) 4.8 Material Control, Traceability & MRB
5 Chapter 5: Continuous Improvement
5.1 Continuous Improvement Methodologies 5.2 Classic Quality Tools 5.3 Management & Planning Tools 5.4 Lean Tools & Waste Elimination 5.5 Problem-Solving Methodologies & Root Cause Analysis 5.6 Risk Management & Assessment 5.7 Change Management & Team Facilitation
6 Chapter 6: Quantitative Methods and Tools
6.1 Descriptive Statistics & Data Summarization 6.2 Probability Concepts & Distributions 6.3 Sampling Distributions & Central Limit Theorem 6.4 Point & Interval Estimation 6.5 Hypothesis Testing Fundamentals 6.6 Specific Statistical Tests 6.7 Regression & Correlation Analysis
7 Chapter 7: Risk Management & Advanced Quality Engineering
7.1 Risk Identification & Hazard Analysis 7.2 Quantitative Risk Analysis & Modeling 7.3 Risk Mitigation & Control Planning 7.4 Special Process Control & Advanced SPC 7.5 Advanced Statistical Design & Analysis 7.6 Computer Applications & Quality Engineering Software
3.4 Design of Experiments Foundations
Key Takeaways Explain This Topic AI
The three foundational principles of Design of Experiments (DOE) are Randomization (protects against lurking/confounding variables), Replication (estimates experimental error and improves precision), and Blocking (isolates nuisance variables).
A standard full factorial design with k factors at 2 levels requires N = 2^k experimental runs to evaluate all main effects and high-order interaction effects without confounding.
Main Effect of a factor is the average change in response produced by changing that factor from its low level (-) to its high level (+), calculated as Y(+) - Y(-).
Two-factor Interaction occurs when the effect of factor A on the response variable depends on the level setting of factor B, visualized as non-parallel lines on an interaction plot.
Last updated: July 2026
Loading diagram... 2^2 Factorial Design Space Matrix
3.4 Design of Experiments Foundations
Design of Experiments (DOE) is a structured, mathematically optimal methodology used to plan, conduct, analyze, and interpret controlled tests. Unlike legacy One-Factor-At-a-Time (OFAT) experimentation—which changes a single variable while holding all others constant—DOE allows quality engineers to systematically evaluate multiple input factors simultaneously, determine their individual impact, and discover complex factor interactions with a minimal number of experimental runs.
1. Three Core Principles of DOE
Sir Ronald Fisher established the three fundamental pillars of experimental design: +-----------------------------------------------------------------------------------+
- | CORE DOE PRINICIPLES |
- +-------------------+-------------------------------+-------------------------------+
- | RANDOMIZATION | REPLICATION | BLOCKING |
- +-------------------+-------------------------------+-------------------------------+
- | Protects against | Provides estimate of | Isolates known, controllable |
- | lurking variables | experimental error variance | nuisance variables (e.g., |
- | and time-order | and increases statistical | shift, raw material batch, |
- | process drift. | power / precision. | test operator). |
- +-------------------+-------------------------------+-------------------------------+
Randomization: Running experimental trials in a completely randomized sequence. Randomization balances out the effects of unmeasured or uncontrolled lurking variables (such as ambient temperature change, operator fatigue, or machine warm-up drift) across all treatment combinations.
Replication: Repeating independent experimental runs for each factor combination. Replication allows the experimenter to estimate pure experimental error variance ( σ error 2 \sigma^2_{\text{error}} σ error 2 ) and increases the statistical power to detect true effect signals. Note: Repeated measurements of the same physical unit are NOT true replications; they are repeated measures. True replication requires setting up the experimental run again from scratch.
Blocking: A design technique used to isolate and eliminate the variance caused by known, controllable nuisance factors that are not of primary interest (e.g., different raw material batches, different test shifts, or distinct lab instruments). By grouping homogeneous runs into "blocks," nuisance variation is filtered out of the error term.
2. Key DOE Terminology
Factor ( k k k ): An independent variable manipulated by the experimenter (e.g., Temperature, Pressure, Cure Time).
Level: The specific values or settings assigned to a factor. In standard 2-level designs, levels are coded as Low ( − 1 -1 − 1 or − - − ) and High ( + 1 +1 + 1 or + + + ).
Response Variable ( Y Y Y ): The measured output or dependent quality characteristic (e.g., Tensile Strength, Yield %, Surface Roughness).
Treatment Combination: A specific combination of factor levels applied during an experimental run.
Confounding / Aliasing: When the effects of two or more factors or interactions cannot be separated mathematically.
3. Full 2 k 2^k 2 k Factorial Designs
A Full Factorial Design tests all possible combinations of factor levels. When evaluating k k k factors, each at 2 2 2 levels, the total number of experimental runs required for a single replicate N N N is: N = 2 k N = 2^k N = 2 k
For k = 2 k = 2 k = 2 factors: N = 2 2 = 4 N = 2^2 = 4 N = 2 2 = 4 runs.
For k = 3 k = 3 k = 3 factors: N = 2 3 = 8 N = 2^3 = 8 N = 2 3 = 8 runs.
For k = 4 k = 4 k = 4 factors: N = 2 4 = 16 N = 2^4 = 16 N = 2 4 = 16 runs.
If n n n replicates are performed, total runs = n × 2 k = n \times 2^k = n × 2 k .
- 4. Calculating Main Effects and Interactions (Step-by-Step)
- Mathematical Definitions
Main Effect: The average change in response Y Y Y observed when moving a factor from its Low level ( − - − ) to its High level ( + + + ): Effect ( A ) = Y ˉ A + − Y ˉ A − \text{Effect}(A) = \bar{Y}_{A+} - \bar{Y}_{A-} Effect ( A ) = Y ˉ A + − Y ˉ A −
Interaction Effect ( A B AB A B ): Occurs when the effect of Factor A A A depends on the level setting of Factor B B B . Mathematically, it is half the difference between the effect of A A A at the High level of B B B and the effect of A A A at the Low level of B B B : Effect ( A B ) = 1 2 ( [ Y ˉ A + B + − Y ˉ A − B + ] − [ Y ˉ A + B − − Y ˉ A − B − ] ) \text{Effect}(AB) = \frac{1}{2} \left( [\bar{Y}_{A+B+} - \bar{Y}_{A-B+}] - [\bar{Y}_{A+B-} - \bar{Y}_{A-B-}] \right) Effect ( A B ) = 2 1 ( [ Y ˉ A + B + − Y ˉ A − B + ] − [ Y ˉ A + B − − Y ˉ A − B − ] )
Worked Numerical Problem ( 2 2 2^2 2 2 Design)
A process quality engineer investigates a polymer molding process to maximize Tensile Strength ( Y Y Y in MPa).
Factor A: Mold Temperature (Low − = 150 ∘ C - = 150^\circ\text{C} − = 15 0 ∘ C , High + = 180 ∘ C + = 180^\circ\text{C} + = 18 0 ∘ C )
Factor B: Injection Pressure (Low − = 30 psi - = 30\text{ psi} − = 30 psi , High + = 50 psi + = 50\text{ psi} + = 50 psi )
The resulting experimental response table for 4 single-replicate runs is:
- Run # Factor A (Temp) Factor B (Pressure) Coded AB Interaction Tensile Strength Y Y Y (MPa)
- 1 − - − (150) − - − (30) + + + 40
- 2 + + + (180) − - − (30) − - − 52
- 3 − - − (150) + + + (50) − - − 46
- 4 + + + (180) + + + (50) + + + 70
Step 1: Calculate Main Effect of Factor A Y ˉ A + = Y Run 2 + Y Run 4 2 = 52 + 70 2 = 122 2 = 61.0 \bar{Y}_{A+} = \frac{Y_{\text{Run 2}} + Y_{\text{Run 4}}}{2} = \frac{52 + 70}{2} = \frac{122}{2} = 61.0 Y ˉ A + = 2 Y Run 2 + Y Run 4 = 2 52 + 70 = 2 122 = 61.0 Y ˉ A − = Y Run 1 + Y Run 3 2 = 40 + 46 2 = 86 2 = 43.0 \bar{Y}_{A-} = \frac{Y_{\text{Run 1}} + Y_{\text{Run 3}}}{2} = \frac{40 + 46}{2} = \frac{86}{2} = 43.0 Y ˉ A − = 2 Y Run 1 + Y Run 3 = 2 40 + 46 = 2 86 = 43.0 Effect ( A ) = 61.0 − 43.0 = + 18.0 MPa \text{Effect}(A) = 61.0 - 43.0 = +18.0\text{ MPa} Effect ( A ) = 61.0 − 43.0 = + 18.0 MPa
Interpretation: Increasing Mold Temperature from 150°C to 180°C increases average tensile strength by 18.0 MPa.
Step 2: Calculate Main Effect of Factor B Y ˉ B + = Y Run 3 + Y Run 4 2 = 46 + 70 2 = 116 2 = 58.0 \bar{Y}_{B+} = \frac{Y_{\text{Run 3}} + Y_{\text{Run 4}}}{2} = \frac{46 + 70}{2} = \frac{116}{2} = 58.0 Y ˉ B + = 2 Y Run 3 + Y Run 4 = 2 46 + 70 = 2 116 = 58.0 Y ˉ B − = Y Run 1 + Y Run 2 2 = 40 + 52 2 = 92 2 = 46.0 \bar{Y}_{B-} = \frac{Y_{\text{Run 1}} + Y_{\text{Run 2}}}{2} = \frac{40 + 52}{2} = \frac{92}{2} = 46.0 Y ˉ B − = 2 Y Run 1 + Y Run 2 = 2 40 + 52 = 2 92 = 46.0 Effect ( B ) = 58.0 − 46.0 = + 12.0 MPa \text{Effect}(B) = 58.0 - 46.0 = +12.0\text{ MPa} Effect ( B ) = 58.0 − 46.0 = + 12.0 MPa
Interpretation: Increasing Injection Pressure from 30 psi to 50 psi increases average tensile strength by 12.0 MPa.
Step 3: Calculate Interaction Effect AB Y ˉ A B + = Y Run 1 + Y Run 4 2 = 40 + 70 2 = 110 2 = 55.0 \bar{Y}_{AB+} = \frac{Y_{\text{Run 1}} + Y_{\text{Run 4}}}{2} = \frac{40 + 70}{2} = \frac{110}{2} = 55.0 Y ˉ A B + = 2 Y Run 1 + Y Run 4 = 2 40 + 70 = 2 110 = 55.0 Y ˉ A B − = Y Run 2 + Y Run 3 2 = 52 + 46 2 = 98 2 = 49.0 \bar{Y}_{AB-} = \frac{Y_{\text{Run 2}} + Y_{\text{Run 3}}}{2} = \frac{52 + 46}{2} = \frac{98}{2} = 49.0 Y ˉ A B − = 2 Y Run 2 + Y Run 3 = 2 52 + 46 = 2 98 = 49.0 Effect ( A B ) = 55.0 − 49.0 = + 6.0 MPa \text{Effect}(AB) = 55.0 - 49.0 = +6.0\text{ MPa} Effect ( A B ) = 55.0 − 49.0 = + 6.0 MPa
Graphical Representation of Interaction
On an interaction plot ( Y Y Y vs. Factor A level), non-parallel lines indicate the presence of a statistical interaction between Factor A and Factor B: Tensile Strength (MPa)
- 70 | *(A+, B+ = 70)
- 60 | /
- 50 | *(A+, B- = 52) /
- 40 | / *(A-, B+ = 46)
- 30 | *(A-, B- = 40)
- +-------------------------------------------
- Low Temp (150°C) High Temp (180°C)
- Line B- (30 psi) ----
- Line B+ (50 psi) -----
- 5. CQE Exam Tips & Key Pitfalls
Important
For the ASQ CQE exam, memorize the full factorial formula N = 2 k N = 2^k N = 2 k . Be ready to distinguish between replication (re-running the entire setup to measure experimental error) and repeated measures (re-measuring the same part). Remember that non-parallel lines on an interaction plot signal a strong factor interaction!