Study guide
8.1 Design of Experiments: Objectives, Terminology, and Effects
ASQ Certified Six Sigma Black Belt CSSBB
Track your progress as you read
Finished sections get a check mark.
1 Chapter 1: Introduction & CSSBB Exam Strategy
1.1 CSSBB Exam Format, Scoring, and Testing Windows 1.2 Eligibility, Project Affidavits, Application, and Recertification 1.3 Open-Book Strategy, Reference Materials, and a 16-Week Study Plan
2 Chapter 2: Organization-Wide Planning and Deployment
2.1 Fundamentals of Six Sigma and Lean Methodologies 2.2 Selecting the Right Methodology: DMAIC, DFSS, and Lean 2.3 Business Systems, Processes, and Stakeholder Relationships 2.4 Strategic Planning and Deployment of Six Sigma Initiatives 2.5 Six Sigma Roles and Responsibilities 2.6 Organizational Barriers and Common Causes of Six Sigma Failure 2.7 Change Management: Stakeholder Analysis, Readiness, and Communication
3 Chapter 3: Organizational Process Management and Measures
3.1 Impact of Six Sigma Projects on Customers, Suppliers, and Stakeholders 3.2 Benchmarking Types and Performance Goal Setting 3.3 Performance Measures: Balanced Scorecard, KPIs, KBIs, OKRs, and Line of Sight 3.4 Leading and Lagging Indicators and Performance Dashboards 3.5 Financial Measures: Revenue Growth, Margin, NPV, ROI, and Cost-Benefit Analysis 3.6 Cost of Poor Quality and Hard versus Soft Savings
4 Chapter 4: Team Management
4.1 Team Types and Constraints 4.2 Team Roles, Responsibilities, and Member Selection 4.3 Team Success Factors and Ground Rules 4.4 Motivational Techniques and Overcoming Demotivators 4.5 Stages of Team Development and Conflict Resolution 4.6 Team Communication Plans 4.7 Team Leadership Models: Direct, Coach, Support, and Delegate 4.8 Group Behaviors, Conflict Resolution, and Meeting Management 4.9 Facilitation Techniques and Team Decision-Making Methods 4.10 Team Training: Needs Assessment, Delivery, and Evaluation
5 Chapter 5: Define Phase
5.1 Customer Identification and Segmentation 5.2 Customer Data Collection: Methods, Validity, and Reliability 5.3 Customer Requirements: CTX, CTQ Trees, and Operational Definitions 5.4 The Kano Model and Quality Function Deployment 5.5 SIPOC and Process Mapping 5.6 Business Case Justification 5.7 The Project Charter and the Problem Statement 5.8 Project Scope and Boundaries 5.9 SMART Goals and Project Performance Measurements 5.10 Project Charter Reviews and Toll-Gate Governance 5.11 Project Management Tools: Gantt Charts, Toll-Gate Reviews, WBS, and RACI 5.12 Analytical Tools Used Throughout the DMAIC Cycle
6 Chapter 6: Measure Phase
6.1 Process Flow Metrics and the Hidden Factory 6.2 Process Analysis Tools and Value Stream Mapping 6.3 Types of Data and Measurement Scales 6.4 Sampling Concepts, Methods, and Sample Size for Estimation 6.5 Data Collection Plans and Common Pitfalls 6.6 Gage R&R for Variable Measurement Systems 6.7 Attribute Agreement Analysis and Audit MSA 6.8 Measurement Systems Across the Organization, and Metrology 6.9 Population Parameters, Sample Statistics, and Valid Statistical Conclusions 6.10 Descriptive Statistics: Central Tendency, Dispersion, and Shape 6.11 Graphical Methods for Exploratory Data Analysis 6.12 Probability Concepts, Common Distributions, and the Central Limit Theorem 6.13 Additional Distributions: Hypergeometric, Exponential, Lognormal, Weibull, and Bivariate 6.14 Process Capability and Performance Indices 6.15 Capability Studies, Attributes Capability, Yield Metrics, and Long-Term Capability
7 Chapter 7: Analyze Phase
7.1 The Correlation Coefficient, Its Confidence Interval, and Causation 7.2 Linear Regression and Residual Analysis 7.3 Multivariate Tools: Factor Analysis, Discriminant Analysis, and MANOVA 7.4 Hypothesis Testing Terminology, Errors, and Single-Sample Tests 7.5 Statistical Versus Practical Significance 7.6 Sample Size for Hypothesis Tests 7.7 Point Estimates, Confidence, Prediction, and Tolerance Intervals 7.8 Tests for Means, Variances, and Proportions 7.9 Analysis of Variance 7.10 Chi-Square Goodness-of-Fit and Tests of Independence 7.11 Types of Risk and Failure Mode and Effects Analysis 7.12 Gap Analysis and Root Cause Analysis 7.13 Waste Analysis: The Seven Classic Wastes and Resource Under-Utilization
8 Chapter 8: Improve Phase
8.1 Design of Experiments: Objectives, Terminology, and Effects 8.2 DOE Design Principles: Randomization, Blocking, Replication, and Resolution 8.3 Planning and Evaluating Designed Experiments 8.4 One-Factor Experiments: Completely Randomized, Randomized Block, and Latin Square Designs 8.5 Full Factorial Experiments and Design Selection 8.6 Two-Level Fractional Factorial Experiments and Confounding 8.7 Response Surface Methodology and Optimization 8.8 Waste Elimination: Pull Systems, Kanban, 5S, and Poka-Yoke 8.9 Cycle-Time Reduction: Continuous Flow, SMED, and Heijunka 8.10 Kaizen, Kaizen Blitz, Theory of Constraints, and OEE 8.11 Implementation Planning, Piloting, and Solution Selection
9 Chapter 9: Control Phase
9.1 SPC Objectives, Variable Selection, and Rational Subgrouping 9.2 Control Charts for Variables Data 9.3 Control Charts for Attributes Data 9.4 Short-Run SPC and Moving Average Charts 9.5 Control Chart Analysis: Common Cause, Special Cause, and Run Rules 9.6 Total Productive Maintenance and Visual Controls 9.7 Measurement System Reanalysis 9.8 Control Plan Development and Process Owner Handoff 9.9 Lessons Learned, Documentation, and Training for Sustainment 9.10 Ongoing Evaluation of the Improved Process
10 Chapter 10: Design for Six Sigma (DFSS)
10.1 DFSS Frameworks: DMADV, DMADOV, and Design Transfer 10.2 Design for X (DFX) 10.3 Robust Design, Parameter Design, and Verification 10.4 Tolerance Design and Statistical Tolerancing
8.1 Design of Experiments: Objectives, Terminology, and Effects
Key Takeaways Explain This Topic AI
Design of Experiments (DOE) is a structured statistical approach that systematically manipulates input factors (X's) to evaluate their direct main effects and interactive impacts on critical output responses (Y's).
The three fundamental principles of experimental design are Randomization (protects against lurking variable bias and time-order trends), Replication (enables calculation of pure experimental error variance σ²), and Blocking (isolates known nuisance sources of variation).
Main Effect of a factor measures the average change in response produced by changing a factor from its low (-1) level to its high (+1) level: E_A = Y_bar_{A+} - Y_bar_{A-}.
An Interaction Effect occurs when the impact of one factor on the response variable depends on the specific level setting of another factor, indicated graphically by non-parallel or intersecting lines.
DOE follows a structured, sequential strategy progressing from screening designs (identifying active factors) to characterization factorials, optimization (RSM), and Taguchi robust designs.
Last updated: August 2026
DOE Objectives and Strategic Framework
In the Six Sigma Improve Phase , Design of Experiments (DOE) is the definitive statistical methodology used to optimize process parameters, establish cause-and-effect relationships between process inputs ( X X X 's) and key outputs ( Y Y Y 's), and uncover complex factor interactions.
Traditional engineering approaches rely on One-Factor-at-a-Time (OFAT) experimentation, where an experimenter changes a single factor while holding all others constant. OFAT is fundamentally flawed because:
It cannot detect interaction effects between input factors.
It requires significantly more experimental runs to achieve equivalent statistical power.
It often leads to false local optima.
Sequential DOE Strategy
DOE is executed sequentially across four strategic stages:
Screening : Identifying the few critical vital factors ( X X X 's) out of many potential inputs using Resolution III or IV fractional factorials.
Characterization : Quantifying main effects and two-factor interactions using 2 k 2^k 2 k full factorials or Resolution V fractional factorials.
Optimization : Modeling quadratic non-linear curves to locate optimal operational settings using Response Surface Methodology (RSM).
Robustness Testing : Ensuring process settings remain immune to uncontrollable environmental or raw material noise factors using Taguchi designs.
Key DOE Terminology
Understanding standardized DOE terminology is essential for the CSSBB exam:
Term Definition & Context Practical Process Example
Factor ( X X X ) An independent process variable directly manipulated by the experimenter. Temperature, Pressure, Concentration.
Level A specific setting or value assigned to a factor during an experiment. Temperature Low (-1) = 150°C, High (+1) = 200°C.
Treatment A specific combination of factor levels tested in a single experimental run. Run with Temp = 200°C (+1) and Pressure = 50 psi (-1).
Run A single unit of execution or observation under specified treatment settings. Performing one weld cycle under defined settings.
Response ( Y Y Y ) The measured dependent outcome variable evaluating process performance. Weld Shear Strength (psi), Yield Rate (%).
Experimental Unit The smallest physical entity to which a treatment is independently applied. A single silicon wafer, a discrete steel coupon.
Covariate An uncontrolled, continuous variable measured during the experiment to adjust for nuisance effects statistically. Ambient relative humidity during adhesive curing.
Noise Factor An uncontrollable or expensive-to-control variable causing response variation. Shift operator technique, raw material batch variation.
Crossed factors Every level of one factor is run with every level of the other, which is what makes an interaction estimable. Each of 3 temperatures run on each of 2 machines.
Nested factor A factor whose levels are unique to a single level of another factor rather than shared across them. Operators 1-3 work only line A and operators 4-6 only line B; batches within a supplier.
Nesting is a design property, not a choice of analysis. Because operator 1 never appears on line B, there is no operator-by-line cell to compare, so the interaction simply does not exist and cannot be estimated. A nested (hierarchical) design therefore reports variance components -- how much of the total variation lives between lines, between operators within a line, and within an operator -- rather than main effects and interactions. Analyzing nested data as though it were crossed is a standard exam trap; the tell is that a factor's levels carry different meanings under each level of the factor above it. Gage R&R is the familiar case: parts crossed with operators when every operator measures every part, nested when they cannot (destructive testing).
Calculating Main Effects and Interaction Effects
For a standard two-level 2 2 2^2 2 2 factorial design evaluating Factors A A A and B B B , four treatment combinations exist: ( 1 ) (1) ( 1 ) , a a a , b b b , and a b ab ab , where lowercase letters represent the high (+1) level of that factor:
- Run Factor A Factor B Coded AB Interaction Response ( Y Y Y )
- 1 -1 -1 +1 Y ( 1 ) Y_{(1)} Y ( 1 )
- 2 +1 -1 -1 Y a Y_{a} Y a
- 3 -1 +1 -1 Y b Y_{b} Y b
- 4 +1 +1 +1 Y a b Y_{ab} Y ab
- Main Effect Calculation
The Main Effect of Factor A A A ( E A E_A E A ) measures the average change in response when Factor A A A moves from its low (-1) setting to its high (+1) setting: E A = Y ˉ A + − Y ˉ A − = Y a + Y a b 2 − Y ( 1 ) + Y b 2 E_A = \bar{Y}_{A+} - \bar{Y}_{A-} = \frac{Y_a + Y_{ab}}{2} - \frac{Y_{(1)} + Y_b}{2} E A = Y ˉ A + − Y ˉ A − = 2 Y a + Y ab − 2 Y ( 1 ) + Y b
Similarly, the Main Effect of Factor B B B ( E B E_B E B ) is: E B = Y ˉ B + − Y ˉ B − = Y b + Y a b 2 − Y ( 1 ) + Y a 2 E_B = \bar{Y}_{B+} - \bar{Y}_{B-} = \frac{Y_b + Y_{ab}}{2} - \frac{Y_{(1)} + Y_a}{2} E B = Y ˉ B + − Y ˉ B − = 2 Y b + Y ab − 2 Y ( 1 ) + Y a
Interaction Effect Calculation
An Interaction Effect ( I N T A B INT_{AB} I N T A B ) measures the degree to which the effect of Factor A A A depends on the level of Factor B B B . It is calculated as half the difference between the effect of Factor A A A at the high level of B B B and the effect of Factor A A A at the low level of B B B : I N T A B = 1 2 [ ( Y a b − Y b ) − ( Y a − Y ( 1 ) ) ] = Y a b + Y ( 1 ) − Y a − Y b 2 INT_{AB} = \frac{1}{2} \left[ (Y_{ab} - Y_b) - (Y_a - Y_{(1)}) \right] = \frac{Y_{ab} + Y_{(1)} - Y_a - Y_b}{2} I N T A B = 2 1 [ ( Y ab − Y b ) − ( Y a − Y ( 1 ) ) ] = 2 Y ab + Y ( 1 ) − Y a − Y b
Graphical Interpretation of Effects
Main Effects Plot : Plots average response values at low and high levels. Steeper slopes indicate stronger main effects.
Interaction Plot : Displays response curves of Factor A A A across both levels of Factor B B B .
Parallel Lines : Zero interaction between factors.
Non-Parallel / Crossing Lines : Strong interaction present. When significant interaction exists, main effects cannot be interpreted independently.
Degrees of Freedom and Sum of Squares in 2 k 2^k 2 k Factorials
In a 2 k 2^k 2 k design with n n n replicates (total runs N t o t a l = n ⋅ 2 k N_{total} = n \cdot 2^k N t o t a l = n ⋅ 2 k ):
Total Degrees of Freedom: D F T o t a l = N t o t a l − 1 DF_{Total} = N_{total} - 1 D F T o t a l = N t o t a l − 1
- Factor Degrees of Freedom: D F F a c t o r = 1 DF_{Factor} = 1 D F F a c t or = 1 (for 2-level factors)
- Error Degrees of Freedom: D F E r r o r = 2 k ( n − 1 ) DF_{Error} = 2^k(n - 1) D F E rror = 2 k ( n − 1 )
The Sum of Squares for any two-level factor effect ( S S F a c t o r SS_{Factor} S S F a c t or ) is computed directly from its effect estimate: S S F a c t o r = N t o t a l 4 ⋅ ( E F a c t o r ) 2 SS_{Factor} = \frac{N_{total}}{4} \cdot (E_{Factor})^2 S S F a c t or = 4 N t o t a l ⋅ ( E F a c t or ) 2
In ANOVA analysis, the variance ratio test F 0 = M S F a c t o r M S E r r o r F_0 = \frac{MS_{Factor}}{MS_{Error}} F 0 = M S E rror M S F a c t or determines statistical significance ( p < 0.05 p < 0.05 p < 0.05 ).