7.3 Multivariate Tools: Factor Analysis, Discriminant Analysis, and MANOVA

ASQ Certified Six Sigma Black Belt CSSBB

Track your progress as you read

Finished sections get a check mark.

1 Chapter 1: Introduction & CSSBB Exam Strategy

1.1 CSSBB Exam Format, Scoring, and Testing Windows 1.2 Eligibility, Project Affidavits, Application, and Recertification 1.3 Open-Book Strategy, Reference Materials, and a 16-Week Study Plan

2 Chapter 2: Organization-Wide Planning and Deployment

2.1 Fundamentals of Six Sigma and Lean Methodologies 2.2 Selecting the Right Methodology: DMAIC, DFSS, and Lean 2.3 Business Systems, Processes, and Stakeholder Relationships 2.4 Strategic Planning and Deployment of Six Sigma Initiatives 2.5 Six Sigma Roles and Responsibilities 2.6 Organizational Barriers and Common Causes of Six Sigma Failure 2.7 Change Management: Stakeholder Analysis, Readiness, and Communication

3 Chapter 3: Organizational Process Management and Measures

3.1 Impact of Six Sigma Projects on Customers, Suppliers, and Stakeholders 3.2 Benchmarking Types and Performance Goal Setting 3.3 Performance Measures: Balanced Scorecard, KPIs, KBIs, OKRs, and Line of Sight 3.4 Leading and Lagging Indicators and Performance Dashboards 3.5 Financial Measures: Revenue Growth, Margin, NPV, ROI, and Cost-Benefit Analysis 3.6 Cost of Poor Quality and Hard versus Soft Savings

4 Chapter 4: Team Management

4.1 Team Types and Constraints 4.2 Team Roles, Responsibilities, and Member Selection 4.3 Team Success Factors and Ground Rules 4.4 Motivational Techniques and Overcoming Demotivators 4.5 Stages of Team Development and Conflict Resolution 4.6 Team Communication Plans 4.7 Team Leadership Models: Direct, Coach, Support, and Delegate 4.8 Group Behaviors, Conflict Resolution, and Meeting Management 4.9 Facilitation Techniques and Team Decision-Making Methods 4.10 Team Training: Needs Assessment, Delivery, and Evaluation

5 Chapter 5: Define Phase

5.1 Customer Identification and Segmentation 5.2 Customer Data Collection: Methods, Validity, and Reliability 5.3 Customer Requirements: CTX, CTQ Trees, and Operational Definitions 5.4 The Kano Model and Quality Function Deployment 5.5 SIPOC and Process Mapping 5.6 Business Case Justification 5.7 The Project Charter and the Problem Statement 5.8 Project Scope and Boundaries 5.9 SMART Goals and Project Performance Measurements 5.10 Project Charter Reviews and Toll-Gate Governance 5.11 Project Management Tools: Gantt Charts, Toll-Gate Reviews, WBS, and RACI 5.12 Analytical Tools Used Throughout the DMAIC Cycle

6 Chapter 6: Measure Phase

6.1 Process Flow Metrics and the Hidden Factory 6.2 Process Analysis Tools and Value Stream Mapping 6.3 Types of Data and Measurement Scales 6.4 Sampling Concepts, Methods, and Sample Size for Estimation 6.5 Data Collection Plans and Common Pitfalls 6.6 Gage R&R for Variable Measurement Systems 6.7 Attribute Agreement Analysis and Audit MSA 6.8 Measurement Systems Across the Organization, and Metrology 6.9 Population Parameters, Sample Statistics, and Valid Statistical Conclusions 6.10 Descriptive Statistics: Central Tendency, Dispersion, and Shape 6.11 Graphical Methods for Exploratory Data Analysis 6.12 Probability Concepts, Common Distributions, and the Central Limit Theorem 6.13 Additional Distributions: Hypergeometric, Exponential, Lognormal, Weibull, and Bivariate 6.14 Process Capability and Performance Indices 6.15 Capability Studies, Attributes Capability, Yield Metrics, and Long-Term Capability

7 Chapter 7: Analyze Phase

7.1 The Correlation Coefficient, Its Confidence Interval, and Causation 7.2 Linear Regression and Residual Analysis 7.3 Multivariate Tools: Factor Analysis, Discriminant Analysis, and MANOVA 7.4 Hypothesis Testing Terminology, Errors, and Single-Sample Tests 7.5 Statistical Versus Practical Significance 7.6 Sample Size for Hypothesis Tests 7.7 Point Estimates, Confidence, Prediction, and Tolerance Intervals 7.8 Tests for Means, Variances, and Proportions 7.9 Analysis of Variance 7.10 Chi-Square Goodness-of-Fit and Tests of Independence 7.11 Types of Risk and Failure Mode and Effects Analysis 7.12 Gap Analysis and Root Cause Analysis 7.13 Waste Analysis: The Seven Classic Wastes and Resource Under-Utilization

8 Chapter 8: Improve Phase

8.1 Design of Experiments: Objectives, Terminology, and Effects 8.2 DOE Design Principles: Randomization, Blocking, Replication, and Resolution 8.3 Planning and Evaluating Designed Experiments 8.4 One-Factor Experiments: Completely Randomized, Randomized Block, and Latin Square Designs 8.5 Full Factorial Experiments and Design Selection 8.6 Two-Level Fractional Factorial Experiments and Confounding 8.7 Response Surface Methodology and Optimization 8.8 Waste Elimination: Pull Systems, Kanban, 5S, and Poka-Yoke 8.9 Cycle-Time Reduction: Continuous Flow, SMED, and Heijunka 8.10 Kaizen, Kaizen Blitz, Theory of Constraints, and OEE 8.11 Implementation Planning, Piloting, and Solution Selection

9 Chapter 9: Control Phase

9.1 SPC Objectives, Variable Selection, and Rational Subgrouping 9.2 Control Charts for Variables Data 9.3 Control Charts for Attributes Data 9.4 Short-Run SPC and Moving Average Charts 9.5 Control Chart Analysis: Common Cause, Special Cause, and Run Rules 9.6 Total Productive Maintenance and Visual Controls 9.7 Measurement System Reanalysis 9.8 Control Plan Development and Process Owner Handoff 9.9 Lessons Learned, Documentation, and Training for Sustainment 9.10 Ongoing Evaluation of the Improved Process

10 Chapter 10: Design for Six Sigma (DFSS)

10.1 DFSS Frameworks: DMADV, DMADOV, and Design Transfer 10.2 Design for X (DFX) 10.3 Robust Design, Parameter Design, and Verification 10.4 Tolerance Design and Statistical Tolerancing

7.3 Multivariate Tools: Factor Analysis, Discriminant Analysis, and MANOVA

Key Takeaways Explain This Topic AI

Multivariate methods analyze several correlated variables jointly, controlling the error rate that repeated univariate tests inflate.

Factor analysis reduces many correlated variables to a few underlying latent factors and is used to find common sources of variation.

Discriminant analysis finds the combination of predictors that best separates known groups and classifies new observations into them.

MANOVA tests whether group means differ across several dependent variables simultaneously.

Principal component analysis is a variance-maximizing reduction technique closely related to, but distinct from, factor analysis.

Last updated: August 2026

Why multivariate methods exist

Two problems motivate them.

Error rate inflation. Testing 10 responses separately at α = 0.05 \alpha = 0.05 α = 0.05 gives a family-wise error

rate of 1 − 0.95 10 = 0.40 1 - 0.95^{10} = 0.40 1 − 0.9 5 10 = 0.40 . Roughly two chances in five of at least one false positive, before any

real effect exists.

• Missed joint structure. Two responses may each show no significant difference between groups, while
• their combination separates the groups cleanly. Univariate tests examined one variable at a time

cannot see a relationship that lives in the correlation between them.

Tool Question it answers Inputs Output

Factor analysis What small set of underlying factors explains the correlations among many variables? Many correlated continuous variables Latent factors with loadings

Principal component analysis What orthogonal combinations capture the most variance? Many correlated continuous variables Components ranked by variance explained

Discriminant analysis Which combination of predictors best separates known groups, and how do I classify new cases? Continuous predictors, known group labels Discriminant functions, classification rule

MANOVA Do group means differ across several dependent variables at once? One or more categorical factors, several continuous responses Multivariate test statistic and p-value

• Factor analysis
• Factor analysis assumes that a set of observed, correlated variables is driven by a smaller number of
• unobserved latent factors plus variable-specific error. Each observed variable is modelled as a

weighted sum of the factors: X j = λ j 1 F 1 + λ j 2 F 2 + ⋯ + λ j m F m + e j X_j = \lambda_{j1}F_1 + \lambda_{j2}F_2 + \cdots + \lambda_{jm}F_m + e_j X j ​ = λ j 1 ​ F 1 ​ + λ j 2 ​ F 2 ​ + ⋯ + λ jm ​ F m ​ + e j ​

The weights λ j k \lambda_{jk} λ jk ​ are loadings , and a variable's communality is the share of its

variance explained by the common factors.

Uses in Six Sigma:

Survey and VOC reduction. Twenty customer satisfaction questions frequently reduce to three or

four underlying dimensions -- reliability, responsiveness, value -- which then become the CTQs.

• Finding common causes of variation. If eight process measurements load heavily on one factor,
• they are being driven by a shared source such as ambient conditions or a common utility supply, and

chasing them individually is wasted effort.

• Interpretation is helped by rotation , most commonly varimax, which redistributes loadings so each
• variable loads strongly on one factor and weakly on the rest without changing the total variance

explained.

Factor analysis versus principal component analysis

They are often confused, and the distinction is worth knowing:

Factor analysis Principal component analysis

Model Observed variables are caused by latent factors plus unique error Components are weighted sums of the observed variables

• Direction Latent to observed Observed to composite
• Aim Explain the correlation structure Maximize variance captured in the fewest components
• Error term Explicit unique variance per variable None
• Use PCA when the goal is dimension reduction for downstream modelling; use factor analysis when the

goal is to identify an interpretable underlying cause.

Discriminant analysis

Discriminant analysis finds the linear combination of predictors that maximally separates two or more known groups, and then uses it to classify new observations. D = w 1 X 1 + w 2 X 2 + ⋯ + w p X p D = w_1X_1 + w_2X_2 + \cdots + w_pX_p D = w 1 ​ X 1 ​ + w 2 ​ X 2 ​ + ⋯ + w p ​ X p ​

The weights are chosen to maximize the ratio of between-group to within-group variation on D D D .

Six Sigma applications:

Classifying incoming material lots as likely-good or likely-problem from a panel of measured

properties.

Separating warranty-return units from survivors using in-process measurements, which points at the

measurements worth controlling.

Deciding which of several failure modes a unit exhibits from sensor data.

• Key contrast: discriminant analysis has known group labels and predicts membership; cluster analysis
• has no labels and discovers groups. Confusing them is a standard exam distractor. Logistic
• regression addresses a similar problem to two-group discriminant analysis but makes weaker

distributional assumptions and is usually preferred when the predictors are not multivariate normal.

• MANOVA
• MANOVA extends ANOVA to several dependent variables at once. Instead of asking whether group means

differ on one response, it asks whether the vector of means differs.

H 0 H_0 H 0 ​ : the mean vectors of all groups are equal.

H 1 H_1 H 1 ​ : at least one group's mean vector differs.

• Test statistics include Wilks' lambda (the most commonly reported), Pillai's trace, the
• Hotelling-Lawley trace, and Roy's largest root. Pillai's trace is the most robust to violations of

assumptions.

When to use MANOVA rather than several ANOVAs:

When the responses are conceptually related -- tensile strength, elongation, and hardness of the

same specimen.

When the responses are correlated , so separate tests both waste information and inflate the

error rate.

When a difference may exist in the combination of responses rather than in any one of them.

The usual workflow is MANOVA first as an omnibus test; only if it is significant do you examine the

individual responses, which protects the family-wise error rate.

• Assumptions: multivariate normality of the responses within each group, homogeneity of the
• variance-covariance matrices (tested with Box's M), and independent observations. Sample size must

exceed the number of dependent variables in every group, and comfortably so.

Choosing among them

• Situation Tool
• Reduce 25 survey items to a few interpretable dimensions Factor analysis
• Compress 15 correlated sensor readings before regression Principal component analysis
• Predict which of two known failure classes a unit belongs to Discriminant analysis (or logistic regression)
• Compare three suppliers on four correlated material properties at once MANOVA
• Discover previously unknown groupings in process data Cluster analysis
• Monitor several correlated characteristics on one control chart Hotelling's T 2 T^2 T 2 chart
• Two cautions apply to all of them. They need considerably more data than univariate methods -- rules of
• thumb range from 5 to 10 observations per variable as a minimum. And they are tagged Understand in
• the Body of Knowledge: the exam expects you to select the right tool for a described situation, not to

compute Wilks' lambda by hand.