7.1 The Correlation Coefficient, Its Confidence Interval, and Causation

ASQ Certified Six Sigma Black Belt CSSBB

Track your progress as you read

Finished sections get a check mark.

1 Chapter 1: Introduction & CSSBB Exam Strategy

1.1 CSSBB Exam Format, Scoring, and Testing Windows 1.2 Eligibility, Project Affidavits, Application, and Recertification 1.3 Open-Book Strategy, Reference Materials, and a 16-Week Study Plan

2 Chapter 2: Organization-Wide Planning and Deployment

2.1 Fundamentals of Six Sigma and Lean Methodologies 2.2 Selecting the Right Methodology: DMAIC, DFSS, and Lean 2.3 Business Systems, Processes, and Stakeholder Relationships 2.4 Strategic Planning and Deployment of Six Sigma Initiatives 2.5 Six Sigma Roles and Responsibilities 2.6 Organizational Barriers and Common Causes of Six Sigma Failure 2.7 Change Management: Stakeholder Analysis, Readiness, and Communication

3 Chapter 3: Organizational Process Management and Measures

3.1 Impact of Six Sigma Projects on Customers, Suppliers, and Stakeholders 3.2 Benchmarking Types and Performance Goal Setting 3.3 Performance Measures: Balanced Scorecard, KPIs, KBIs, OKRs, and Line of Sight 3.4 Leading and Lagging Indicators and Performance Dashboards 3.5 Financial Measures: Revenue Growth, Margin, NPV, ROI, and Cost-Benefit Analysis 3.6 Cost of Poor Quality and Hard versus Soft Savings

4 Chapter 4: Team Management

4.1 Team Types and Constraints 4.2 Team Roles, Responsibilities, and Member Selection 4.3 Team Success Factors and Ground Rules 4.4 Motivational Techniques and Overcoming Demotivators 4.5 Stages of Team Development and Conflict Resolution 4.6 Team Communication Plans 4.7 Team Leadership Models: Direct, Coach, Support, and Delegate 4.8 Group Behaviors, Conflict Resolution, and Meeting Management 4.9 Facilitation Techniques and Team Decision-Making Methods 4.10 Team Training: Needs Assessment, Delivery, and Evaluation

5 Chapter 5: Define Phase

5.1 Customer Identification and Segmentation 5.2 Customer Data Collection: Methods, Validity, and Reliability 5.3 Customer Requirements: CTX, CTQ Trees, and Operational Definitions 5.4 The Kano Model and Quality Function Deployment 5.5 SIPOC and Process Mapping 5.6 Business Case Justification 5.7 The Project Charter and the Problem Statement 5.8 Project Scope and Boundaries 5.9 SMART Goals and Project Performance Measurements 5.10 Project Charter Reviews and Toll-Gate Governance 5.11 Project Management Tools: Gantt Charts, Toll-Gate Reviews, WBS, and RACI 5.12 Analytical Tools Used Throughout the DMAIC Cycle

6 Chapter 6: Measure Phase

6.1 Process Flow Metrics and the Hidden Factory 6.2 Process Analysis Tools and Value Stream Mapping 6.3 Types of Data and Measurement Scales 6.4 Sampling Concepts, Methods, and Sample Size for Estimation 6.5 Data Collection Plans and Common Pitfalls 6.6 Gage R&R for Variable Measurement Systems 6.7 Attribute Agreement Analysis and Audit MSA 6.8 Measurement Systems Across the Organization, and Metrology 6.9 Population Parameters, Sample Statistics, and Valid Statistical Conclusions 6.10 Descriptive Statistics: Central Tendency, Dispersion, and Shape 6.11 Graphical Methods for Exploratory Data Analysis 6.12 Probability Concepts, Common Distributions, and the Central Limit Theorem 6.13 Additional Distributions: Hypergeometric, Exponential, Lognormal, Weibull, and Bivariate 6.14 Process Capability and Performance Indices 6.15 Capability Studies, Attributes Capability, Yield Metrics, and Long-Term Capability

7 Chapter 7: Analyze Phase

7.1 The Correlation Coefficient, Its Confidence Interval, and Causation 7.2 Linear Regression and Residual Analysis 7.3 Multivariate Tools: Factor Analysis, Discriminant Analysis, and MANOVA 7.4 Hypothesis Testing Terminology, Errors, and Single-Sample Tests 7.5 Statistical Versus Practical Significance 7.6 Sample Size for Hypothesis Tests 7.7 Point Estimates, Confidence, Prediction, and Tolerance Intervals 7.8 Tests for Means, Variances, and Proportions 7.9 Analysis of Variance 7.10 Chi-Square Goodness-of-Fit and Tests of Independence 7.11 Types of Risk and Failure Mode and Effects Analysis 7.12 Gap Analysis and Root Cause Analysis 7.13 Waste Analysis: The Seven Classic Wastes and Resource Under-Utilization

8 Chapter 8: Improve Phase

8.1 Design of Experiments: Objectives, Terminology, and Effects 8.2 DOE Design Principles: Randomization, Blocking, Replication, and Resolution 8.3 Planning and Evaluating Designed Experiments 8.4 One-Factor Experiments: Completely Randomized, Randomized Block, and Latin Square Designs 8.5 Full Factorial Experiments and Design Selection 8.6 Two-Level Fractional Factorial Experiments and Confounding 8.7 Response Surface Methodology and Optimization 8.8 Waste Elimination: Pull Systems, Kanban, 5S, and Poka-Yoke 8.9 Cycle-Time Reduction: Continuous Flow, SMED, and Heijunka 8.10 Kaizen, Kaizen Blitz, Theory of Constraints, and OEE 8.11 Implementation Planning, Piloting, and Solution Selection

9 Chapter 9: Control Phase

9.1 SPC Objectives, Variable Selection, and Rational Subgrouping 9.2 Control Charts for Variables Data 9.3 Control Charts for Attributes Data 9.4 Short-Run SPC and Moving Average Charts 9.5 Control Chart Analysis: Common Cause, Special Cause, and Run Rules 9.6 Total Productive Maintenance and Visual Controls 9.7 Measurement System Reanalysis 9.8 Control Plan Development and Process Owner Handoff 9.9 Lessons Learned, Documentation, and Training for Sustainment 9.10 Ongoing Evaluation of the Improved Process

10 Chapter 10: Design for Six Sigma (DFSS)

10.1 DFSS Frameworks: DMADV, DMADOV, and Design Transfer 10.2 Design for X (DFX) 10.3 Robust Design, Parameter Design, and Verification 10.4 Tolerance Design and Statistical Tolerancing

7.1 The Correlation Coefficient, Its Confidence Interval, and Causation

Key Takeaways Explain This Topic AI

The Pearson correlation coefficient measures the strength and direction of a linear relationship and ranges from -1 to +1.

The coefficient of determination r squared is the proportion of variation in Y explained by the linear relationship with X.

A correlation coefficient near zero rules out a linear relationship but not a curved one, so always plot the data.

Confidence intervals for rho are built using Fisher's z transformation, because the sampling distribution of r is skewed unless rho is zero.

Correlation supports causation only after confounding, reverse causation, and selection effects have been excluded; designed experiments do this by randomization.

Last updated: August 2026

The Pearson correlation coefficient r = ∑ ( x i − x ˉ ) ( y i − y ˉ ) ∑ ( x i − x ˉ ) 2 ∑ ( y i − y ˉ ) 2 = S x y S x x S y y r = \frac{\sum (x_i - \bar{x})(y_i - \bar{y})}{\sqrt{\sum (x_i - \bar{x})^2 \sum (y_i - \bar{y})^2}} = \frac{S_{xy}}{\sqrt{S_{xx} S_{yy}}} r = ∑ ( x i ​ − x ˉ ) 2 ∑ ( y i ​ − y ˉ ​ ) 2 ​ ∑ ( x i ​ − x ˉ ) ( y i ​ − y ˉ ​ ) ​ = S xx ​ S yy ​ ​ S x y ​ ​

r r r measures the strength and direction of the linear association between two continuous variables

and is bounded by − 1 ≤ r ≤ + 1 -1 \le r \le +1 − 1 ≤ r ≤ + 1 . It is dimensionless and unaffected by linear rescaling, so

converting millimetres to inches changes nothing.

• ∣ r ∣ \vert r\vert ∣ r ∣ Conventional description
• 0.00 - 0.30 Negligible to weak
• 0.30 - 0.50 Moderate
• 0.50 - 0.70 Moderately strong
• 0.70 - 0.90 Strong
• 0.90 - 1.00 Very strong
• These bands are conventions, not thresholds. In a designed experiment on a machined dimension, r = 0.85 r =

0.85 r = 0.85 may be disappointing; in a study of human behaviour, r = 0.40 r = 0.40 r = 0.40 may be a major finding.

The coefficient of determination r 2 = proportion of the variation in Y explained by the linear relationship with X r^2 = \text{proportion of the variation in } Y \text{ explained by the linear relationship with } X r 2 = proportion of the variation in Y explained by the linear relationship with X

This is the interpretation that matters practically. r = 0.70 r = 0.70 r = 0.70 sounds impressive until you square it: r 2 = 0.49 r^2 = 0.49 r 2 = 0.49 , so 51% of the variation remains unexplained . Reporting r r r alone systematically

overstates how much of the problem a factor accounts for, which is why the Analyze phase should

prioritize factors by r 2 r^2 r 2 , not by r r r .

Worked example

Six paired observations of oven temperature ( X X X , degrees C) and tensile strength ( Y Y Y , MPa):

• x x x 180 185 190 195 200 205
• y y y 412 418 431 435 447 452

x ˉ = 192.5 \bar{x} = 192.5 x ˉ = 192.5 , y ˉ = 432.5 \bar{y} = 432.5 y ˉ ​ = 432.5 . Computing the sums of squares gives S x x = 437.5 S_{xx} = 437.5 S xx ​ = 437.5 , S y y = 1229.5 S_{yy} = 1229.5 S yy ​ = 1229.5 , and S x y = 727.5 S_{xy} = 727.5 S x y ​ = 727.5 . Then: r = 727.5 437.5 × 1229.5 = 727.5 733.42 = 0.9919 r = \frac{727.5}{\sqrt{437.5 \times 1229.5}} = \frac{727.5}{733.42} = 0.9919 r = 437.5 × 1229.5 ​ 727.5 ​ = 733.42 727.5 ​ = 0.9919

r 2 = 0.9839 r^2 = 0.9839 r 2 = 0.9839 , so 98.4% of the variation in tensile strength over this temperature range is explained

by the linear relationship. Note the qualifier over this range -- nothing here supports

extrapolation to 250 C.

Testing and estimating

Testing whether rho differs from zero t = r n − 2 1 − r 2 , d f = n − 2 t = \frac{r\sqrt{n-2}}{\sqrt{1-r^2}}, \qquad df = n - 2 t = 1 − r 2 ​ r n − 2 ​ ​ , df = n − 2

Reject H 0 : ρ = 0 H_0: \rho = 0 H 0 ​ : ρ = 0 when ∣ t ∣ |t| ∣ t ∣ exceeds the critical value. For the example above, t = 0.9919 4 / 1 − 0.9839 = 1.9839 / 0.1268 = 15.6 t = 0.9919\sqrt{4}/\sqrt{1-0.9839} = 1.9839/0.1268 = 15.6 t = 0.9919 4 ​ / 1 − 0.9839 ​ = 1.9839/0.1268 = 15.6 with 4 degrees of freedom, which is

overwhelmingly significant.

Confidence interval via Fisher's z transformation

The sampling distribution of r r r is skewed whenever ρ ≠ 0 \rho \ne 0 ρ  = 0 , because r r r is bounded at ± 1 \pm 1 ± 1 .

Fisher's transformation removes the skew: z ′ = 1 2 ln ⁡ ( 1 + r 1 − r ) , S E z ′ = 1 n − 3 z' = \frac{1}{2}\ln\left(\frac{1+r}{1-r}\right), \qquad SE_{z'} = \frac{1}{\sqrt{n-3}} z ′ = 2 1 ​ ln ( 1 − r 1 + r ​ ) , S E z ′ ​ = n − 3 ​ 1 ​

Build the interval on the z ′ z' z ′ scale, z ′ ± 1.96 S E z ′ z' \pm 1.96 \, SE_{z'} z ′ ± 1.96 S E z ′ ​ for 95% confidence, then transform each

endpoint back: r = e 2 z ′ − 1 e 2 z ′ + 1 r = \frac{e^{2z'} - 1}{e^{2z'} + 1} r = e 2 z ′ + 1 e 2 z ′ − 1 ​

Two practical points. The interval is asymmetric around r r r on the original scale, and it requires n > 3 n > 3 n > 3 . With small samples it is remarkably wide -- with n = 10 n = 10 n = 10 and r = 0.60 r = 0.60 r = 0.60 , the 95% interval runs

roughly from -0.04 to 0.89, which is not evidence of a strong relationship.

Assumptions and what breaks them

• Assumption Violation Consequence
• Linearity Curved relationship r r r near zero despite a strong relationship
• Continuous, roughly bivariate normal data Heavy skew, ordinal data Use Spearman rank correlation instead
• Independent observations Time-ordered or clustered data Standard errors wrong; significance overstated
• No influential outliers One extreme point r r r can be created or destroyed by a single observation
• Adequate range of X X X Restricted range r r r attenuated toward zero
• Always plot the data before reading r r r . Anscombe's quartet -- four data sets with identical
• correlation, means, and regression lines but radically different shapes -- exists precisely to make
• this point. A scatter plot takes seconds and prevents the two most common failures: a curved

relationship reported as no relationship, and a single outlier reported as a strong relationship.

• Restricted range deserves special attention in Six Sigma work, because it is built into the way we
• collect data. If a process is tightly controlled between 199 and 201 C, a study of temperature versus
• strength within that band will show little correlation even if temperature is a dominant factor across
• a wider range. The absence of correlation in observational process data is weak evidence that a factor

does not matter; a designed experiment that deliberately widens the range is the correct test.

Correlation and causation

An observed correlation is consistent with several explanations, only one of which is direct causation:

X causes Y -- the conclusion usually wanted.

Y causes X -- reverse causation.

A third variable Z causes both -- confounding.

Selection effect -- the sampling procedure created the association.

Coincidence -- with enough variables examined, spurious correlations appear.

The last is worth quantifying: testing 20 unrelated factor pairs at α = 0.05 \alpha = 0.05 α = 0.05 produces on average

one significant result by chance alone. Data-mining a wide process data set for correlations without

adjusting for multiplicity reliably generates false leads.

Establishing causation

• Evidence Strength
• Correlation in observational data Weak; generates hypotheses
• Correlation plus a plausible physical mechanism Moderate
• Correlation plus temporal precedence and dose-response Moderate to strong
• Controlled experiment with randomization Strong
• Controlled experiment, replicated, with confirmed mechanism Conclusive for practical purposes
• Randomization in a designed experiment is what neutralizes unknown confounders, which is why the
• Improve phase of DMAIC is built around DOE rather than around further observational analysis. A

correlation found in the Analyze phase is a hypothesis to be tested, not a root cause to be acted on.