Study guide

10.1 Linear Correlation & Pearson's Correlation Coefficient (r)

CSSC Certified Six Sigma Green Belt Exam

Track your progress as you read

Finished sections get a check mark.

1 Chapter 1: Six Sigma Overview & Exam Fundamentals

1.1 CSSC Certification Overview, Exam Structure & Body of Knowledge 1.2 History & Evolution of Six Sigma 1.3 Six Sigma Organizational Roles & Belts Hierarchy 1.4 The DMAIC Methodology Architecture vs. DMADV / DFSS 1.5 Other Process Improvement & Quality Methods, and When to Choose Six Sigma

2 Chapter 2: Quality Fundamentals & Defect Metrics

2.1 Critical to Quality (CTQ) Characteristics & VOC Translation 2.2 Defect Metrics: DPU, DPO, DPMO, & the 1.5-Sigma Shift 2.3 First Time Yield (FTY) & Rolled Throughput Yield (RTY) 2.4 Cost of Quality (COQ) & Cost of Poor Quality (COPQ)

3 Chapter 3: Lean Principles & Waste Elimination

3.1 Foundations of Lean & The Toyota Production System (TPS) 3.2 The Eight Wastes: CSSC's Seven Muda, TIMWOODS, and Muri/Mura 3.3 The 5S Visual Workplace Methodology 3.4 Value Stream Mapping (VSM), Cycle Time & Takt Time

4 Chapter 4: Project Selection & Team Management

4.1 Six Sigma Project Selection & Business Case Development 4.2 Project Charter Architecture 4.3 Stakeholder Management & Communication Planning 4.4 Team Dynamics & Tuckman's Team Development Stages 4.5 The 15-Point Project Viability Model & Process-Level Selection

5 Chapter 5: Define Phase & Process Mapping

5.1 High-Level Process Mapping with SIPOC 5.2 Flowcharts, Swimlane Diagrams & Process Value Analysis 5.3 Quality Function Deployment (QFD) & The House of Quality 5.4 Critical to Quality (CTQ) Flowdown & Operational Definitions 5.5 The CSSC Define Toolset: Ground Rules, In/Out of the Box, Is–Is Not & Tollgate Checklists

6 Chapter 6: Measure Phase & Measurement Systems

6.1 Data Types: Continuous (Variable) vs. Discrete (Attribute) Data 6.2 Data Collection Planning & Sampling Strategies 6.3 Measurement System Analysis (MSA) Foundations & Calibration 6.4 Variable & Attribute Gage R&R Studies

7 Chapter 7: Analyze Phase & Root Cause Analysis

7.1 Qualitative Root Cause Tools: 5 Whys & Cause-and-Effect (Fishbone) Diagrams 7.2 Failure Mode and Effects Analysis (FMEA) & RPN Calculation 7.3 Pareto Analysis & The 80/20 Rule 7.4 Graphical Data Exploration: Histograms, Box Plots, & Multi-Vari Charts 7.5 The Root Cause Verification Matrix

8 Chapter 8: Descriptive Statistics & Distributions

8.1 Measures of Central Tendency & Dispersion 8.2 The Normal Distribution & The Empirical Rule (68-95-99.7) 8.3 Standard Normal Distribution, Z-Scores & Probability Calculations 8.4 Common Non-Normal Distributions: Binomial, Poisson & Chi-Square

9 Chapter 9: Inferential Statistics & Hypothesis Testing

9.1 Fundamentals of Hypothesis Testing: Null vs. Alternative, Alpha & Beta Risks 9.2 One-Sample and Two-Sample t-Tests for Means 9.3 Paired t-Tests & Non-Parametric Alternatives 9.4 Analysis of Variance (One-Way & Two-Way ANOVA) & Chi-Square Contingency Tests 9.5 Sample Size Determination for Hypothesis Tests

10 Chapter 10: Correlation, Regression, & Experimentation

10.1 Linear Correlation & Pearson's Correlation Coefficient (r) 10.2 Simple Linear Regression & Coefficient of Determination (R^2) 10.3 Introduction to Design of Experiments (DOE) & Factorial Designs 10.4 Analyzing Experimental Results: Main Effects & Interaction Plots

11 Chapter 11: Improve Phase & Solution Implementation

11.1 Brainstorming, Creative Thinking & Solution Selection Matrices 11.2 Piloting Solutions & Conducting Risk Assessments 11.3 Implementation Planning & Change Management (ADKAR) 11.4 Mistake-Proofing (Poka-Yoke) & Standard Work

12 Chapter 12: Control Phase, SPC, & Process Capability

12.1 Statistical Process Control (SPC) & Shewhart Control Rules 12.2 Variable Control Charts: I-MR, X-bar & R, X-bar & S 12.3 Attribute Control Charts: p, np, c, and u Charts 12.4 Process Capability & Performance Indices: Cp, Cpk, Pp, Ppk 12.5 Communicating Statistical Results to Business Audiences

10.1 Linear Correlation & Pearson's Correlation Coefficient (r)

Key Takeaways Explain This Topic AI

Pearson's correlation coefficient (r) measures the direction and strength of a linear relationship between two continuous variables on a standardized scale from -1.0 to +1.0.

Strength classifications benchmark |r| ≥ 0.80 as strong, 0.50 ≤ |r| < 0.80 as moderate, and |r| < 0.50 as weak, while r = 0 indicates the complete absence of a linear relationship (not necessarily no relationship).

The coefficient of determination (R² = r²) quantifies the exact proportion of total variance in the dependent variable Y explained by the linear association with X, showing that predictive power accelerates quadratically as |r| approaches 1.0.

Spearman's rank correlation (r_s) evaluates monotonic relationships without normality assumptions, making it ideal for ordinal ratings, ranks, or non-linear monotonic data.

Anscombe's Quartet proves that identical summary statistics (mean, variance, r = 0.816, regression line) can emerge from radically different underlying data geometries, mandating visual scatter plot inspection before numerical analysis.

Last updated: September 2026

10.1 Linear Correlation & Pearson's Correlation Coefficient (r)

Quick Summary: In the Analyze phase of DMAIC, continuous improvement teams transition from qualitative brainstorming to quantitative validation of root causes ( Y = f ( X ) Y = f(X) Y = f ( X ) ). Correlation analysis measures the statistical association between two continuous variables. Pearson's correlation coefficient ( r r r ) quantifies the strength and direction of linear relationships on a standardized scale from − 1.0 -1.0 − 1.0 to + 1.0 +1.0 + 1.0 . The coefficient of determination ( R 2 = r 2 R^2 = r^2 R 2 = r 2 ) expresses the proportion of total variance in the output Y Y Y explained by input X X X . However, correlation does not establish causation, and practitioners must guard against lethal analytical traps including non-linear dependencies, influential outliers, and synthetic artifacts illustrated by Anscombe's Quartet .

The Role of Correlation in the DMAIC Analyze Phase

During the Define and Measure phases, project teams identify the primary operational problem—the Critical to Quality ( CTQ ) response variable, designated as Y Y Y . In the Analyze phase, the objective shifts to isolating the vital few root causes—the input variables, designated as X 1 , X 2 , … , X k X_1, X_2, \dots, X_k X 1 ​ , X 2 ​ , … , X k ​ —that dictate the behavior of Y Y Y .

Before investing capital in complex tooling modifications or process overhauls, Green Belts must prove mathematically that a suspected input X X X shares a genuine association with output Y Y Y . Correlation analysis serves as the initial statistical filter in this journey. The DMAIC Root Cause Funnel

  • Brainstormed Inputs (Qualitative: Fishbone, 5 Whys)
  • ┌─────────────────────────────────────────────────────────┐
  • │ X1, X2, X3, X4, X5, X6, X7, X8, X9, X10, X11, X12 │
  • └───────────────────────────┬─────────────────────────────┘
  • ▼
  • Correlation & Regression Screening (Quantitative Filtering)
  • ┌─────────────────────────────────────────┐
  • │ Evaluate Pearson's r, R², and p-values │
  • └─────────────────────┬───────────────────┘
  • ▼
  • Vital Few Root Causes (Active DOE / Solution Design)
  • ┌───────────────────────┐
  • │ X2, X7 (Verified Xs) │ ──▶ Transfers into IMPROVE Phase
  • └───────────────────────┘
  • Scatter Plots: The Visual Prerequisite

A cardinal rule of Six Sigma data analytics states: Never calculate a numerical correlation coefficient without first examining a visual scatter plot of the raw data.

A scatter plot displays paired bivariate observations ( x i , y i ) (x_i, y_i) ( x i ​ , y i ​ ) as Cartesian coordinates on a two-dimensional grid. Visual inspection immediately reveals patterns that numerical algorithms cannot distinguish: Bivariate Scatter Patterns

  • POSITIVE LINEAR NEGATIVE LINEAR ZERO CORRELATION
  • Y ┌ ▲ Y ┌ █ ▲ Y ┌ █ █ █ ▲
  • │ █ █ │ │ █ █ │ │ █ █ █ █ │
  • │ █ █ │ │ █ █ │ │ █ █ █ █ │
  • │ █ █ │ │ █ █ │ │ █ █ █ █ │
  • │ █ │ │ █ │ │ █ █ █ │
  • └──────────────────┴─ └──────────────────┴─ └──────────────────┴─
  • 0 X 0 X 0 X
  • r ≈ +0.90 (Strong +) r ≈ -0.90 (Strong -) r ≈ 0.00 (No Linear)
  • CURVILINEAR (NON-LINEAR) ISOLATED OUTLIER CLUSTERED GROUPS
  • Y ┌ █ █ ▲ Y ┌ ▲ Y ┌ ████ ▲
  • │ █ █ │ │ █ │ │ ████ │
  • │ █ █ │ │ │ │ │
  • │ █ █│ │ █ █ █ │ │ ████ │
  • │ █ │ │ █ █ █ │ │ ████ │
  • └──────────────────┴─ └──────────────────┴─ └──────────────────┴─
  • 0 X 0 X 0 X
  • r ≈ 0.00 (Parabolic) r inflated by 1 point Simpson's Paradox Risk

Direction : Does Y Y Y systematically increase as X X X increases (positive slope), or does Y Y Y decrease as X X X increases (negative slope)?

Form : Is the data envelope straight (linear) or curved (exponential, logarithmic, parabolic)?

Strength : How tightly do individual data points cluster around an imaginary central trend line?

Unusual Observations : Are there isolated extreme points (outliers) that could distort statistical calculations?

Pearson's Product-Moment Correlation Coefficient ( r r r )

Developed by Karl Pearson, the Pearson product-moment correlation coefficient —denoted as ρ \rho ρ (rho) for a population and r r r for a sample—quantifies the strength and direction of a linear relationship between two continuous variables.

Mathematical Formulation

Mathematically, r r r represents the ratio of the sample covariance of X X X and Y Y Y to the product of their individual standard deviations: r = ∑ i = 1 n ( x i − x ˉ ) ( y i − y ˉ ) ∑ i = 1 n ( x i − x ˉ ) 2 ∑ i = 1 n ( y i − y ˉ ) 2 = S S x y S S x x ⋅ S S y y r = \frac{\sum_{i=1}^n (x_i - \bar{x})(y_i - \bar{y})}{\sqrt{\sum_{i=1}^n (x_i - \bar{x})^2} \sqrt{\sum_{i=1}^n (y_i - \bar{y})^2}} = \frac{SS_{xy}}{\sqrt{SS_{xx} \cdot SS_{yy}}} r = ∑ i = 1 n ​ ( x i ​ − x ˉ ) 2 ​ ∑ i = 1 n ​ ( y i ​ − y ˉ ​ ) 2 ​ ∑ i = 1 n ​ ( x i ​ − x ˉ ) ( y i ​ − y ˉ ​ ) ​ = S S xx ​ ⋅ S S yy ​ ​ S S x y ​ ​

Where:

  • S S x y SS_{xy} S S x y ​ is the sum of cross-products (covariation of X X X and Y Y Y ),
  • S S x x SS_{xx} S S xx ​ is the sum of squared deviations for X X X ,

S S y y SS_{yy} S S yy ​ is the sum of squared deviations for Y Y Y .

Because both numerator and denominator are scaled by variability, r r r is a dimensionless index . Changing the measurement units of X X X or Y Y Y (e.g., converting temperature from Celsius to Fahrenheit, or length from inches to millimeters) has zero effect on the value of r r r .

Theoretical Bounds and Scale

Pearson's r r r is mathematically constrained to the closed interval: − 1.0 ≤ r ≤ + 1.0 -1.0 \le r \le +1.0 − 1.0 ≤ r ≤ + 1.0

r = + 1.0 r = +1.0 r = + 1.0 (Perfect Positive Linear Correlation) : Every observation falls exactly on a straight line with a positive slope. As X X X increases, Y Y Y increases in exact lockstep.

r = − 1.0 r = -1.0 r = − 1.0 (Perfect Negative Linear Correlation) : Every observation falls exactly on a straight line with a negative slope. As X X X increases, Y Y Y decreases in exact lockstep.

r = 0.0 r = 0.0 r = 0.0 (Zero Linear Correlation) : There is zero linear association between X X X and Y Y Y . Knowledge of X X X provides no ability to predict Y Y Y using a straight-line model.

Benchmarks for Interpreting Strength

While domain context dictates operational importance, the Council for Six Sigma Certification (CSSC) and industrial quality engineering apply standard benchmark classifications for correlation magnitude ( ∣ r ∣ |r| ∣ r ∣ ):

Absolute Value Range ( ∣ r ∣ \vert r\vert ∣ r ∣ ) Strength Classification Operational Six Sigma Interpretation

0.80 ≤ ∣ r ∣ ≤ 1.00 0.80 \le \vert r\vert\le 1.00 0.80 ≤ ∣ r ∣ ≤ 1.00 Strong (Very High) Strong linear association; X X X is a prime candidate for mathematical modeling and root cause control.

0.50 ≤ ∣ r ∣ < 0.80 0.50 \le \vert r\vert< 0.80 0.50 ≤ ∣ r ∣ < 0.80 Moderate Substantial relationship exists, but considerable unexplained variation remains; secondary factors or noise are present.

0.20 ≤ ∣ r ∣ < 0.50 0.20 \le \vert r\vert< 0.50 0.20 ≤ ∣ r ∣ < 0.50 Weak Slight linear tendency, but X X X alone has minimal predictive utility.

0.00 ≤ ∣ r ∣ < 0.20 0.00 \le \vert r\vert< 0.20 0.00 ≤ ∣ r ∣ < 0.20 Very Weak to Negligible No practical linear association; changes in X X X do not explain meaningful variation in Y Y Y .

Exam Tip: Correlation measures association , not slope! A steep line and a shallow line can both have r = + 1.00 r = +1.00 r = + 1.00 , provided all points lie perfectly on their respective lines. The correlation coefficient r r r tells you how tightly points cling to the line, not the steepness of the angle.

Spearman Rank Correlation ( r s r_s r s ​ or ρ s \rho_s ρ s ​ )

Pearson's r r r requires two fundamental assumptions: both variables must be continuous, and their joint distribution must be approximately bivariate normal. When these assumptions fail, Green Belts deploy Spearman's Rank Correlation ( r s r_s r s ​ ) .

When to Use Spearman Rank Correlation

Ordinal Data : Data consists of ranks, ratings, or ordered categorical scales (e.g., customer satisfaction scores from 1 to 5, supplier audit tiers, defect severity ranks).

Severe Non-Normality : Continuous data displays extreme skewness, bi-modality, or heavy kurtosis that cannot be normalized.

Monotonic Non-Linear Relationships : The relationship between X X X and Y Y Y is consistently upward or consistently downward (monotonic), but follows an exponential or logarithmic curve rather than a straight line.

Operational Mechanics

Spearman's rank correlation replaces raw data values with their relative ranks (from 1 1 1 to n n n ). If ties occur, tied observations receive the average of the ranks they would have occupied. Pearson's formula is then applied directly to the ranked integers: r s = 1 − 6 ∑ d i 2 n ( n 2 − 1 ) r_s = 1 - \frac{6 \sum d_i^2}{n(n^2 - 1)} r s ​ = 1 − n ( n 2 − 1 ) 6 ∑ d i 2 ​ ​

Where d i = Rank ( x i ) − Rank ( y i ) d_i = \text{Rank}(x_i) - \text{Rank}(y_i) d i ​ = Rank ( x i ​ ) − Rank ( y i ​ ) represents the difference between paired ranks for observation i i i .

The Coefficient of Determination ( R 2 R^2 R 2 )

While Pearson's r r r indicates the strength of association, business leaders and project champions think in terms of explained variation . To quantify how much process variation is accounted for, Green Belts compute the Coefficient of Determination , denoted as R 2 R^2 R 2 (or r 2 r^2 r 2 in simple bivariate correlation): R 2 = ( r ) 2 R^2 = (r)^2 R 2 = ( r ) 2

Formal Definition and Interpretation

The Coefficient of Determination ( R 2 R^2 R 2 ) represents the proportion (or percentage) of the total variance in the dependent response variable ( Y Y Y ) that is mathematically explained or accounted for by its linear relationship with the independent predictor variable ( X X X ).

The value of R 2 R^2 R 2 ranges strictly from 0.0 0.0 0.0 to 1.0 1.0 1.0 (or 0 % 0\% 0% to 100 % 100\% 100% ):

If r = 0.80 r = 0.80 r = 0.80 , then R 2 = ( 0.80 ) 2 = 0.64 R^2 = (0.80)^2 = 0.64 R 2 = ( 0.80 ) 2 = 0.64 ( 64 % 64\% 64% ). This proves that 64 % 64\% 64% of the total variation in Y Y Y is explained by X X X , while the remaining 36 % 36\% 36% ( 1 − R 2 1 - R^2 1 − R 2 ) represents unexplained residual variation (process noise, unmeasured variables, or measurement error).

If r = − 0.50 r = -0.50 r = − 0.50 , then R 2 = ( − 0.50 ) 2 = 0.25 R^2 = (-0.50)^2 = 0.25 R 2 = ( − 0.50 ) 2 = 0.25 ( 25 % 25\% 25% ). Notice that squaring removes the negative sign: R 2 R^2 R 2 is always non-negative. The Variance Pie: R² vs. Unexplained Noise

r = 0.80 ──▶ R² = 0.64 (64% Explained)

  • ┌────────────────────────┐
  • │████████████████████ │
  • │████████████████████ │
  • │████ EXPLAINED █████░░░░│ ░░ UNEXPLAINED
  • │████ BY INPUT X ████░░░░│ NOISE (1 - R²)
  • │████ (64%) ████░░░░│ (36%)
  • │████████████████████ │
  • └────────────────────────┘
  • The Non-Linear Nature of R 2 R^2 R 2

A common executive mistake is assuming that r = 0.80 r = 0.80 r = 0.80 is twice as strong as r = 0.40 r = 0.40 r = 0.40 . Examining R 2 R^2 R 2 reveals the truth:

At r = 0.40 r = 0.40 r = 0.40 , R 2 = 0.16 R^2 = 0.16 R 2 = 0.16 ( 16 % 16\% 16% explained variation).

At r = 0.80 r = 0.80 r = 0.80 , R 2 = 0.64 R^2 = 0.64 R 2 = 0.64 ( 64 % 64\% 64% explained variation).

An r r r of 0.80 0.80 0.80 actually explains four times ( 64 % / 16 % = 4.0 64\% / 16\% = 4.0 64%/16% = 4.0 ) the variance of an r r r of 0.40 0.40 0.40 . As ∣ r ∣ |r| ∣ r ∣ approaches 1.0 1.0 1.0 , predictive power accelerates rapidly.

Hypothesis Testing for Linear Correlation

Observing a sample correlation of r = 0.45 r = 0.45 r = 0.45 in a small pilot dataset does not guarantee that the true population correlation ( ρ \rho ρ ) differs from zero. The observed association could be an artifact of random sampling noise.

To prove statistical significance, practitioners execute a two-tailed t t t -test:

1. Formulate the Hypotheses

Null Hypothesis ( H 0 H_0 H 0 ​ ) : ρ = 0 \rho = 0 ρ = 0 (There is no linear correlation in the population).

Alternative Hypothesis ( H a H_a H a ​ ) : ρ ≠ 0 \rho \ne 0 ρ  = 0 (There is a statistically significant linear correlation).

2. Compute the Test Statistic ( t t t )

The test statistic follows Student's t t t -distribution with d f = n − 2 df = n - 2 df = n − 2 degrees of freedom: t = r n − 2 1 − r 2 t = \frac{r \sqrt{n - 2}}{\sqrt{1 - r^2}} t = 1 − r 2 ​ r n − 2 ​ ​

3. Apply the Decision Rule

If the calculated ∣ t ∣ > t α / 2 , n − 2 |t| > t_{\alpha/2, n-2} ∣ t ∣ > t α /2 , n − 2 ​ (or if the software p p p -value ≤ α \le \alpha ≤ α , typically 0.05 0.05 0.05 ), Reject H 0 H_0 H 0 ​ and conclude that a statistically significant linear relationship exists.

If p > α p > \alpha p > α , Fail to Reject H 0 H_0 H 0 ​ ; the evidence is insufficient to conclude that ρ ≠ 0 \rho \ne 0 ρ  = 0 .

The Sample Size Leverage Effect

Sample size ( n n n ) heavily influences the p p p -value:

With n = 6 n = 6 n = 6 , an observed correlation of r = 0.75 r = 0.75 r = 0.75 yields t = 0.75 4 / 1 − 0.5625 = 1.50 / 0.6614 = 2.268 t = 0.75 \sqrt{4} / \sqrt{1 - 0.5625} = 1.50 / 0.6614 = 2.268 t = 0.75 4 ​ / 1 − 0.5625 ​ = 1.50/0.6614 = 2.268 . For d f = 4 df = 4 df = 4 , the two-tailed critical value at α = 0.05 \alpha = 0.05 α = 0.05 is 2.776 2.776 2.776 . Because 2.268 < 2.776 2.268 < 2.776 2.268 < 2.776 ( p = 0.086 p = 0.086 p = 0.086 ), the team fails to reject H 0 H_0 H 0 ​ despite a strong correlation!

With n = 500 n = 500 n = 500 , an observed correlation of r = 0.12 r = 0.12 r = 0.12 (practically useless in an engineering context) yields t = 0.12 498 / 1 − 0.0144 = 2.678 / 0.9928 = 2.70 t = 0.12 \sqrt{498} / \sqrt{1 - 0.0144} = 2.678 / 0.9928 = 2.70 t = 0.12 498 ​ / 1 − 0.0144 ​ = 2.678/0.9928 = 2.70 ( p = 0.007 p = 0.007 p = 0.007 ). The test is statistically significant , yet X X X explains only R 2 = 1.4 % R^2 = 1.4\% R 2 = 1.4% of the variation in Y Y Y .

Key Principle: Never rely on statistical significance ( p p p -value) alone. Always pair the p p p -value with the practical magnitude of r r r and R 2 R^2 R 2 .

Anscombe's Quartet: The Visual Imperative

In 1973, English statistician Francis Anscombe constructed four synthetic datasets to demonstrate both the necessity of graphing data before calculating summary statistics and the effect of outliers on statistical properties.

Each of the four datasets contains n = 11 n = 11 n = 11 paired observations ( X , Y ) (X, Y) ( X , Y ) . When analyzed using standard numerical formulas, all four datasets yield identical statistical outputs :

  • Statistical Property Dataset I Dataset II Dataset III Dataset IV
  • Sample Mean of X X X ( x ˉ \bar{x} x ˉ ) 9.00 9.00 9.00 9.00 9.00 9.00 9.00 9.00 9.00 9.00 9.00 9.00

Sample Variance of X X X ( s x 2 s_x^2 s x 2 ​ ) 11.00 11.00 11.00 11.00 11.00 11.00 11.00 11.00 11.00 11.00 11.00 11.00

Sample Mean of Y Y Y ( y ˉ \bar{y} y ˉ ​ ) 7.50 7.50 7.50 7.50 7.50 7.50 7.50 7.50 7.50 7.50 7.50 7.50

Sample Variance of Y Y Y ( s y 2 s_y^2 s y 2 ​ ) 4.125 4.125 4.125 4.125 4.125 4.125 4.125 4.125 4.125 4.125 4.125 4.125

Pearson Correlation ( r r r ) 0.816 0.816 0.816 0.816 0.816 0.816 0.816 0.816 0.816 0.816 0.816 0.816

Coefficient of Determination ( R 2 R^2 R 2 ) 0.667 0.667 0.667 ( 66.7 % 66.7\% 66.7% ) 0.667 0.667 0.667 ( 66.7 % 66.7\% 66.7% ) 0.667 0.667 0.667 ( 66.7 % 66.7\% 66.7% ) 0.667 0.667 0.667 ( 66.7 % 66.7\% 66.7% )

Linear Regression Line y ^ = 3.0 + 0.5 x \hat{y} = 3.0 + 0.5x y ^ ​ = 3.0 + 0.5 x y ^ = 3.0 + 0.5 x \hat{y} = 3.0 + 0.5x y ^ ​ = 3.0 + 0.5 x y ^ = 3.0 + 0.5 x \hat{y} = 3.0 + 0.5x y ^ ​ = 3.0 + 0.5 x y ^ = 3.0 + 0.5 x \hat{y} = 3.0 + 0.5x y ^ ​ = 3.0 + 0.5 x

Despite having identical numerical summaries, inspecting their scatter plots reveals four radically different physical realities: Anscombe's Quartet Visualized

  • DATASET I: Ideal Linear DATASET II: Non-Linear Parabolic
  • Y ┌ █ Y ┌ ███
  • │ █ █ │ ██ ██
  • │ █ █ │ ██ ██
  • │ █ │ ██ ██
  • │ █ │ ██ ██
  • └─────────────────── └───────────────────
  • 0 X 0 X
  • Standard linear relationship Perfect curve; linear fit invalid
  • DATASET III: Outlier Distorted DATASET IV: High-Leverage Outlier
  • Y ┌ Y ┌ █ (Outlier)
  • │ █ (Outlier) │
  • │ ████ │ ████ (Vertical stack)
  • │ ████ │ ████
  • │ ████ │ ████
  • └─────────────────── └───────────────────
  • 0 X 0 X
  • True r = 1.0, ruined by 1 point No relationship; 1 point drives fit

Dataset I : Fits a standard linear model with random, normally distributed error residuals around the regression line. Pearson's r = 0.816 r = 0.816 r = 0.816 accurately describes this relationship.

Dataset II : Exhibits a smooth, deterministic quadratic (parabolic) curve. The relationship between X X X and Y Y Y is perfect, but because it is non-linear, linear regression and Pearson's r r r fail to capture its true nature.

Dataset III : Represents a perfect linear fit ( r = 1.0 r = 1.0 r = 1.0 ) for 10 of the 11 points, but a single rogue outlier pulls the slope down and artificially reduces the correlation to 0.816 0.816 0.816 .

Dataset IV : Consists of 10 points stacked vertically at x = 8.0 x = 8.0 x = 8.0 with zero variation in X X X . A single high-leverage outlier located at ( x = 19 , y = 12.5 ) (x = 19, y = 12.5) ( x = 19 , y = 12.5 ) single-handedly manufactures a correlation of r = 0.816 r = 0.816 r = 0.816 and creates a fictitious regression line where no relationship exists!

The Six Sigma Takeaway: A computer program will blindly process numbers and output r = 0.816 r = 0.816 r = 0.816 without alerting you that Dataset II is a curve or Dataset IV is an artificial artifact. Visual graphics are mandatory.

Critical Pitfalls in Correlation Analysis

Continuous improvement practitioners must avoid four major pitfalls when interpreting correlation:

1. The Non-Linear Trap

Pearson's r r r evaluates linear association exclusively. If a biological or chemical process exhibits an inverted U-shape—where catalytic yield increases with temperature up to an optimum threshold and then crashes due to thermal decomposition—the calculated Pearson correlation across the entire operating window may equal r = 0.00 r = 0.00 r = 0.00 . Inexperienced analysts will conclude that temperature does not affect yield. In reality, temperature exerts total control, but requires quadratic or polynomial modeling.

2. Outlier Distortion (Artificial or Masked Correlation)

As seen in Anscombe's Datasets III and IV, a single anomalous observation caused by a sensor spike or transcription error can:

Transform an actual r = 0.00 r = 0.00 r = 0.00 into an apparent r = 0.85 r = 0.85 r = 0.85 (artificial correlation), or

Transform an actual r = 0.95 r = 0.95 r = 0.95 into an apparent r = 0.20 r = 0.20 r = 0.20 (masked correlation).

Always apply robust outlier screening (such as studentized residuals or Cook's Distance) before finalizing correlation conclusions.

3. The Ecological Fallacy & Simpson's Paradox

The ecological fallacy occurs when inferences about individual units are deduced solely from aggregated group statistics. A related danger is Simpson's Paradox , where a correlation observed across aggregated data reverses direction when the data is disaggregated into operational subgroups (e.g., across machines, shifts, or suppliers): Simpson's Paradox Visualized

  • AGGREGATED DATA (Combined) STRATIFIED BY SHIFT
  • Y ┌ ▲ Y ┌ Shift 1 (Neg) Shift 2 (Neg)
  • │ ███ │ │ █ █
  • │ ███ │ │ █ █
  • │ ███ │ │ █ █
  • │ ███ │ │ █ █
  • └─────────────────┴─ └────────────────────────────┴─
  • 0 X 0 X

Apparent POSITIVE Trend True NEGATIVE Trend in Both Shifts!

4. Correlation Does NOT Equal Causation

This is the cardinal rule of applied statistics. Observing a strong correlation ( ∣ r ∣ > 0.90 |r| > 0.90 ∣ r ∣ > 0.90 ) between X X X and Y Y Y establishes mathematical co-movement, but never proves that X X X causes Y Y Y . Three alternative mechanisms frequently generate high correlation without causation:

Lurking / Confounding Variables ( Z Z Z ) : Both X X X and Y Y Y are simultaneously driven by an unmeasured third factor. Example: Ice cream sales ( X X X ) and drowning incidents ( Y Y Y ) exhibit strong positive correlation ( r = 0.88 r = 0.88 r = 0.88 ). Selling ice cream does not drown swimmers; outdoor summer temperature ( Z Z Z ) drives both variables independently.

Reverse Causality : The analyst assumes X X X drives Y Y Y , when in physical reality Y Y Y drives X X X .

Spurious Correlation : Pure coincidence in historical time-series data. Highly publicized examples include strong correlations between U.S. spending on science and suicides by hanging, or margarine consumption and divorce rates in Maine.

To prove causality, Green Belts must proceed beyond passive observational correlation to active manipulation through Design of Experiments (DOE).

Step-by-Step Worked Calculation Example

Problem: A Six Sigma Green Belt investigates whether preheating time ( X X X , in minutes) correlates with final weld shear strength ( Y Y Y , in MPa). A random sample of n = 5 n = 5 n = 5 production joints yields the following paired data:

  • Observation ( i i i ) Preheating Time X X X (min) Shear Strength Y Y Y (MPa)
  • 1 2.0 35.0
  • 2 4.0 45.0
  • 3 5.0 50.0
  • 4 7.0 65.0
  • 5 8.0 70.0

Calculate the sample means, sums of squares, Pearson correlation coefficient r r r , coefficient of determination R 2 R^2 R 2 , and conduct a hypothesis test at α = 0.05 \alpha = 0.05 α = 0.05 .

Step 1: Compute Sample Means x ˉ = 2.0 + 4.0 + 5.0 + 7.0 + 8.0 5 = 26.0 5 = 5.20 min \bar{x} = \frac{2.0 + 4.0 + 5.0 + 7.0 + 8.0}{5} = \frac{26.0}{5} = 5.20\text{ min} x ˉ = 5 2.0 + 4.0 + 5.0 + 7.0 + 8.0 ​ = 5 26.0 ​ = 5.20 min y ˉ = 35.0 + 45.0 + 50.0 + 65.0 + 70.0 5 = 265.0 5 = 53.00 MPa \bar{y} = \frac{35.0 + 45.0 + 50.0 + 65.0 + 70.0}{5} = \frac{265.0}{5} = 53.00\text{ MPa} y ˉ ​ = 5 35.0 + 45.0 + 50.0 + 65.0 + 70.0 ​ = 5 265.0 ​ = 53.00 MPa

Step 2: Set Up Deviations and Sums of Squares

i i i x i − x ˉ x_i - \bar{x} x i ​ − x ˉ y i − y ˉ y_i - \bar{y} y i ​ − y ˉ ​ ( x i − x ˉ ) 2 (x_i - \bar{x})^2 ( x i ​ − x ˉ ) 2 ( y i − y ˉ ) 2 (y_i - \bar{y})^2 ( y i ​ − y ˉ ​ ) 2 ( x i − x ˉ ) ( y i − y ˉ ) (x_i - \bar{x})(y_i - \bar{y}) ( x i ​ − x ˉ ) ( y i ​ − y ˉ ​ )

1 2.0 − 5.2 = − 3.2 2.0 - 5.2 = -3.2 2.0 − 5.2 = − 3.2 35 − 53 = − 18 35 - 53 = -18 35 − 53 = − 18 10.24 10.24 10.24 324.0 324.0 324.0 ( − 3.2 ) ( − 18 ) = 57.6 (-3.2)(-18) = 57.6 ( − 3.2 ) ( − 18 ) = 57.6

2 4.0 − 5.2 = − 1.2 4.0 - 5.2 = -1.2 4.0 − 5.2 = − 1.2 45 − 53 = − 8 45 - 53 = -8 45 − 53 = − 8 1.44 1.44 1.44 64.0 64.0 64.0 ( − 1.2 ) ( − 8 ) = 9.6 (-1.2)(-8) = 9.6 ( − 1.2 ) ( − 8 ) = 9.6

3 5.0 − 5.2 = − 0.2 5.0 - 5.2 = -0.2 5.0 − 5.2 = − 0.2 50 − 53 = − 3 50 - 53 = -3 50 − 53 = − 3 0.04 0.04 0.04 9.0 9.0 9.0 ( − 0.2 ) ( − 3 ) = 0.6 (-0.2)(-3) = 0.6 ( − 0.2 ) ( − 3 ) = 0.6

4 7.0 − 5.2 = + 1.8 7.0 - 5.2 = +1.8 7.0 − 5.2 = + 1.8 65 − 53 = + 12 65 - 53 = +12 65 − 53 = + 12 3.24 3.24 3.24 144.0 144.0 144.0 ( + 1.8 ) ( + 12 ) = 21.6 (+1.8)(+12) = 21.6 ( + 1.8 ) ( + 12 ) = 21.6

5 8.0 − 5.2 = + 2.8 8.0 - 5.2 = +2.8 8.0 − 5.2 = + 2.8 70 − 53 = + 17 70 - 53 = +17 70 − 53 = + 17 7.84 7.84 7.84 289.0 289.0 289.0 ( + 2.8 ) ( + 17 ) = 47.6 (+2.8)(+17) = 47.6 ( + 2.8 ) ( + 17 ) = 47.6

Sum 0.0 0.0 0.0 0.0 0.0 0.0 S S x x = 22.80 SS_{xx} = 22.80 S S xx ​ = 22.80 S S y y = 830.00 SS_{yy} = 830.00 S S yy ​ = 830.00 S S x y = 137.00 SS_{xy} = 137.00 S S x y ​ = 137.00

Step 3: Compute Pearson's r r r r = S S x y S S x x ⋅ S S y y = 137.00 22.80 × 830.00 = 137.00 18924.0 = 137.00 137.5645 ≈ + 0.9959 r = \frac{SS_{xy}}{\sqrt{SS_{xx} \cdot SS_{yy}}} = \frac{137.00}{\sqrt{22.80 \times 830.00}} = \frac{137.00}{\sqrt{18924.0}} = \frac{137.00}{137.5645} \approx +0.9959 r = S S xx ​ ⋅ S S yy ​ ​ S S x y ​ ​ = 22.80 × 830.00 ​ 137.00 ​ = 18924.0 ​ 137.00 ​ = 137.5645 137.00 ​ ≈ + 0.9959

Step 4: Compute Coefficient of Determination R 2 R^2 R 2 R 2 = ( 0.9959 ) 2 ≈ 0.9918 ( 99.18 % ) R^2 = (0.9959)^2 \approx 0.9918 \quad (99.18\%) R 2 = ( 0.9959 ) 2 ≈ 0.9918 ( 99.18% )

Interpretation: 99.18 % 99.18\% 99.18% of the total variation in weld shear strength is mathematically explained by preheating time.

Step 5: Test the Hypothesis ( H 0 : ρ = 0 H_0: \rho = 0 H 0 ​ : ρ = 0 vs H a : ρ ≠ 0 H_a: \rho \ne 0 H a ​ : ρ  = 0 ) t = r n − 2 1 − r 2 = 0.9959 5 − 2 1 − 0.9918 = 0.9959 × 1.73205 0.0082 = 1.7249 0.09055 ≈ 19.05 t = \frac{r \sqrt{n - 2}}{\sqrt{1 - r^2}} = \frac{0.9959 \sqrt{5 - 2}}{\sqrt{1 - 0.9918}} = \frac{0.9959 \times 1.73205}{\sqrt{0.0082}} = \frac{1.7249}{0.09055} \approx 19.05 t = 1 − r 2 ​ r n − 2 ​ ​ = 1 − 0.9918 ​ 0.9959 5 − 2 ​ ​ = 0.0082 ​ 0.9959 × 1.73205 ​ = 0.09055 1.7249 ​ ≈ 19.05

Degrees of freedom: d f = n − 2 = 5 − 2 = 3 df = n - 2 = 5 - 2 = 3 df = n − 2 = 5 − 2 = 3 .

From the Student's t t t -table, two-tailed critical value for α = 0.05 \alpha = 0.05 α = 0.05 with d f = 3 df = 3 df = 3 is t 0.025 , 3 = 3.182 t_{0.025, 3} = 3.182 t 0.025 , 3 ​ = 3.182 .

Since ∣ t ∣ = 19.05 > 3.182 |t| = 19.05 > 3.182 ∣ t ∣ = 19.05 > 3.182 , we Reject H 0 H_0 H 0 ​ ( p < 0.001 p < 0.001 p < 0.001 ). There is a statistically significant, very strong positive linear correlation between preheating time and weld shear strength.

Critical Exam Traps to Avoid

Trap 1: Confusing Correlation Strength ( r r r ) with Explained Variance ( R 2 R^2 R 2 ) — Exam questions frequently ask: "If r = 0.70 r = 0.70 r = 0.70 , what percentage of variation in Y Y Y is explained by X X X ?" Distractor choices will offer 70 % 70\% 70% . The correct answer is ( 0.70 ) 2 = 0.49 = 49 % (0.70)^2 = 0.49 = 49\% ( 0.70 ) 2 = 0.49 = 49% .

Trap 2: Assuming r = 0 r = 0 r = 0 Proves No Relationship Exists — A Pearson r r r of zero indicates only that no linear relationship exists. The underlying data could form a perfect non-linear parabola or circle.

Trap 3: Equating Steep Slope with High Correlation — A line with an equation y ^ = 0.001 x \hat{y} = 0.001x y ^ ​ = 0.001 x can have r = 1.00 r = 1.00 r = 1.00 , while a steep line with y ^ = 50 x \hat{y} = 50x y ^ ​ = 50 x can have r = 0.20 r = 0.20 r = 0.20 if points are scattered widely around it.

Trap 4: Claiming Statistically Significant Correlation Proves Causality — Rejection of H 0 : ρ = 0 H_0: \rho = 0 H 0 ​ : ρ = 0 proves only that the observed linear pattern is unlikely due to random chance. It does not prove that X X X causes Y Y Y .

Loading diagram... Bivariate Correlation Analysis & Analytical Trap Screening Protocol