Study guide
10.2 Simple Linear Regression & Prediction
ASQ Certified Six Sigma Yellow Belt CSSYB
Track your progress as you read
Finished sections get a check mark.
1 Introduction & Exam Overview
About the ASQ CSSYB Exam How to Use This Study Guide
2 Chapter 1: Six Sigma & Lean Fundamentals
1.1 Six Sigma Foundations, Principles & History 1.2 Lean Foundations, Principles & The 8 Wastes 1.3 Six Sigma Roles & Responsibilities
3 Chapter 2: Team Basics & Dynamics
2.1 Team Types & Stages of Team Evolution 2.2 Team Decision-Making & Idea Generation Tools 2.3 Communication Methods & Meeting Management
4 Chapter 3: Quality Tools & Six Sigma Metrics
3.1 The 7 Basic Quality Tools 3.2 Six Sigma Process Performance Metrics & COPQ
5 Chapter 4: Define Phase — Project Identification & Scope
4.1 Voice of the Customer (VOC) & Critical-to-Quality (CTQ) 4.2 Project Selection & Stakeholder Analysis 4.3 Process Definition with SIPOC & Supply Chain Basics
6 Chapter 5: Define Phase — Project Management Basics
5.1 The Project Charter & Problem Statements 5.2 Project Planning: WBS, Gantt Charts & Communication Plans 5.3 Project Management Tools & Tollgate Reviews
7 Chapter 6: Measure Phase — Data Collection & Statistics
6.1 Basic Statistics: Central Tendency & Dispersion 6.2 Data Types & Classification 6.3 Data Collection Plans, Operational Definitions & Sampling 6.4 Data Collection Techniques: Check Sheets, Checklists, Surveys & Interviews
8 Chapter 7: Measure Phase — Measurement System Analysis
7.1 Measurement System Fundamentals: Precision, Accuracy & Bias 7.2 Gauge Repeatability & Reproducibility (GR&R)
9 Chapter 8: Analyze Phase — Process & Root Cause Analysis
8.1 Process Analysis: 5S & Value Analysis 8.2 Failure Mode and Effects Analysis (FMEA) 8.3 Root Cause Analysis: 5 Whys, Process Mapping, 8D, Force-Field & Matrix Charts
10 Chapter 9: Analyze Phase — Corrective Action & Variation
9.1 Corrective & Preventive Action Processes 9.2 Common Cause vs Special Cause Variation 9.3 Basic Distribution Types: Normal, Binomial & Poisson
11 Chapter 10: Analyze Phase — Relationships & Hypothesis Testing
10.1 Correlation & Scatter Plots 10.2 Simple Linear Regression & Prediction 10.3 Hypothesis Testing Concepts: Hypotheses, Errors & P-Values
12 Chapter 11: Improve Phase — Implementation Techniques
11.1 Kaizen & Kaizen Blitz Events 11.2 Plan-Do-Check-Act (PDCA) & Solution Selection 11.3 Cost-Benefit Analysis & Financial Validation
13 Chapter 12: Control Phase — Sustaining Improvements
12.1 Control Plans & Process Monitoring 12.2 Statistical Process Control: X-bar & R Charts 12.3 Document Control, Standard Operating Procedures & Project Hand-off
10.2 Simple Linear Regression & Prediction
Key Takeaways Explain This Topic AI
Simple linear regression mathematically models the functional relationship between a continuous predictor (X) and a continuous response (Y) via the equation Y_hat = b0 + b1*X.
The slope (b1) quantifies the estimated change in response Y for every one-unit increase in predictor X, while the Y-intercept (b0) represents the baseline value of Y_hat when X = 0.
The method of Ordinary Least Squares (OLS) calculates the regression line by minimizing the sum of squared vertical residuals between observed points and fitted values.
The coefficient of determination (R-squared) reflects the proportion of total variation in the response variable explained by the regression model, with R-squared = r^2 in simple linear regression.
While interpolation within the observed data range provides reliable predictions, extrapolating beyond the experimental boundaries introduces severe operational risk.
Last updated: September 2026
Simple Linear Regression & Prediction
Quick Answer: Simple linear regression develops a predictive mathematical equation— Y ^ = b 0 + b 1 X \hat{Y} = b_0 + b_1 X Y ^ = b 0 + b 1 X —quantifying how a continuous dependent response ( Y Y Y ) changes when an independent predictor ( X X X ) is varied. Using Ordinary Least Squares (OLS), regression calculates the unique straight line that minimizes the sum of squared vertical residuals between data points and the line. The coefficient of determination ( R 2 R^2 R 2 ) reflects the percentage of total variation explained by the model. Regression provides reliable predictions within the experimental data range, but extrapolating beyond observed boundaries creates severe operational risk. Independent CSSYB study guide by ExamFinch.
Purpose of Simple Linear Regression
Once scatter plots and correlation confirm a linear association between process variables, Six Sigma teams must quantify that link: How much does output Y Y Y change per unit change in input X X X ? What setting of X X X achieves our target Y Y Y ?
While correlation measures the degree of association, simple linear regression constructs a functional mathematical transfer function ( Y = f ( X ) Y = f(X) Y = f ( X ) ). It establishes an explicit relationship between:
One Independent Predictor ( X X X ): The controllable process setting, raw material parameter, or operational condition.
One Dependent Response ( Y Y Y ): The output quality characteristic, dimensional measurement, or cycle time metric targeted for improvement.
This predictive model enables teams to evaluate process sensitivity, establish operating tolerances, and design data-driven solutions.
The Linear Regression Model
Regression differentiates between the true population relationship and the sample model estimated from empirical data.
Theoretical Population Model
The theoretical relationship across the entire process population is expressed as: Y = β 0 + β 1 X + ϵ Y = \beta_0 + \beta_1 X + \epsilon Y = β 0 + β 1 X + ϵ
Where β 0 \beta_0 β 0 is the population intercept, β 1 \beta_1 β 1 is the population slope, and ϵ \epsilon ϵ represents independent, normally distributed random error ( ϵ ∼ N ( 0 , σ 2 ) \epsilon \sim N(0, \sigma^2) ϵ ∼ N ( 0 , σ 2 ) ).
Fitted Sample Regression Equation
Using sample data, practitioners compute the fitted regression line: Y ^ = b 0 + b 1 X \hat{Y} = b_0 + b_1 X Y ^ = b 0 + b 1 X
Where:
Y ^ \hat{Y} Y ^ ("Y-hat"): The predicted mean response for a specified value of X X X .
b 1 b_1 b 1 (Slope): The estimated change in response Y Y Y for each 1-unit increase in predictor X X X . The slope represents the rate of change ( Δ Y / Δ X \Delta Y / \Delta X Δ Y /Δ X ). A positive slope indicates Y Y Y increases as X X X increases, whereas a negative slope indicates an inverse relationship.
b 0 b_0 b 0 ( Y Y Y -Intercept): The estimated value of Y ^ \hat{Y} Y ^ when X = 0 X = 0 X = 0 . If X = 0 X = 0 X = 0 is outside operating reality (such as machine speed at 0 RPM during production), b 0 b_0 b 0 serves purely as a coordinate anchor without physical meaning.
The Method of Ordinary Least Squares (OLS)
To select the single best-fitting line among infinite candidates, statisticians use the Method of Ordinary Least Squares (OLS) .
Residuals and Minimization
For every observation ( X i , Y i ) (X_i, Y_i) ( X i , Y i ) , the vertical distance between the actual observed value ( Y i Y_i Y i ) and the fitted value ( Y ^ i \hat{Y}_i Y ^ i ) is the residual ( e i e_i e i ): e i = Y i − Y ^ i = Y i − ( b 0 + b 1 X i ) e_i = Y_i - \hat{Y}_i = Y_i - (b_0 + b_1 X_i) e i = Y i − Y ^ i = Y i − ( b 0 + b 1 X i )
The sum of raw residuals always equals zero because positive and negative deviations cancel. OLS eliminates cancellation and penalizes large discrepancies by minimizing the Sum of Squared Errors (SSE) : SSE = ∑ i = 1 n e i 2 = ∑ i = 1 n ( Y i − Y ^ i ) 2 \text{SSE} = \sum_{i=1}^{n} e_i^2 = \sum_{i=1}^{n} (Y_i - \hat{Y}_i)^2 SSE = i = 1 ∑ n e i 2 = i = 1 ∑ n ( Y i − Y ^ i ) 2
Minimizing SSE produces the closed-form OLS formulas: b 1 = ∑ ( X i − X ˉ ) ( Y i − Y ˉ ) ∑ ( X i − X ˉ ) 2 = r ( s Y s X ) b_1 = \frac{\sum (X_i - \bar{X})(Y_i - \bar{Y})}{\sum (X_i - \bar{X})^2} = r \left( \frac{s_Y}{s_X} \right) b 1 = ∑ ( X i − X ˉ ) 2 ∑ ( X i − X ˉ ) ( Y i − Y ˉ ) = r ( s X s Y ) b 0 = Y ˉ − b 1 X ˉ b_0 = \bar{Y} - b_1 \bar{X} b 0 = Y ˉ − b 1 X ˉ
The fitted OLS line always passes through the point of averages ( X ˉ , Y ˉ ) (\bar{X}, \bar{Y}) ( X ˉ , Y ˉ ) .
Coefficient of Determination ( R 2 R^2 R 2 )
To assess model adequacy, Six Sigma practitioners evaluate the Coefficient of Determination ( R 2 R^2 R 2 ) .
Regression partitions the total variation in the response variable into two additive components: Total Sum of Squares (SST) = Regression Sum of Squares (SSR) + Error Sum of Squares (SSE) \text{Total Sum of Squares (SST)} = \text{Regression Sum of Squares (SSR)} + \text{Error Sum of Squares (SSE)} Total Sum of Squares (SST) = Regression Sum of Squares (SSR) + Error Sum of Squares (SSE)
Where SST measures total variation around Y ˉ \bar{Y} Y ˉ , SSR measures variation explained by the regression line, and SSE measures unexplained residual noise. The coefficient of determination is: R 2 = SSR SST = 1 − SSE SST R^2 = \frac{\text{SSR}}{\text{SST}} = 1 - \frac{\text{SSE}}{\text{SST}} R 2 = SST SSR = 1 − SST SSE
Key Properties and Interpretation
Range: 0.0 ≤ R 2 ≤ 1.0 0.0 \le R^2 \le 1.0 0.0 ≤ R 2 ≤ 1.0 (or 0 % 0\% 0% to 100 % 100\% 100% ).
Relation to Pearson r r r : In simple linear regression, R 2 = ( r ) 2 R^2 = (r)^2 R 2 = ( r ) 2 . If r = 0.90 r = 0.90 r = 0.90 , then R 2 = 0.81 R^2 = 0.81 R 2 = 0.81 .
Practical Interpretation: An R 2 R^2 R 2 of 0.85 0.85 0.85 means that 85 % 85\% 85% of the total variation in response Y Y Y is explained by the linear relationship with predictor X X X . The remaining 15 % 15\% 15% represents unexplained common-cause variation or unmeasured variables.
Prediction: Interpolation vs. Extrapolation Risks
A validated regression equation allows practitioners to predict response values, but Yellow Belts must recognize the danger of extrapolation.
Interpolation (Statistically Valid): Predicting Y ^ \hat{Y} Y ^ for predictor values within the observed data range ( X min ≤ X ≤ X max X_{\min} \le X \le X_{\max} X m i n ≤ X ≤ X m a x ). Interpolated predictions are statistically valid and supported by empirical evidence.
Extrapolation (Severe Risk): Predicting Y ^ \hat{Y} Y ^ for predictor values outside the observed data range ( X < X min X < X_{\min} X < X m i n or X > X max X > X_{\max} X > X m a x ).
Extrapolating assumes the linear relationship continues indefinitely. In reality, physical processes experience saturation, material degradation, or structural failure outside tested operating ranges, yielding misleading or impossible predictions.
Step-by-Step Worked Numerical Example
A Six Sigma team in a medical device facility evaluates sealing bar pressure in psi ( X X X ) versus package seal strength in Newtons ( Y Y Y ).
1. Data and Summary Values
Five test samples yield:
- X ˉ = 50 psi \bar{X} = 50\text{ psi} X ˉ = 50 psi , Y ˉ = 80 N \bar{Y} = 80\text{ N} Y ˉ = 80 N
- ∑ ( X i − X ˉ ) 2 = 1 , 000 \sum (X_i - \bar{X})^2 = 1,000 ∑ ( X i − X ˉ ) 2 = 1 , 000
∑ ( X i − X ˉ ) ( Y i − Y ˉ ) = 1 , 550 \sum (X_i - \bar{X})(Y_i - \bar{Y}) = 1,550 ∑ ( X i − X ˉ ) ( Y i − Y ˉ ) = 1 , 550
Experimental range: 30 psi ≤ X ≤ 70 psi 30\text{ psi} \le X \le 70\text{ psi} 30 psi ≤ X ≤ 70 psi
2. Computing Slope and Intercept b 1 = 1 , 550 1 , 000 = 1.55 N/psi b_1 = \frac{1,550}{1,000} = 1.55\text{ N/psi} b 1 = 1 , 000 1 , 550 = 1.55 N/psi b 0 = 80 − ( 1.55 ) ( 50 ) = 80 − 77.5 = 2.5 N b_0 = 80 - (1.55)(50) = 80 - 77.5 = 2.5\text{ N} b 0 = 80 − ( 1.55 ) ( 50 ) = 80 − 77.5 = 2.5 N
The fitted prediction model is: Y ^ = 2.5 + 1.55 X \hat{Y} = 2.5 + 1.55 X Y ^ = 2.5 + 1.55 X
Interpretation: Each additional psi of sealing pressure increases predicted seal strength by 1.55 N 1.55\text{ N} 1.55 N .
3. Model Evaluation and Prediction
Software output for the same five samples reports r = 0.992 r = 0.992 r = 0.992 , so R 2 = ( 0.992 ) 2 = 0.984 R^2 = (0.992)^2 = 0.984 R 2 = ( 0.992 ) 2 = 0.984 ( 98.4 % 98.4\% 98.4% of seal strength variation is explained by pressure).
Valid Interpolation: At X = 55 psi X = 55\text{ psi} X = 55 psi (within the 30–70 psi range): Y ^ = 2.5 + 1.55 ( 55 ) = 87.75 N \hat{Y} = 2.5 + 1.55(55) = 87.75\text{ N} Y ^ = 2.5 + 1.55 ( 55 ) = 87.75 N
Extrapolation Danger: At X = 200 psi X = 200\text{ psi} X = 200 psi , the equation predicts Y ^ = 312.5 N \hat{Y} = 312.5\text{ N} Y ^ = 312.5 N . In production, 200 psi would crush the blister pack, causing catastrophic seal failure.