3.2 Regression Diagnostics: Multicollinearity, Heteroskedasticity & Serial Correlation

CFA Level 2 Chartered Financial Analyst

Track your progress as you read

Finished sections get a check mark.

1 Introduction & CFA Level II Exam Strategy

1.1 CFA Level II Exam Overview & Item-Set Vignette Strategy 1.2 2026 Curriculum Structure & 10 Topic Weight Bands 1.3 300-Hour Study Plan, Calculator Mastery & Practical Skills Modules (PSM)

2 Ethical and Professional Standards

2.1 Code of Ethics & The Seven Standards of Professional Conduct 2.2 Vignette Analysis: Conflicts of Interest & Disclosure (Standard VI) 2.3 Duties to Clients (Standard III) & Duties to Employers (Standard IV) 2.4 Standard V: Investment Analysis, Recommendations & Actions and Standard VII: Responsibilities as a CFA Member or Candidate 2.5 Application of the Code and Standards: Level II Case Method 2.6 Recommended Procedures: Compliance Programs, Supervisory Systems & Firm Policies

3 Quantitative Methods

3.1 Multiple Linear Regression, ANOVA & Hypothesis Testing 3.2 Regression Diagnostics: Multicollinearity, Heteroskedasticity & Serial Correlation 3.3 Time-Series Analysis: AR Models, Nonstationarity & Cointegration 3.4 Machine Learning, Deep Learning & Big Data Projects 3.5 Extensions of Multiple Regression: Influence Analysis, Qualitative Variables & Logistic Regression 3.6 Big Data Projects: Wrangling, Exploration, Feature Engineering & Model Training

4 Economics for Valuation

4.1 Foreign Exchange Parity Relations & Equilibrium Exchange Rates 4.2 Economic Growth Theories & Production Function Analysis 4.3 Forward Points, the Carry Trade & Policy Effects on Exchange Rates 4.4 Growth Determinants: Natural Resources, Demographics, Convergence & Trade Openness

5 Financial Statement Analysis

5.1 Intercorporate Investments: Equity Method & Business Combinations 5.2 Employee Compensation: Defined Benefit Pension Plans & Share-Based Payments 5.3 Multinational Operations: Current Rate vs Temporal Translation 5.4 Analysis of Financial Institutions & The CAMELS Framework 5.5 Evaluating the Quality of Financial Reports & Accounting Adjustments 5.6 Integration of Financial Statement Analysis Techniques

6 Corporate Issuers

6.1 Analysis of Dividends: Policy Theories, Signaling & Taxation Systems 6.2 Share Repurchases: Methods, EPS and Book Value Effects & Payout Sustainability 6.3 Cost of Capital: Advanced Topics 6.4 Corporate Governance, Board Oversight & ESG Integration 6.5 Corporate Restructuring: Types, Motivations, Evaluation & Valuation 6.6 Restructuring Financial Effects: EPS, Net Debt to EBITDA, WACC & Divestitures

7 Equity Valuation

7.1 Equity Valuation Framework & Required Rate of Return Estimation 7.2 Discounted Dividend Valuation: Gordon Growth, Multistage & The H-Model 7.3 Free Cash Flow Valuation: FCFF and FCFE Modeling 7.4 Market-Based Valuation: Price and Enterprise Value Multiples 7.5 Residual Income Valuation 7.6 Private Company Valuation: Income, Market & Asset-Based Approaches 7.7 Choosing and Combining Models: Definitions of Value, Sum-of-the-Parts & Cross-Border Comparability

8 Fixed Income Analysis

8.1 The Term Structure and Interest Rate Dynamics: Spot, Forward & Swap Curves 8.2 The Arbitrage-Free Valuation Framework & Binomial Interest Rate Trees 8.3 Valuation and Analysis of Bonds with Embedded Options: OAS & Duration 8.4 Credit Analysis Models: Structural vs Reduced-Form Approaches 8.5 Credit Default Swaps (CDS): Mechanics, Pricing & Trading Strategies 8.6 Managing Yield-Curve Risk: Key Rate Durations, One-Sided Durations & Yield Volatility Structure

9 Derivatives & Risk Management

9.1 Pricing and Valuation of Forward Commitments: Equity, Fixed Income & FX 9.2 Swap Pricing and Valuation: Interest Rate, Currency & Equity Swaps 9.3 Contingent Claims: Binomial Option Pricing Model & Arbitrage Replication 9.4 The Black-Scholes-Merton (BSM) Model, Option Greeks & Dynamic Hedging 9.5 Interest Rate Options, Swaptions & the Black Model

10 Alternative Investments

10.1 Commodities and Commodity Derivatives: Sectors, Participants, Futures Returns & Indexes 10.2 Private Real Estate Investments: Direct Capitalization, DCF & Cost Approach 10.3 Public Real Estate Investments: REIT Structures, NAV, FFO & AFFO 10.4 Hedge Fund Strategies: Classification, Implementation & Portfolio Role 10.5 Real Estate Investment Features, Due Diligence & Index Construction Biases

11 Portfolio Management

11.1 Using Multifactor Models: Macroeconomic, Fundamental & Statistical Risk 11.2 Measuring and Managing Market Risk: VaR, CVaR & Stress Testing 11.3 Economics & Investment Markets: Business Cycles, Term Structure & Asset Allocation 11.4 Analysis of Active Portfolio Management & The Fundamental Law 11.5 Exchange-Traded Funds (ETFs): Creation, Arbitrage, Tracking & Applications 11.6 Backtesting and Simulation: Procedures, Metrics, Biases & Scenario Analysis

3.2 Regression Diagnostics: Multicollinearity, Heteroskedasticity & Serial Correlation

Key Takeaways Explain This Topic AI

The 'Big Three' regression violations (heteroskedasticity, serial correlation, multicollinearity) leave OLS slope estimates unbiased and consistent (unless lagged dependent variables accompany serial correlation), but distort estimated standard errors and hypothesis tests.

Conditional heteroskedasticity (error variance correlated with regressors) understates standard errors and inflates t-statistics, detected via the Breusch-Pagan test (n * R^2_{resid} ~ chi^2_k) and corrected with Hansen-White robust standard errors.

Positive serial correlation in time-series residuals understates standard errors and inflates t-statistics, detected via the Durbin-Watson statistic (DW approx 2(1 - r)) and Breusch-Godfrey test, and corrected with Newey-West HAC standard errors.

Multicollinearity inflates coefficient standard errors (low t-stats despite high R^2 and significant F), diagnosed via VIF > 5 or 10, while qualitative dependent models (Logit, Probit) bound response probabilities within [0, 1] via Maximum Likelihood Estimation.

Last updated: August 2026

Econometric Violations & Diagnostic Testing

When applying multiple regression to financial datasets, the Classical Linear Regression Model (CLRM) assumptions are frequently violated. Financial analysts must identify the nature of each violation, its statistical consequences on Ordinary Least Squares (OLS) estimates, the appropriate diagnostic tests, and the correct econometric remedies. ┌──────────────────────────────────────────────────────────┐

• │ The "Big Three" Econometric Violations │
• └────────────────────────────┬─────────────────────────────┘
• │
• ┌────────────────────────────────────────┼────────────────────────────────────────┐
• ▼ ▼ ▼
• ┌────────────────────────┐ ┌────────────────────────┐ ┌────────────────────────┐
• │ Heteroskedasticity │ │ Serial Correlation │ │ Multicollinearity │
• │ - Non-constant Var(e) │ │ - Correlated errors │ │ - High corr among Xs │
• │ - Breusch-Pagan test │ │ - Durbin-Watson test │ │ - High R², low t-stats │
• │ - White robust SEs │ │ - Newey-West HAC SEs │ │ - VIF > 5 or 10 │
• └────────────────────────┘ └────────────────────────┘ └────────────────────────┘
• 1. Heteroskedasticity: Non-Constant Error Variance

Heteroskedasticity occurs when the variance of the error terms is not constant across all observations: V a r ( ϵ i ∣ X ) = σ i 2 Var(\epsilon_i \mid X) = \sigma_i^2 Va r ( ϵ i ​ ∣ X ) = σ i 2 ​ .

Unconditional vs. Conditional Heteroskedasticity

Unconditional Heteroskedasticity : Error variance varies across observations but is uncorrelated with the independent variables . While technically a violation, it creates no major problems for statistical inference.

Conditional Heteroskedasticity : Error variance is systematically correlated with one or more independent variables (e.g., error variance increases as firm market cap increases). This is a severe violation that distorts hypothesis testing.

Consequences of Conditional Heteroskedasticity on OLS:

OLS parameter estimates ( b 0 , b 1 , … , b k b_0, b_1, \dots, b_k b 0 ​ , b 1 ​ , … , b k ​ ) remain unbiased and consistent .

OLS standard errors ( s b j s_{b_j} s b j ​ ​ ) are biased and inconsistent (typically severely understated in financial applications).

Understated standard errors lead to artificially inflated t t t -statistics , causing false rejections of the null hypothesis ( Type I errors ).

The overall regression F F F -statistic is unreliable .

Detection Methods:

Residual Scatter Plots : Plotting squared residuals ( e i 2 e_i^2 e i 2 ​ ) against independent variables X j X_j X j ​ or fitted values Y ^ i \hat{Y}_i Y ^ i ​ reveals funneling or fan-shaped patterns.

Breusch-Pagan (BP) Test : Regresses the squared OLS residuals on the k k k independent variables: e i 2 = a 0 + a 1 X 1 i + ⋯ + a k X k i + u i e_i^2 = a_0 + a_1 X_{1i} + \dots + a_k X_{ki} + u_i e i 2 ​ = a 0 ​ + a 1 ​ X 1 i ​ + ⋯ + a k ​ X ki ​ + u i ​ . The test statistic is calculated as: L M = n × R r e s i d 2 ∼ χ k 2 LM = n \times R^2_{resid} \sim \chi^2_k L M = n × R res i d 2 ​ ∼ χ k 2 ​

Where R r e s i d 2 R^2_{resid} R res i d 2 ​ is the R 2 R^2 R 2 from the residual regression and k k k is the degrees of freedom. If L M > χ c r i t , α , k 2 LM > \chi^2_{crit, \alpha, k} L M > χ cr i t , α , k 2 ​ , reject H 0 H_0 H 0 ​ of homoskedasticity.

White's Test : A generalized test regressing e i 2 e_i^2 e i 2 ​ on all independent variables, their squares ( X j 2 X_j^2 X j 2 ​ ), and their cross-products ( X j X m X_j X_m X j ​ X m ​ ).

Remedies:

Hansen-White Robust Standard Errors (also known as White-corrected or heteroskedasticity-consistent standard errors): Re-estimates standard errors without altering point estimates b j b_j b j ​ . This restores valid t t t -tests and F F F -tests.

Generalized Least Squares (GLS / Weighted Least Squares) : Transforms variables by dividing by the conditional standard deviation σ i \sigma_i σ i ​ when the error variance structure is known.

2. Serial Correlation (Autocorrelation)

Serial correlation occurs in time-series data when regression error terms are correlated across consecutive time periods: ϵ t = ρ ϵ t − 1 + u t , ∣ ρ ∣ < 1 \epsilon_t = \rho \epsilon_{t-1} + u_t, \quad |\rho| < 1 ϵ t ​ = ρ ϵ t − 1 ​ + u t ​ , ∣ ρ ∣ < 1

Where ρ \rho ρ is the first-order serial correlation parameter.

Positive vs. Negative Serial Correlation

Positive Serial Correlation (most common in finance): Positive errors follow positive errors, and negative errors follow negative errors ( ρ > 0 \rho > 0 ρ > 0 ).

Negative Serial Correlation : Errors alternate systematically in sign across adjacent periods ( ρ < 0 \rho < 0 ρ < 0 ).

Consequences of Serial Correlation on OLS:

OLS parameter estimates remain unbiased and consistent , UNLESS the regression includes a lagged dependent variable ( Y t − 1 Y_{t-1} Y t − 1 ​ ) as a regressor. If a lagged dependent variable is present alongside serial correlation, OLS estimates are biased and inconsistent .

For positive serial correlation, OLS standard errors are understated , leading to artificially inflated t t t -statistics and excessive Type I errors .

The Mean Square Error (MSE) is understated, causing R 2 R^2 R 2 to be artificially inflated .

The F F F -statistic is invalid and overstated.

Detection Methods:

Durbin-Watson ( D W DW D W ) Statistic : Measures first-order serial correlation: D W = ∑ t = 2 n ( e t − e t − 1 ) 2 ∑ t = 1 n e t 2 ≈ 2 ( 1 − r ) DW = \frac{\sum_{t=2}^n (e_t - e_{t-1})^2}{\sum_{t=1}^n e_t^2} \approx 2(1 - r) D W = ∑ t = 1 n ​ e t 2 ​ ∑ t = 2 n ​ ( e t ​ − e t − 1 ​ ) 2 ​ ≈ 2 ( 1 − r )

Where r r r is the sample correlation between adjacent residuals e t e_t e t ​ and e t − 1 e_{t-1} e t − 1 ​ .

If r = 0 r = 0 r = 0 (no autocorrelation), D W ≈ 2.0 DW \approx 2.0 D W ≈ 2.0 .

If r = + 1 r = +1 r = + 1 (perfect positive autocorrelation), D W ≈ 0.0 DW \approx 0.0 D W ≈ 0.0 .

If r = − 1 r = -1 r = − 1 (perfect negative autocorrelation), D W ≈ 4.0 DW \approx 4.0 D W ≈ 4.0 . 0 d_L d_U 4 - d_U 4 - d_L 4

• ├─── Positive ───┼── Inconclusive ──┼── No Serial ───┼── Inconclusive ──┼─── Negative ───┤
• │ Autocorr (H₁) │ │Autocorr (H₀) │ │ Autocorr (H₁) │

Decision Rules for Positive Autocorrelation ( H 0 : ρ = 0 H_0: \rho = 0 H 0 ​ : ρ = 0 vs. H a : ρ > 0 H_a: \rho > 0 H a ​ : ρ > 0 ):

If D W < d L DW < d_L D W < d L ​ : Reject H 0 H_0 H 0 ​ (positive serial correlation confirmed).

If d L ≤ D W ≤ d U d_L \le DW \le d_U d L ​ ≤ D W ≤ d U ​ : Inconclusive .

If D W > d U DW > d_U D W > d U ​ : Fail to reject H 0 H_0 H 0 ​ (no evidence of positive serial correlation).

Important Limitation of DW : The Durbin-Watson test is invalid if the regression contains a lagged dependent variable as an independent regressor. In such cases, use the Breusch-Godfrey Lagrange Multiplier test .

Remedies:

Newey-West Standard Errors (HAC SEs) : Computes Heteroskedasticity and Autocorrelation Consistent standard errors, correcting t t t -statistics for both violations without changing OLS slope estimates.

Autoregressive Transformation : Re-estimates the equation via Generalized Least Squares (e.g., Cochrane-Orcutt or Prais-Winsten procedure).

3. Multicollinearity

Multicollinearity occurs when two or more independent variables in a multiple regression are highly linearly correlated with each other.

Consequences of Multicollinearity on OLS:

OLS parameter estimates remain unbiased and consistent .

The standard errors of individual slope coefficients ( s b j s_{b_j} s b j ​ ​ ) are artificially inflated (greatly enlarged).

Individual t t t -statistics are artificially low , resulting in failure to reject H 0 H_0 H 0 ​ even when variables are economically critical ( Type II errors ).

Classic Symptom : High overall R 2 R^2 R 2 and a statistically significant overall F F F -test, yet none (or very few) of the individual slope coefficients have statistically significant t t t -statistics .

Estimated coefficients become highly sensitive to minor changes in data or specification.

Detection Methods:

Pairwise Correlations : Regressors with ∣ r ∣ > 0.70 |r| > 0.70 ∣ r ∣ > 0.70 suggest potential collinearity (though collinearity among three or more variables can exist even if pairwise correlations are moderate).

Variance Inflation Factor (VIF) : For each independent variable X j X_j X j ​ , regressing X j X_j X j ​ on all remaining k − 1 k - 1 k − 1 regressors yields R j 2 R_j^2 R j 2 ​ : V I F j = 1 1 − R j 2 VIF_j = \frac{1}{1 - R_j^2} V I F j ​ = 1 − R j 2 ​ 1 ​

Interpretation Thresholds :

V I F = 1.0 VIF = 1.0 V I F = 1.0 : No correlation whatsoever with other regressors.

V I F > 5.0 VIF > 5.0 V I F > 5.0 : Moderate to severe multicollinearity requiring scrutiny.

V I F > 10.0 VIF > 10.0 V I F > 10.0 : Severe multicollinearity that severely degrades regression precision.

Remedies:

Drop one or more collinear variables : Remove redundant predictors that share economic information.

Transform collinear variables : Use first differences, ratios, or construct orthogonal factors via Principal Component Analysis (PCA).

Increase sample size : Gathering additional data points can reduce coefficient standard errors.

Summary Matrix: Diagnostic Comparison

Econometric Issue Nature of Violation Impact on OLS Coefficients Impact on Standard Errors Primary Detection Test Robust Remedy

Conditional Heteroskedasticity V a r ( ϵ i ∣ X ) ≠ σ 2 Var(\epsilon_i \mid X) \neq \sigma^2 Va r ( ϵ i ​ ∣ X )  = σ 2 (correlated with X X X ) Unbiased & Consistent Biased (usually understated → \rightarrow → inflated t t t ) Breusch-Pagan test ( n R 2 ∼ χ k 2 n R^2 \sim \chi^2_k n R 2 ∼ χ k 2 ​ ), White test Hansen-White robust SEs, GLS

Serial Correlation C o v ( ϵ t , ϵ t − s ) ≠ 0 Cov(\epsilon_t, \epsilon_{t-s}) \neq 0 C o v ( ϵ t ​ , ϵ t − s ​ )  = 0 across time Unbiased & Consistent (biased if lagged Y Y Y present) Biased (understated for ρ > 0 → \rho > 0 \rightarrow ρ > 0 → inflated t t t ) Durbin-Watson test ( D W ≈ 2 ( 1 − r ) DW \approx 2(1-r) D W ≈ 2 ( 1 − r ) ), Breusch-Godfrey Newey-West HAC SEs, Prais-Winsten

Multicollinearity High linear correlation among X X X s Unbiased & Consistent Inflated (artificially high → \rightarrow → deflated t t t ) High R 2 R^2 R 2 + low t t t s, V I F j > 5 VIF_j > 5 V I F j ​ > 5 or 10 10 10 Drop redundant variables, PCA

Model Misspecification: Types and Impacts

Model misspecification occurs when the regression equation fails to reflect the true data generating process:

Omission of a Relevant Variable : If a true determinant Z Z Z is omitted and correlated with included X X X , OLS estimates suffer from omitted variable bias : E ( b ^ 1 ) = β 1 + β z C o v ( X , Z ) V a r ( X ) E(\hat{b}_1) = \beta_1 + \beta_z \frac{Cov(X, Z)}{Var(X)} E ( b ^ 1 ​ ) = β 1 ​ + β z ​ Va r ( X ) C o v ( X , Z ) ​ Coefficients are biased and inconsistent , and error variance estimates are distorted.

Inclusion of an Irrelevant Variable : If an unnecessary variable is included, OLS estimates remain unbiased and consistent , but degrees of freedom are lost and coefficient standard errors become inefficient (inflated).

Incorrect Functional Form : Modeling a non-linear relationship (e.g., quadratic, logarithmic) as strictly linear causes biased residuals and inconsistent predictions (detectable via Ramsey RESET test).

Inappropriate Pooling / Structural Breaks : Combining data from distinct structural regimes (e.g., pre-crisis and post-crisis) biases coefficients. Evaluated via the Chow test .

Qualitative Dependent Variable Models

When the dependent variable Y Y Y is discrete/binary (e.g., corporate default Y ∈ { 0 , 1 } Y \in \{0, 1\} Y ∈ { 0 , 1 } , loan approval, merger success), linear OLS (the Linear Probability Model) fails because:

Predicted probabilities Y ^ \hat{Y} Y ^ can fall outside the logical range [ 0 , 1 ] [0, 1] [ 0 , 1 ] .

Residuals are inherently heteroskedastic ( V a r ( ϵ i ) = P i ( 1 − P i ) Var(\epsilon_i) = P_i(1 - P_i) Va r ( ϵ i ​ ) = P i ​ ( 1 − P i ​ ) ).

Error terms cannot be normally distributed.

Non-Linear Binary Response Models

Model Mathematical Transformation Estimation Technique Key Interpretation

Logit (Logistic Regression) P i = 1 1 + e − X i β = e X i β 1 + e X i β P_i = \frac{1}{1 + e^{-X_i \beta}} = \frac{e^{X_i \beta}}{1 + e^{X_i \beta}} P i ​ = 1 + e − X i ​ β 1 ​ = 1 + e X i ​ β e X i ​ β ​ Maximum Likelihood Estimation (MLE) Log-odds ratio: ln ⁡ ( P i 1 − P i ) = X i β \ln\left(\frac{P_i}{1 - P_i}\right) = X_i \beta ln ( 1 − P i ​ P i ​ ​ ) = X i ​ β . Slope β j \beta_j β j ​ represents change in log-odds. Odds ratio = e β j = e^{\beta_j} = e β j ​ .

Probit P i = Φ ( X i β ) = ∫ − ∞ X i β 1 2 π e − u 2 / 2 d u P_i = \Phi(X_i \beta) = \int_{-\infty}^{X_i \beta} \frac{1}{\sqrt{2\pi}} e^{-u^2/2} du P i ​ = Φ ( X i ​ β ) = ∫ − ∞ X i ​ β ​ 2 π ​ 1 ​ e − u 2 /2 d u Maximum Likelihood Estimation (MLE) Uses the standard normal cumulative distribution function Φ ( ⋅ ) \Phi(\cdot) Φ ( ⋅ ) .

Discriminant Analysis Z i = c 0 + c 1 X 1 i + ⋯ + c k X k i Z_i = c_0 + c_1 X_{1i} + \dots + c_k X_{ki} Z i ​ = c 0 ​ + c 1 ​ X 1 i ​ + ⋯ + c k ​ X ki ​ Fisher's Linear Discriminant / Ordinary classification Generates linear composite score maximizing between-group separation relative to within-group variance (e.g., Altman Z-score).