3.5 Extensions of Multiple Regression: Influence Analysis, Qualitative Variables & Logistic Regression

CFA Level 2 Chartered Financial Analyst

Track your progress as you read

Finished sections get a check mark.

1 Introduction & CFA Level II Exam Strategy

1.1 CFA Level II Exam Overview & Item-Set Vignette Strategy 1.2 2026 Curriculum Structure & 10 Topic Weight Bands 1.3 300-Hour Study Plan, Calculator Mastery & Practical Skills Modules (PSM)

2 Ethical and Professional Standards

2.1 Code of Ethics & The Seven Standards of Professional Conduct 2.2 Vignette Analysis: Conflicts of Interest & Disclosure (Standard VI) 2.3 Duties to Clients (Standard III) & Duties to Employers (Standard IV) 2.4 Standard V: Investment Analysis, Recommendations & Actions and Standard VII: Responsibilities as a CFA Member or Candidate 2.5 Application of the Code and Standards: Level II Case Method 2.6 Recommended Procedures: Compliance Programs, Supervisory Systems & Firm Policies

3 Quantitative Methods

3.1 Multiple Linear Regression, ANOVA & Hypothesis Testing 3.2 Regression Diagnostics: Multicollinearity, Heteroskedasticity & Serial Correlation 3.3 Time-Series Analysis: AR Models, Nonstationarity & Cointegration 3.4 Machine Learning, Deep Learning & Big Data Projects 3.5 Extensions of Multiple Regression: Influence Analysis, Qualitative Variables & Logistic Regression 3.6 Big Data Projects: Wrangling, Exploration, Feature Engineering & Model Training

4 Economics for Valuation

4.1 Foreign Exchange Parity Relations & Equilibrium Exchange Rates 4.2 Economic Growth Theories & Production Function Analysis 4.3 Forward Points, the Carry Trade & Policy Effects on Exchange Rates 4.4 Growth Determinants: Natural Resources, Demographics, Convergence & Trade Openness

5 Financial Statement Analysis

5.1 Intercorporate Investments: Equity Method & Business Combinations 5.2 Employee Compensation: Defined Benefit Pension Plans & Share-Based Payments 5.3 Multinational Operations: Current Rate vs Temporal Translation 5.4 Analysis of Financial Institutions & The CAMELS Framework 5.5 Evaluating the Quality of Financial Reports & Accounting Adjustments 5.6 Integration of Financial Statement Analysis Techniques

6 Corporate Issuers

6.1 Analysis of Dividends: Policy Theories, Signaling & Taxation Systems 6.2 Share Repurchases: Methods, EPS and Book Value Effects & Payout Sustainability 6.3 Cost of Capital: Advanced Topics 6.4 Corporate Governance, Board Oversight & ESG Integration 6.5 Corporate Restructuring: Types, Motivations, Evaluation & Valuation 6.6 Restructuring Financial Effects: EPS, Net Debt to EBITDA, WACC & Divestitures

7 Equity Valuation

7.1 Equity Valuation Framework & Required Rate of Return Estimation 7.2 Discounted Dividend Valuation: Gordon Growth, Multistage & The H-Model 7.3 Free Cash Flow Valuation: FCFF and FCFE Modeling 7.4 Market-Based Valuation: Price and Enterprise Value Multiples 7.5 Residual Income Valuation 7.6 Private Company Valuation: Income, Market & Asset-Based Approaches 7.7 Choosing and Combining Models: Definitions of Value, Sum-of-the-Parts & Cross-Border Comparability

8 Fixed Income Analysis

8.1 The Term Structure and Interest Rate Dynamics: Spot, Forward & Swap Curves 8.2 The Arbitrage-Free Valuation Framework & Binomial Interest Rate Trees 8.3 Valuation and Analysis of Bonds with Embedded Options: OAS & Duration 8.4 Credit Analysis Models: Structural vs Reduced-Form Approaches 8.5 Credit Default Swaps (CDS): Mechanics, Pricing & Trading Strategies 8.6 Managing Yield-Curve Risk: Key Rate Durations, One-Sided Durations & Yield Volatility Structure

9 Derivatives & Risk Management

9.1 Pricing and Valuation of Forward Commitments: Equity, Fixed Income & FX 9.2 Swap Pricing and Valuation: Interest Rate, Currency & Equity Swaps 9.3 Contingent Claims: Binomial Option Pricing Model & Arbitrage Replication 9.4 The Black-Scholes-Merton (BSM) Model, Option Greeks & Dynamic Hedging 9.5 Interest Rate Options, Swaptions & the Black Model

10 Alternative Investments

10.1 Commodities and Commodity Derivatives: Sectors, Participants, Futures Returns & Indexes 10.2 Private Real Estate Investments: Direct Capitalization, DCF & Cost Approach 10.3 Public Real Estate Investments: REIT Structures, NAV, FFO & AFFO 10.4 Hedge Fund Strategies: Classification, Implementation & Portfolio Role 10.5 Real Estate Investment Features, Due Diligence & Index Construction Biases

11 Portfolio Management

11.1 Using Multifactor Models: Macroeconomic, Fundamental & Statistical Risk 11.2 Measuring and Managing Market Risk: VaR, CVaR & Stress Testing 11.3 Economics & Investment Markets: Business Cycles, Term Structure & Asset Allocation 11.4 Analysis of Active Portfolio Management & The Fundamental Law 11.5 Exchange-Traded Funds (ETFs): Creation, Arbitrage, Tracking & Applications 11.6 Backtesting and Simulation: Procedures, Metrics, Biases & Scenario Analysis

3.5 Extensions of Multiple Regression: Influence Analysis, Qualitative Variables & Logistic Regression

Key Takeaways Explain This Topic AI

An observation is high-leverage when its leverage measure exceeds 3 times (k+1)/n, and it is an outlier in the dependent variable when its studentized residual exceeds roughly 3 in absolute value.

Cook's distance combines both dimensions; a value above 0.5 warrants investigation and a value above 1.0 indicates an observation that materially changes the fitted coefficients.

n categories of a qualitative variable require n-1 intercept dummies; including all n with an intercept creates perfect multicollinearity known as the dummy variable trap.

An intercept dummy shifts the level of the regression line, while an interaction (slope) dummy changes the slope, and a model may include both for the same category.

Logistic regression models the log odds as a linear function, is estimated by maximum likelihood rather than least squares, and a slope coefficient means that a one-unit change in the regressor changes the log odds by that amount.

Last updated: August 2026

3.5 Extensions of Multiple Regression: Influence Analysis, Qualitative Variables & Logistic Regression

Blueprint note: this is a distinct learning module in the Level II Quantitative Methods topic, separate from the misspecification module. Its three learning outcomes are influence analysis, qualitative independent variables, and logistic regression. Vignettes present regression output tables and diagnostic statistics and ask you to interpret them, not to run the estimation.

1. Influence Analysis: Which Observations Are Driving the Fit?

A single data point can dominate an estimated relationship. Influence analysis separates two distinct problems.

Leverage measures how unusual an observation is in the independent variable space. For observation i , the leverage h i i h_{ii} h ii ​ is the i -th diagonal element of the hat matrix, and it satisfies 0 ≤ h i i ≤ 1 0 \le h_{ii} \le 1 0 ≤ h ii ​ ≤ 1 with the leverages summing to k + 1 k+1 k + 1 , where k is the number of independent variables and n the sample size. Because the average leverage is therefore ( k + 1 ) / n (k+1)/n ( k + 1 ) / n , the standard screening rule is:

An observation is potentially influential when h i i > 3 ( k + 1 ) / n h_{ii} > 3\,(k+1)/n h ii ​ > 3 ( k + 1 ) / n .

Outliers are unusual in the dependent variable : the model fits them badly. The scale-free measure is the studentized residual , computed by deleting observation i , re-estimating the model on the remaining n − 1 n-1 n − 1 observations, and standardising the resulting prediction error. A common screen flags ∣ t i ∗ ∣ > 3 |t_i^*| > 3 ∣ t i ∗ ​ ∣ > 3 , though the formal test compares the studentized residual to a critical value from the t distribution with n − k − 2 n - k - 2 n − k − 2 degrees of freedom.

The distinction matters because the two problems have different consequences:

• Situation Unusual in X? Fitted badly? Effect on coefficients
• Ordinary observation No No None
• Outlier only No Yes Inflates the standard error of estimate; limited coefficient distortion
• High leverage only Yes No Reinforces the existing slope; can understate uncertainty
• High leverage and outlier Yes Yes Materially changes the estimated slope

Cook's distance combines both. It measures how much all fitted values move when observation i is deleted: D i = e i 2 k × M S E [ h i i ( 1 − h i i ) 2 ] D_i = \frac{e_i^2}{k \times MSE} \left[ \frac{h_{ii}}{(1 - h_{ii})^2} \right] D i ​ = k × MSE e i 2 ​ ​ [ ( 1 − h ii ​ ) 2 h ii ​ ​ ]

where e i e_i e i ​ is the residual and MSE is the mean squared error of the full regression. Interpretation rules used at Level II:

• D i > 0.5 D_i > 0.5 D i ​ > 0.5 — the observation may be influential and deserves investigation;
• D i > 1.0 D_i > 1.0 D i ​ > 1.0 — the observation is highly likely to be influential ;

an alternative screen compares D i D_i D i ​ to k / n \sqrt{k/n} k / n ​ .

What to do about an influential point is a judgement question that vignettes love. Deleting data because it is inconvenient is not acceptable. The defensible sequence is: verify the observation is not a data error; if it is genuine, consider whether the model is misspecified for that regime (a crisis quarter may require a dummy variable); report results with and without the observation; and disclose the sensitivity. Note the link to Ethics Standard V(A) — silently dropping the observation that reverses your conclusion is not a reasonable and adequate basis.

2. Qualitative Independent Variables

A dummy variable takes the value 1 when a condition holds and 0 otherwise, letting a regression absorb categorical information such as industry, exchange listing, credit-rating band, quarter, or a policy regime.

The dummy variable trap

If a qualitative characteristic has n mutually exclusive categories , include exactly n − 1 dummies when the model has an intercept. The omitted category becomes the base (reference) case and is captured by the intercept. Including all n dummies plus an intercept creates an exact linear dependence — perfect multicollinearity — and the regression cannot be estimated.

Example with four rating buckets (AAA–AA, A, BBB, high yield) and high yield as the base: Spread i = b 0 + b 1 D A A A / A A , i + b 2 D A , i + b 3 D B B B , i + b 4 Leverage i + ε i \text{Spread}_i = b_0 + b_1 D_{AAA/AA,i} + b_2 D_{A,i} + b_3 D_{BBB,i} + b_4 \text{Leverage}_i + \varepsilon_i Spread i ​ = b 0 ​ + b 1 ​ D AAA / AA , i ​ + b 2 ​ D A , i ​ + b 3 ​ D BBB , i ​ + b 4 ​ Leverage i ​ + ε i ​

b 0 b_0 b 0 ​ is the estimated spread for a high-yield issuer with zero leverage;

b 1 b_1 b 1 ​ is the estimated spread difference between an AAA–AA issuer and a high-yield issuer, holding leverage constant;

a t -test on b 1 b_1 b 1 ​ tests whether that difference is statistically significant, not whether AAA–AA spreads are non-zero.

Intercept dummies versus slope (interaction) dummies

An intercept dummy shifts the level of the line. An interaction dummy , formed by multiplying the dummy by a continuous regressor, changes the slope : R i = b 0 + b 1 D i + b 2 X i + b 3 ( D i × X i ) + ε i R_i = b_0 + b_1 D_i + b_2 X_i + b_3 (D_i \times X_i) + \varepsilon_i R i ​ = b 0 ​ + b 1 ​ D i ​ + b 2 ​ X i ​ + b 3 ​ ( D i ​ × X i ​ ) + ε i ​

When D i = 0 D_i = 0 D i ​ = 0 : intercept b 0 b_0 b 0 ​ , slope b 2 b_2 b 2 ​ .

When D i = 1 D_i = 1 D i ​ = 1 : intercept b 0 + b 1 b_0 + b_1 b 0 ​ + b 1 ​ , slope b 2 + b 3 b_2 + b_3 b 2 ​ + b 3 ​ .

So b 1 b_1 b 1 ​ answers "is the level different?" and b 3 b_3 b 3 ​ answers "is the sensitivity different?" A vignette showing a market-beta regression with a recession dummy and a recession-times-market interaction is asking whether beta itself rises in recessions ( b 3 b_3 b 3 ​ ), not merely whether average returns are lower ( b 1 b_1 b 1 ​ ).

Seasonal dummies are the same tool applied to time: three quarterly dummies with the fourth quarter as the base, or eleven monthly dummies.

3. Logistic Regression: Modelling a Binary Outcome

When the dependent variable is binary — default or no default, acquired or not acquired, breach of covenant or not — linear regression is inappropriate. A linear probability model can predict probabilities below 0 or above 1, its errors are heteroskedastic by construction, and its errors cannot be normally distributed.

Logistic regression solves this by modelling the log odds as a linear function of the regressors: ln ⁡ ⁣ ( p 1 − p ) = b 0 + b 1 X 1 + b 2 X 2 + ⋯ + b k X k \ln\!\left(\frac{p}{1-p}\right) = b_0 + b_1 X_1 + b_2 X_2 + \dots + b_k X_k ln ( 1 − p p ​ ) = b 0 ​ + b 1 ​ X 1 ​ + b 2 ​ X 2 ​ + ⋯ + b k ​ X k ​

where p p p is the probability that the event occurs. Solving back for the probability gives the logistic (sigmoid) function: p = 1 1 + e − ( b 0 + b 1 X 1 + ⋯ + b k X k ) p = \frac{1}{1 + e^{-(b_0 + b_1 X_1 + \dots + b_k X_k)}} p = 1 + e − ( b 0 ​ + b 1 ​ X 1 ​ + ⋯ + b k ​ X k ​ ) 1 ​

which is bounded strictly between 0 and 1 and is S-shaped, so extreme values of the regressors move the fitted probability by progressively less.

What the coefficients mean

b j b_j b j ​ is the change in the log odds for a one-unit increase in X j X_j X j ​ , holding other variables constant.

e b j e^{b_j} e b j ​ is the odds ratio : the multiplicative change in the odds. A coefficient of 0.40 means the odds are multiplied by e 0.40 = 1.49 e^{0.40} = 1.49 e 0.40 = 1.49 , a 49% increase in the odds — not a 49% increase in the probability.

The effect on the probability is non-linear and depends on the starting point, which is why vignettes ask for the fitted probability at stated regressor values rather than a marginal effect.

Estimation and model fit

Logistic regression is estimated by maximum likelihood , not ordinary least squares, so there is no R 2 R^2 R 2 in the OLS sense and no F -statistic. Instead:

Likelihood ratio (LR) test : L R = − 2 ( log-likelihood of the restricted model − log-likelihood of the unrestricted model ) LR = -2\,(\text{log-likelihood of the restricted model} - \text{log-likelihood of the unrestricted model}) L R = − 2 ( log-likelihood of the restricted model − log-likelihood of the unrestricted model ) , compared against a chi-square distribution. It plays the role the F -test plays in linear regression.

Individual coefficients are tested with a z -statistic, coefficient divided by its standard error.

A pseudo- R 2 R^2 R 2 may be reported but is not comparable across model types and should not be read as explained variance.

Worked interpretation

A credit analyst estimates a one-year default model on 900 issuers using two regressors, net debt to EBITDA and interest coverage: ln ⁡ ⁣ ( p 1 − p ) = − 4.60 + 0.55 ( Net debt/EBITDA ) − 0.30 ( Interest coverage ) \ln\!\left(\frac{p}{1-p}\right) = -4.60 + 0.55\,(\text{Net debt/EBITDA}) - 0.30\,(\text{Interest coverage}) ln ( 1 − p p ​ ) = − 4.60 + 0.55 ( Net debt/EBITDA ) − 0.30 ( Interest coverage )

For an issuer with net debt to EBITDA of 5.0 times and interest coverage of 2.0 times:

Log odds = − 4.60 + 0.55 ( 5.0 ) − 0.30 ( 2.0 ) = − 4.60 + 2.75 − 0.60 = − 2.45 = -4.60 + 0.55(5.0) - 0.30(2.0) = -4.60 + 2.75 - 0.60 = -2.45 = − 4.60 + 0.55 ( 5.0 ) − 0.30 ( 2.0 ) = − 4.60 + 2.75 − 0.60 = − 2.45

Odds = e − 2.45 = 0.0863 = e^{-2.45} = 0.0863 = e − 2.45 = 0.0863

Probability = 0.0863 / ( 1 + 0.0863 ) = 0.0794 = 0.0863 / (1 + 0.0863) = 0.0794 = 0.0863/ ( 1 + 0.0863 ) = 0.0794 , about 7.9%

Raising net debt to EBITDA by one turn to 6.0 times moves the log odds to − 1.90 -1.90 − 1.90 , odds to e − 1.90 = 0.1496 e^{-1.90} = 0.1496 e − 1.90 = 0.1496 , and the probability to 13.0% . The odds rose by the factor e 0.55 = 1.73 e^{0.55} = 1.73 e 0.55 = 1.73 exactly, while the probability rose by 5.1 percentage points — a figure that would be different if the starting probability were different. That asymmetry is the single most-tested idea in the module.

Level II traps in this learning module

Reading a logistic coefficient as a change in probability rather than in log odds.

Including all n dummies with an intercept and then being asked why the software dropped one.

Treating a high-leverage point as an outlier, or vice versa — they are measured on different axes and have different remedies.

Assuming Cook's distance has a t -distribution; it does not, and the exam uses the 0.5 and 1.0 rules of thumb.

Applying an F -test to a logistic model; the analogous test is the likelihood ratio test.