Study guide

4.1 Exponential Dispersion Family & Link Functions

CAS Property & Casualty Predictive Analytics PCPA

Track your progress as you read

Finished sections get a check mark.

1 Chapter 1: PCPA Exam & Project Orientation

1.1 PCPA Exam Format, Scoring & Registration 1.2 The PCPA Project: Windows, Deliverables & Grading

2 Chapter 2: Dealing with Data — Sourcing, Importing & Assessing

2.1 Requirements Gathering & Assessing Data Relevance 2.2 Importing, Joining & Reshaping Data Sets 2.3 Exploratory Data Analysis & Evaluating a Data Set 2.4 Data Quality Under ASOP 23 & Modeling Under ASOP 56

3 Chapter 3: Dealing with Data — Conditioning P&C Data for a GLM

3.1 Exposure Bases, Weights & Data Grain 3.2 Missing Data Mechanisms & Imputation Strategies 3.3 Outlier Diagnostics, Trimming & Winsorization 3.4 Variable Transformation & Scaling

4 Chapter 4: Model Diagnostics & Selection — Building a GLM

4.1 Exponential Dispersion Family & Link Functions 4.2 Poisson Regression & Exposure Offsets 4.3 Overdispersion, Quasi-Poisson & Negative Binomial 4.4 Gamma & Inverse Gaussian Models for Claim Severity

5 Chapter 5: Model Diagnostics & Selection — Model Form & Predictors

5.1 Tweedie Compound Poisson-Gamma Modeling 5.2 Binomial & Logistic GLMs for Binary Outcomes 5.3 Categorical Predictors, Base Levels & High-Cardinality Grouping 5.4 Interaction Terms & Non-Linear Effects 5.5 Interpreting Coefficients & Multiplicative Relativities

6 Chapter 6: Model Diagnostics & Selection — Evaluating and Improving the Fit

6.1 Deviance, Likelihood Ratio Tests & Residual Diagnostics 6.2 Stepwise Selection & Information Criteria Penalties 6.3 Multicollinearity, Correlated Predictors & Aliasing 6.4 Under-fitting, Over-fitting & Cross-Validation

7 Chapter 7: Model Diagnostics & Selection — Validation & Model Choice

7.1 Actual vs. Predicted, Calibration & Loss Ratio Charts 7.2 Simple Quantile Plots & Measuring Lift 7.3 Double Lift Charts & Competing Model Evaluation 7.4 Gini Index, Lorenz Curves & ROC Curves

8 Chapter 8: Model Interpretation & Presentation — Tables, Charts & Exhibits

8.1 Designing Tables & Statistical Exhibits 8.2 Chart Selection & Graphical Perception 8.3 How Charts Mislead 8.4 One-Way, Two-Way & Partial Dependence Exhibits

9 Chapter 9: Model Interpretation & Presentation — Communicating the Analysis

9.1 Communicating Methodology & Modeling Decisions 9.2 Explaining Why a Variable Was or Was Not Included 9.3 Communicating to Non-Technical Audiences 9.4 The PCPA Technical Report: Structure & Rubric

4.1 Exponential Dispersion Family & Link Functions

Key Takeaways Explain This Topic AI

The Exponential Dispersion Family (EDF) unifies GLM distributions under the general probability density function f(y; theta, phi) = exp{(y*theta - b(theta))/a(phi) + c(y, phi)}.

Key distribution properties derive directly from the cumulant function b(theta): the mean is mu = E[Y] = b'(theta) and the variance is Var(Y) = a(phi)*V(mu), where V(mu) = b''(theta) is the variance function.

Common EDF members in P&C ratemaking include the Normal (V(mu)=1), Poisson (V(mu)=mu), Gamma (V(mu)=mu^2), Inverse Gaussian (V(mu)=mu^3), and Tweedie Compound Poisson-Gamma (V(mu)=mu^p, 1 < p < 2).

While canonical links set g(mu) = theta (such as identity for Normal, log for Poisson, and negative inverse for Gamma), practical insurance ratemaking almost exclusively pairs both frequency and severity models with the log link.

The log link g(mu) = ln(mu) is universally favored in actuarial pricing because it strictly guarantees positive predictions (mu = exp(eta) > 0) and directly generates a multiplicative rating algorithm.

Last updated: September 2026

Theoretical Foundations of Generalized Linear Models

For decades, traditional insurance ratemaking relied on one-way rate indications and minimum-bias procedures (such as Bailey-Simon or Bailey's method) to classify risk. The advent of Generalized Linear Models (GLMs)—introduced by Nelder and Wedderburn in 1972 and expanded by McCullagh and Nelder in 1989—revolutionized actuarial pricing. GLMs provided property and casualty (P&C) actuaries with a unified, rigorous statistical framework capable of handling correlated rating variables, non-normal loss distributions, and exposure weights simultaneously.

Classical Ordinary Least Squares (OLS) regression relies on several foundational assumptions that are fundamentally violated by insurance claims data:

Normality of errors : Claim counts are discrete non-negative integers ( 0 , 1 , 2 , … 0, 1, 2, \dots 0 , 1 , 2 , … ), and claim severities are strictly positive, highly skewed continuous amounts ( y > 0 y > 0 y > 0 ).

Homoscedasticity (constant variance) : In insurance data, risk volatility invariably increases with the expected loss. A policyholder with an expected annual loss of $5,000 exhibits far greater dollar variance than a policyholder with an expected loss of 200 200 200 .

Additive relationship : OLS models additive effects ( μ = x T β \mu = \mathbf{x}^T \boldsymbol{\beta} μ = x T β ), which can easily predict negative claim frequencies or negative loss amounts when linear predictors are negative—an actuarial impossibility.

GLMs resolve each of these structural limitations by expanding linear models in two directions: allowing the response variable to follow any distribution within the Exponential Dispersion Family (EDF) , and connecting the linear predictor to the expected value via a monotonic link function .

The Exponential Dispersion Family (EDF)

A continuous or discrete random variable Y Y Y belongs to the Exponential Dispersion Family if its probability density function (or probability mass function) can be expressed in the general form: f ( y ; θ , ϕ ) = exp ⁡ ( y θ − b ( θ ) a ( ϕ ) + c ( y , ϕ ) ) f(y; \theta, \phi) = \exp\left( \frac{y\theta - b(\theta)}{a(\phi)} + c(y, \phi) \right) f ( y ; θ , ϕ ) = exp ( a ( ϕ ) y θ − b ( θ ) ​ + c ( y , ϕ ) )

Where:

θ \theta θ is the natural (or canonical) parameter , representing location.

ϕ \phi ϕ is the dispersion parameter , representing scale or residual variance.

a ( ϕ ) a(\phi) a ( ϕ ) is the dispersion function , commonly parameterized as a ( ϕ ) = ϕ ω a(\phi) = \frac{\phi}{\omega} a ( ϕ ) = ω ϕ ​ , where ω \omega ω is a known prior weight (such as policy earned exposure or claim count).

b ( θ ) b(\theta) b ( θ ) is the cumulant function (also known as the log-partition function). It is a strictly convex, twice-differentiable function that fully determines the probability distribution's moments.

c ( y , ϕ ) c(y, \phi) c ( y , ϕ ) is the normalizing function , which depends only on the observed data y y y and the dispersion parameter ϕ \phi ϕ , ensuring that the density integrates or sums to 1.

Derivation of Mean and Variance from the Cumulant Function

The fundamental elegance of the EDF lies in the direct mathematical relationship between derivatives of the cumulant function b ( θ ) b(\theta) b ( θ ) and the moments of Y Y Y .

The log-likelihood for a single observation is given by: ln ⁡ f ( y ; θ , ϕ ) = y θ − b ( θ ) a ( ϕ ) + c ( y , ϕ ) \ln f(y; \theta, \phi) = \frac{y\theta - b(\theta)}{a(\phi)} + c(y, \phi) ln f ( y ; θ , ϕ ) = a ( ϕ ) y θ − b ( θ ) ​ + c ( y , ϕ )

Taking the first derivative with respect to the natural parameter θ \theta θ yields the score function U ( θ ) U(\theta) U ( θ ) : U ( θ ) = ∂ ln ⁡ f ∂ θ = y − b ′ ( θ ) a ( ϕ ) U(\theta) = \frac{\partial \ln f}{\partial \theta} = \frac{y - b'(\theta)}{a(\phi)} U ( θ ) = ∂ θ ∂ ln f ​ = a ( ϕ ) y − b ′ ( θ ) ​

By Bartlett's first identity, the expected value of the score function is identically zero ( E [ U ( θ ) ] = 0 \mathbb{E}[U(\theta)] = 0 E [ U ( θ )] = 0 ): E [ Y − b ′ ( θ ) a ( ϕ ) ] = 0 ⟹ E [ Y ] = b ′ ( θ ) \mathbb{E}\left[ \frac{Y - b'(\theta)}{a(\phi)} \right] = 0 \implies \mathbb{E}[Y] = b'(\theta) E [ a ( ϕ ) Y − b ′ ( θ ) ​ ] = 0 ⟹ E [ Y ] = b ′ ( θ )

Thus, the mean μ = E [ Y ] \mu = \mathbb{E}[Y] μ = E [ Y ] is simply the first derivative of the cumulant function: μ = b ′ ( θ ) \mu = b'(\theta) μ = b ′ ( θ )

To find the variance, we differentiate the score function a second time with respect to θ \theta θ : ∂ 2 ln ⁡ f ∂ θ 2 = − b ′ ′ ( θ ) a ( ϕ ) \frac{\partial^2 \ln f}{\partial \theta^2} = -\frac{b''(\theta)}{a(\phi)} ∂ θ 2 ∂ 2 ln f ​ = − a ( ϕ ) b ′′ ( θ ) ​

By Bartlett's second identity, the variance of the score function equals the negative expectation of the second derivative of the log-likelihood (the Fisher Information): Var ( U ( θ ) ) = − E [ ∂ 2 ln ⁡ f ∂ θ 2 ] = b ′ ′ ( θ ) a ( ϕ ) \text{Var}(U(\theta)) = -\mathbb{E}\left[ \frac{\partial^2 \ln f}{\partial \theta^2} \right] = \frac{b''(\theta)}{a(\phi)} Var ( U ( θ )) = − E [ ∂ θ 2 ∂ 2 ln f ​ ] = a ( ϕ ) b ′′ ( θ ) ​

Substituting the definition of the score function U ( θ ) = Y − μ a ( ϕ ) U(\theta) = \frac{Y - \mu}{a(\phi)} U ( θ ) = a ( ϕ ) Y − μ ​ into the variance expression: Var ( Y − μ a ( ϕ ) ) = Var ( Y ) [ a ( ϕ ) ] 2 = b ′ ′ ( θ ) a ( ϕ ) ⟹ Var ( Y ) = a ( ϕ ) b ′ ′ ( θ ) \text{Var}\left( \frac{Y - \mu}{a(\phi)} \right) = \frac{\text{Var}(Y)}{[a(\phi)]^2} = \frac{b''(\theta)}{a(\phi)} \implies \text{Var}(Y) = a(\phi) b''(\theta) Var ( a ( ϕ ) Y − μ ​ ) = [ a ( ϕ ) ] 2 Var ( Y ) ​ = a ( ϕ ) b ′′ ( θ ) ​ ⟹ Var ( Y ) = a ( ϕ ) b ′′ ( θ )

Because b ′ ( θ ) = μ b'(\theta) = \mu b ′ ( θ ) = μ and b ( θ ) b(\theta) b ( θ ) is strictly convex ( b ′ ′ ( θ ) > 0 b''(\theta) > 0 b ′′ ( θ ) > 0 ), the function b ′ ( θ ) b'(\theta) b ′ ( θ ) is strictly monotonic and invertible. We can express θ \theta θ as a function of the mean: θ = ( b ′ ) − 1 ( μ ) \theta = (b')^{-1}(\mu) θ = ( b ′ ) − 1 ( μ ) . Substituting this into b ′ ′ ( θ ) b''(\theta) b ′′ ( θ ) yields the variance function V ( μ ) V(\mu) V ( μ ) : V ( μ ) = b ′ ′ ( θ ( μ ) ) V(\mu) = b''(\theta(\mu)) V ( μ ) = b ′′ ( θ ( μ ))

Therefore, the variance of any EDF distribution decomposes neatly into two distinct terms: Var ( Y ) = a ( ϕ ) V ( μ ) = ϕ ω V ( μ ) \text{Var}(Y) = a(\phi) V(\mu) = \frac{\phi}{\omega} V(\mu) Var ( Y ) = a ( ϕ ) V ( μ ) = ω ϕ ​ V ( μ )

The dispersion component a ( ϕ ) = ϕ / ω a(\phi) = \phi / \omega a ( ϕ ) = ϕ / ω , which captures scale and sample weighting.

The variance function V ( μ ) V(\mu) V ( μ ) , which dictates how the variance responds to changes in the expected mean μ \mu μ .

Core EDF Distributions in Property & Casualty Actuarial Practice

Every distribution used in standard P&C ratemaking belongs to the Exponential Dispersion Family. The specific mathematical form of the variance function V ( μ ) V(\mu) V ( μ ) uniquely determines the underlying probability distribution.

Distribution Insurance Application Natural Parameter θ \theta θ Cumulant b ( θ ) b(\theta) b ( θ ) Dispersion a ( ϕ ) a(\phi) a ( ϕ ) Variance Function V ( μ ) V(\mu) V ( μ ) Variance Var ( Y ) \text{Var}(Y) Var ( Y )

Normal (Gaussian) Benchmark / Baseline μ \mu μ θ 2 2 \frac{\theta^2}{2} 2 θ 2 ​ σ 2 \sigma^2 σ 2 1 1 1 σ 2 \sigma^2 σ 2

Poisson Claim Frequency / Counts ln ⁡ ( μ ) \ln(\mu) ln ( μ ) e θ e^\theta e θ 1 1 1 (fixed) μ \mu μ μ \mu μ

Gamma Claim Severity − 1 μ -\frac{1}{\mu} − μ 1 ​ − ln ⁡ ( − θ ) -\ln(-\theta) − ln ( − θ ) 1 α = ϕ \frac{1}{\alpha} = \phi α 1 ​ = ϕ μ 2 \mu^2 μ 2 ϕ μ 2 \phi \mu^2 ϕ μ 2

Inverse Gaussian Heavy-Tailed Severity − 1 2 μ 2 -\frac{1}{2\mu^2} − 2 μ 2 1 ​ − − 2 θ -\sqrt{-2\theta} − − 2 θ ​ σ 2 = ϕ \sigma^2 = \phi σ 2 = ϕ μ 3 \mu^3 μ 3 ϕ μ 3 \phi \mu^3 ϕ μ 3

Tweedie ( 1 < p < 2 1 < p < 2 1 < p < 2 ) Pure Premium / Loss Cost μ 1 − p 1 − p \frac{\mu^{1-p}}{1-p} 1 − p μ 1 − p ​ μ 2 − p 2 − p \frac{\mu^{2-p}}{2-p} 2 − p μ 2 − p ​ ϕ ω \frac{\phi}{\omega} ω ϕ ​ μ p \mu^p μ p ϕ ω μ p \frac{\phi}{\omega} \mu^p ω ϕ ​ μ p

  • Mathematical Verification of Key Distributions
  • 1. Poisson Distribution (Claim Frequency)

The Poisson probability mass function is P ( Y = y ) = μ y e − μ y ! P(Y = y) = \frac{\mu^y e^{-\mu}}{y!} P ( Y = y ) = y ! μ y e − μ ​ . Rewriting this in exponential form: f ( y ; μ ) = exp ⁡ { y ln ⁡ ( μ ) − μ − ln ⁡ ( y ! ) } f(y; \mu) = \exp\{ y \ln(\mu) - \mu - \ln(y!) \} f ( y ; μ ) = exp { y ln ( μ ) − μ − ln ( y !)}

Comparing this with the EDF density:

  • Natural parameter: θ = ln ⁡ ( μ ) ⟹ μ = e θ \theta = \ln(\mu) \implies \mu = e^\theta θ = ln ( μ ) ⟹ μ = e θ
  • Cumulant function: b ( θ ) = μ = e θ b(\theta) = \mu = e^\theta b ( θ ) = μ = e θ
  • Dispersion function: a ( ϕ ) = 1 a(\phi) = 1 a ( ϕ ) = 1 (dispersion parameter ϕ = 1 \phi = 1 ϕ = 1 is fixed)
  • Normalizing function: c ( y , ϕ ) = − ln ⁡ ( y ! ) c(y, \phi) = -\ln(y!) c ( y , ϕ ) = − ln ( y !)

Checking moments:

Mean: μ = b ′ ( θ ) = d d θ ( e θ ) = e θ = μ \mu = b'(\theta) = \frac{d}{d\theta}(e^\theta) = e^\theta = \mu μ = b ′ ( θ ) = d θ d ​ ( e θ ) = e θ = μ

Variance function: V ( μ ) = b ′ ′ ( θ ) = e θ = μ V(\mu) = b''(\theta) = e^\theta = \mu V ( μ ) = b ′′ ( θ ) = e θ = μ

Variance: Var ( Y ) = a ( ϕ ) V ( μ ) = 1 ⋅ μ = μ \text{Var}(Y) = a(\phi) V(\mu) = 1 \cdot \mu = \mu Var ( Y ) = a ( ϕ ) V ( μ ) = 1 ⋅ μ = μ

This confirms the defining property of the Poisson distribution: the variance strictly equals the mean (equidispersion).

2. Gamma Distribution (Claim Severity)

The Gamma probability density function with shape α \alpha α and rate β \beta β (where μ = α / β \mu = \alpha / \beta μ = α / β and variance σ 2 = α / β 2 = μ 2 / α \sigma^2 = \alpha / \beta^2 = \mu^2 / \alpha σ 2 = α / β 2 = μ 2 / α ) can be written with dispersion ϕ = 1 / α \phi = 1/\alpha ϕ = 1/ α : f ( y ; μ , ϕ ) = 1 Γ ( 1 / ϕ ) ( 1 ϕ μ ) 1 / ϕ y 1 / ϕ − 1 exp ⁡ ( − y ϕ μ ) f(y; \mu, \phi) = \frac{1}{\Gamma(1/\phi)} \left( \frac{1}{\phi \mu} \right)^{1/\phi} y^{1/\phi - 1} \exp\left( -\frac{y}{\phi \mu} \right) f ( y ; μ , ϕ ) = Γ ( 1/ ϕ ) 1 ​ ( ϕ μ 1 ​ ) 1/ ϕ y 1/ ϕ − 1 exp ( − ϕ μ y ​ )

In EDF form: f ( y ; μ , ϕ ) = exp ⁡ ( y ( − 1 / μ ) − ln ⁡ ( μ ) ϕ + c ( y , ϕ ) ) f(y; \mu, \phi) = \exp\left( \frac{y(-1/\mu) - \ln(\mu)}{\phi} + c(y, \phi) \right) f ( y ; μ , ϕ ) = exp ( ϕ y ( − 1/ μ ) − ln ( μ ) ​ + c ( y , ϕ ) )

Natural parameter: θ = − 1 μ ⟹ μ = − 1 θ \theta = -\frac{1}{\mu} \implies \mu = -\frac{1}{\theta} θ = − μ 1 ​ ⟹ μ = − θ 1 ​

Cumulant function: b ( θ ) = ln ⁡ ( μ ) = − ln ⁡ ( − θ ) b(\theta) = \ln(\mu) = -\ln(-\theta) b ( θ ) = ln ( μ ) = − ln ( − θ )

Dispersion function: a ( ϕ ) = ϕ = 1 α a(\phi) = \phi = \frac{1}{\alpha} a ( ϕ ) = ϕ = α 1 ​

Checking moments:

Mean: μ = b ′ ( θ ) = − 1 − θ ( − 1 ) = − 1 θ = μ \mu = b'(\theta) = -\frac{1}{-\theta}(-1) = -\frac{1}{\theta} = \mu μ = b ′ ( θ ) = − − θ 1 ​ ( − 1 ) = − θ 1 ​ = μ

Variance function: V ( μ ) = b ′ ′ ( θ ) = 1 θ 2 = ( − 1 μ ) − 2 = μ 2 V(\mu) = b''(\theta) = \frac{1}{\theta^2} = \left(-\frac{1}{\mu}\right)^{-2} = \mu^2 V ( μ ) = b ′′ ( θ ) = θ 2 1 ​ = ( − μ 1 ​ ) − 2 = μ 2

Variance: Var ( Y ) = a ( ϕ ) V ( μ ) = ϕ μ 2 \text{Var}(Y) = a(\phi) V(\mu) = \phi \mu^2 Var ( Y ) = a ( ϕ ) V ( μ ) = ϕ μ 2

Because the variance is proportional to μ 2 \mu^2 μ 2 , the coefficient of variation ( C V CV C V ) is constant: C V = Var ( Y ) μ = ϕ μ 2 μ = ϕ = 1 α CV = \frac{\sqrt{\text{Var}(Y)}}{\mu} = \frac{\sqrt{\phi \mu^2}}{\mu} = \sqrt{\phi} = \frac{1}{\sqrt{\alpha}} C V = μ Var ( Y ) ​ ​ = μ ϕ μ 2 ​ ​ = ϕ ​ = α ​ 1 ​

This constant C V CV C V property aligns with property damage claims: a 10 % 10\% 10% fluctuation on a commercial property policy is proportionally identical to a 10 % 10\% 10% fluctuation on a personal auto policy, even though the absolute dollar variance is dramatically larger.

Link Functions: Canonical vs. Practical

A Generalized Linear Model connects the expected value of the response μ i = E [ Y i ] \mu_i = \mathbb{E}[Y_i] μ i ​ = E [ Y i ​ ] to a linear combination of explanatory rating variables x i = [ 1 , x i 1 , x i 2 , … , x i k ] T \mathbf{x}_i = [1, x_{i1}, x_{i2}, \dots, x_{ik}]^T x i ​ = [ 1 , x i 1 ​ , x i 2 ​ , … , x ik ​ ] T through a monotonic, differentiable link function g ( ⋅ ) g(\cdot) g ( ⋅ ) : η i = g ( μ i ) = x i T β = β 0 + β 1 x i 1 + β 2 x i 2 + ⋯ + β k x i k \eta_i = g(\mu_i) = \mathbf{x}_i^T \boldsymbol{\beta} = \beta_0 + \beta_1 x_{i1} + \beta_2 x_{i2} + \dots + \beta_k x_{ik} η i ​ = g ( μ i ​ ) = x i T ​ β = β 0 ​ + β 1 ​ x i 1 ​ + β 2 ​ x i 2 ​ + ⋯ + β k ​ x ik ​

Where η i \eta_i η i ​ is called the linear predictor . The link function maps the domain of the mean μ i \mu_i μ i ​ (which may be restricted, such as μ > 0 \mu > 0 μ > 0 for insurance losses) to the entire real line ( − ∞ , ∞ ) (-\infty, \infty) ( − ∞ , ∞ ) of the linear predictor.

The Canonical Link Function

The link function that directly equates the linear predictor to the natural parameter θ \theta θ is called the canonical link : g ( μ ) = θ ( μ ) g(\mu) = \theta(\mu) g ( μ ) = θ ( μ )

For the Normal distribution : θ = μ ⟹ g ( μ ) = μ \theta = \mu \implies g(\mu) = \mu θ = μ ⟹ g ( μ ) = μ ( Identity link ).

For the Poisson distribution : θ = ln ⁡ ( μ ) ⟹ g ( μ ) = ln ⁡ ( μ ) \theta = \ln(\mu) \implies g(\mu) = \ln(\mu) θ = ln ( μ ) ⟹ g ( μ ) = ln ( μ ) ( Log link ).

For the Gamma distribution : θ = − 1 / μ ⟹ g ( μ ) = − 1 / μ \theta = -1/\mu \implies g(\mu) = -1/\mu θ = − 1/ μ ⟹ g ( μ ) = − 1/ μ (or 1 / μ 1/\mu 1/ μ ) ( Negative inverse link ).

For the Inverse Gaussian distribution : θ = − 1 / ( 2 μ 2 ) ⟹ g ( μ ) = 1 / μ 2 \theta = -1/(2\mu^2) \implies g(\mu) = 1/\mu^2 θ = − 1/ ( 2 μ 2 ) ⟹ g ( μ ) = 1/ μ 2 ( Inverse squared link ).

Theoretical Properties of Canonical Links

Canonical links offer attractive mathematical properties in statistical estimation:

Sufficient statistics : The vector X T y \mathbf{X}^T \mathbf{y} X T y forms a minimal sufficient statistic for β \boldsymbol{\beta} β .

Fisher scoring equals Newton-Raphson : The observed Hessian matrix matches the expected Fisher Information matrix everywhere in the parameter space, guaranteeing quadratic convergence.

Unbiased marginal totals : Under a canonical link with an intercept, the sum of fitted values strictly equals the sum of observed values across the training data: ∑ i = 1 n y i = ∑ i = 1 n μ ^ i \sum_{i=1}^n y_i = \sum_{i=1}^n \hat{\mu}_i i = 1 ∑ n ​ y i ​ = i = 1 ∑ n ​ μ ^ ​ i ​

Why Canonical Links Often Fail in Practical Actuarial Pricing

Despite their theoretical elegance, canonical links are frequently unviable for insurance pricing outside the Poisson distribution. Consider modeling claim severity using a Gamma distribution with its canonical link g ( μ ) = − 1 / μ g(\mu) = -1/\mu g ( μ ) = − 1/ μ (or 1 / μ 1/\mu 1/ μ ): 1 μ i = β 0 + β 1 x i 1 + ⋯ + β k x i k \frac{1}{\mu_i} = \beta_0 + \beta_1 x_{i1} + \dots + \beta_k x_{ik} μ i ​ 1 ​ = β 0 ​ + β 1 ​ x i 1 ​ + ⋯ + β k ​ x ik ​

If the linear combination x i T β \mathbf{x}_i^T \boldsymbol{\beta} x i T ​ β evaluates to a negative number or zero for certain risk profiles (e.g., highly favorable credit tier, high deductible, mature driver), the model predicts a negative or infinite expected severity μ ^ i \hat{\mu}_i μ ^ ​ i ​ . Because claim severity is strictly positive ( y > 0 y > 0 y > 0 ), a negative prediction crashes rating engines and violates the physical reality of insurance claims.

Why the Log Link is Universally Favored in P&C Ratemaking

In casualty actuarial practice, both frequency models (Poisson, Negative Binomial) and severity models (Gamma, Inverse Gaussian) are almost universally specified with the log link : g ( μ ) = ln ⁡ ( μ ) ⟺ μ = exp ⁡ ( x T β ) g(\mu) = \ln(\mu) \iff \mu = \exp(\mathbf{x}^T \boldsymbol{\beta}) g ( μ ) = ln ( μ ) ⟺ μ = exp ( x T β )

There are two primary reasons why the log link dominates commercial rate filings:

1. Enforcing Strictly Positive Predictions

Because the exponential function maps any real number to the positive real line: μ i = exp ⁡ ( β 0 + ∑ j = 1 k β j x i j ) > 0 ∀ x i T β ∈ ( − ∞ , ∞ ) \mu_i = \exp\left(\beta_0 + \sum_{j=1}^k \beta_j x_{ij}\right) > 0 \quad \forall \quad \mathbf{x}_i^T \boldsymbol{\beta} \in (-\infty, \infty) μ i ​ = exp ( β 0 ​ + j = 1 ∑ k ​ β j ​ x ij ​ ) > 0 ∀ x i T ​ β ∈ ( − ∞ , ∞ )

No combination of predictor values—regardless of how extreme or favorable the risk characteristics are—can ever produce a negative or zero frequency, severity, or pure premium.

2. Direct Equivalence to Multiplicative Rating Relativities

Traditional property and casualty rating manuals calculate policyholder premium through a multiplicative algorithm: Premium = Base Rate × Territory Factor × Driver Class Factor × Vehicle Factor \text{Premium} = \text{Base Rate} \times \text{Territory Factor} \times \text{Driver Class Factor} \times \text{Vehicle Factor} Premium = Base Rate × Territory Factor × Driver Class Factor × Vehicle Factor

The log link translates regression coefficients directly into this multiplicative structure without requiring any ad-hoc adjustments: μ i = exp ⁡ ( β 0 ) × exp ⁡ ( β 1 x i 1 ) × exp ⁡ ( β 2 x i 2 ) × ⋯ × exp ⁡ ( β k x i k ) \mu_i = \exp(\beta_0) \times \exp(\beta_1 x_{i1}) \times \exp(\beta_2 x_{i2}) \times \dots \times \exp(\beta_k x_{ik}) μ i ​ = exp ( β 0 ​ ) × exp ( β 1 ​ x i 1 ​ ) × exp ( β 2 ​ x i 2 ​ ) × ⋯ × exp ( β k ​ x ik ​ )

The intercept term exp ⁡ ( β 0 ) \exp(\beta_0) exp ( β 0 ​ ) represents the Base Rate (the expected cost for a policyholder with all baseline attributes).

For any categorical predictor x j x_j x j ​ , the exponentiated coefficient exp ⁡ ( β j ) \exp(\beta_j) exp ( β j ​ ) is the Rating Relativity (Rating Factor) .

If a suburban territory has β terr = 0.20 \beta_{\text{terr}} = 0.20 β terr ​ = 0.20 , its rating factor is exp ⁡ ( 0.20 ) = 1.2214 \exp(0.20) = 1.2214 exp ( 0.20 ) = 1.2214 , representing an immediate + 22.14 % +22.14\% + 22.14% rate relativity relative to the base territory. GLM Linear Scale (Additive): eta = beta_0 + beta_1*Territory + beta_2*Class

  • │
  • [Log Link: mu = exp(eta)]
  • │
  • Actuarial Rating Manual: mu = Base Rate * Relativity_Territory * Relativity_Class
  • [exp(beta_0)] [exp(beta_1)] [exp(beta_2)]
  • Retransformation Bias & Jensen's Inequality: GLM vs. Transformed OLS

A classic mistake made by novice analysts is attempting to achieve a multiplicative model by taking the natural logarithm of the response variable and fitting an Ordinary Least Squares regression: ln ⁡ ( Y i ) = β 0 + x i T β + ε i , ε i ∼ N ( 0 , σ 2 ) \ln(Y_i) = \beta_0 + \mathbf{x}_i^T \boldsymbol{\beta} + \varepsilon_i, \quad \varepsilon_i \sim \mathcal{N}(0, \sigma^2) ln ( Y i ​ ) = β 0 ​ + x i T ​ β + ε i ​ , ε i ​ ∼ N ( 0 , σ 2 )

Predictions are then obtained by exponentiating: Y ^ i = exp ⁡ ( β ^ 0 + x i T β ^ ) \hat{Y}_i = \exp(\hat{\beta}_0 + \mathbf{x}_i^T \hat{\boldsymbol{\beta}}) Y ^ i ​ = exp ( β ^ ​ 0 ​ + x i T ​ β ^ ​ ) . This procedure suffers from severe retransformation bias governed by Jensen's Inequality .

Because the logarithm is a strictly concave function, the expected value of the log is strictly less than the log of the expected value for any random variable with non-zero variance: E [ ln ⁡ ( Y ) ] < ln ⁡ ( E [ Y ] ) \mathbb{E}[\ln(Y)] < \ln(\mathbb{E}[Y]) E [ ln ( Y )] < ln ( E [ Y ])

Consequently, exponentiating the expected log response recovers the geometric mean (or the median under lognormality), not the expected value: exp ⁡ ( E [ ln ⁡ ( Y ) ] ) ≠ E [ Y ] \exp(\mathbb{E}[\ln(Y)]) \ne \mathbb{E}[Y] exp ( E [ ln ( Y )])  = E [ Y ]

Under log-normality, the exact relationship is: E [ Y ] = exp ⁡ ( E [ ln ⁡ ( Y ) ] + σ 2 2 ) = exp ⁡ ( x T β ) ⋅ exp ⁡ ( σ 2 2 ) \mathbb{E}[Y] = \exp\left( \mathbb{E}[\ln(Y)] + \frac{\sigma^2}{2} \right) = \exp(\mathbf{x}^T \boldsymbol{\beta}) \cdot \exp\left(\frac{\sigma^2}{2}\right) E [ Y ] = exp ( E [ ln ( Y )] + 2 σ 2 ​ ) = exp ( x T β ) ⋅ exp ( 2 σ 2 ​ )

Failing to include the correction factor exp ⁡ ( σ 2 / 2 ) \exp(\sigma^2 / 2) exp ( σ 2 /2 ) results in systematic underpricing across the portfolio.

In contrast, a GLM with a log link directly models the logarithm of the expectation: ln ⁡ ( E [ Y ] ) = x T β ⟺ E [ Y ] = exp ⁡ ( x T β ) \ln(\mathbb{E}[Y]) = \mathbf{x}^T \boldsymbol{\beta} \iff \mathbb{E}[Y] = \exp(\mathbf{x}^T \boldsymbol{\beta}) ln ( E [ Y ]) = x T β ⟺ E [ Y ] = exp ( x T β )

The GLM operates on the scale of the original losses, correctly preserving the arithmetic mean without introducing retransformation bias or requiring smearing estimators.

Actuarial Exam Traps & Pitfalls

Warning

Trap 1: Confusing the Dispersion Parameter with the Variance Function On CAS exams, candidates often confuse ϕ \phi ϕ with V ( μ ) V(\mu) V ( μ ) . Remember that the variance is Var ( Y ) = ϕ ω V ( μ ) \text{Var}(Y) = \frac{\phi}{\omega} V(\mu) Var ( Y ) = ω ϕ ​ V ( μ ) . For a Poisson model, ϕ = 1 \phi = 1 ϕ = 1 and V ( μ ) = μ V(\mu) = \mu V ( μ ) = μ . For a Gamma model, ϕ = 1 / α \phi = 1/\alpha ϕ = 1/ α (the reciprocal of the shape parameter) and V ( μ ) = μ 2 V(\mu) = \mu^2 V ( μ ) = μ 2 . If an exam question asks for the variance function of a Gamma distribution, the correct answer is μ 2 \mu^2 μ 2 , not ϕ μ 2 \phi \mu^2 ϕ μ 2 .

Warning

Trap 2: Assuming Canonical Links are Mandatory Canonical links possess elegant mathematical properties (e.g., minimal sufficient statistics), but in practice, actuaries almost never use the canonical link for Gamma severity models ( g ( μ ) = − 1 / μ g(\mu) = -1/\mu g ( μ ) = − 1/ μ ). Using the canonical link for Gamma risks negative severity predictions. The log link is standard across the P&C industry for both frequency and severity.

Warning

Trap 3: Log-Transforming the Target in OLS vs. Using a Log-Link GLM Modeling ln ⁡ ( Y ) \ln(Y) ln ( Y ) with OLS models E [ ln ⁡ ( Y ) ] \mathbb{E}[\ln(Y)] E [ ln ( Y )] , which yields the geometric mean when exponentiated. Modeling Y Y Y with a log-link GLM models ln ⁡ ( E [ Y ] ) \ln(\mathbb{E}[Y]) ln ( E [ Y ]) , directly yielding the actuarially required arithmetic mean.