Study guide

7.4 Gini Index, Lorenz Curves & ROC Curves

CAS Property & Casualty Predictive Analytics PCPA

Track your progress as you read

Finished sections get a check mark.

1 Chapter 1: PCPA Exam & Project Orientation

1.1 PCPA Exam Format, Scoring & Registration 1.2 The PCPA Project: Windows, Deliverables & Grading

2 Chapter 2: Dealing with Data — Sourcing, Importing & Assessing

2.1 Requirements Gathering & Assessing Data Relevance 2.2 Importing, Joining & Reshaping Data Sets 2.3 Exploratory Data Analysis & Evaluating a Data Set 2.4 Data Quality Under ASOP 23 & Modeling Under ASOP 56

3 Chapter 3: Dealing with Data — Conditioning P&C Data for a GLM

3.1 Exposure Bases, Weights & Data Grain 3.2 Missing Data Mechanisms & Imputation Strategies 3.3 Outlier Diagnostics, Trimming & Winsorization 3.4 Variable Transformation & Scaling

4 Chapter 4: Model Diagnostics & Selection — Building a GLM

4.1 Exponential Dispersion Family & Link Functions 4.2 Poisson Regression & Exposure Offsets 4.3 Overdispersion, Quasi-Poisson & Negative Binomial 4.4 Gamma & Inverse Gaussian Models for Claim Severity

5 Chapter 5: Model Diagnostics & Selection — Model Form & Predictors

5.1 Tweedie Compound Poisson-Gamma Modeling 5.2 Binomial & Logistic GLMs for Binary Outcomes 5.3 Categorical Predictors, Base Levels & High-Cardinality Grouping 5.4 Interaction Terms & Non-Linear Effects 5.5 Interpreting Coefficients & Multiplicative Relativities

6 Chapter 6: Model Diagnostics & Selection — Evaluating and Improving the Fit

6.1 Deviance, Likelihood Ratio Tests & Residual Diagnostics 6.2 Stepwise Selection & Information Criteria Penalties 6.3 Multicollinearity, Correlated Predictors & Aliasing 6.4 Under-fitting, Over-fitting & Cross-Validation

7 Chapter 7: Model Diagnostics & Selection — Validation & Model Choice

7.1 Actual vs. Predicted, Calibration & Loss Ratio Charts 7.2 Simple Quantile Plots & Measuring Lift 7.3 Double Lift Charts & Competing Model Evaluation 7.4 Gini Index, Lorenz Curves & ROC Curves

8 Chapter 8: Model Interpretation & Presentation — Tables, Charts & Exhibits

8.1 Designing Tables & Statistical Exhibits 8.2 Chart Selection & Graphical Perception 8.3 How Charts Mislead 8.4 One-Way, Two-Way & Partial Dependence Exhibits

9 Chapter 9: Model Interpretation & Presentation — Communicating the Analysis

9.1 Communicating Methodology & Modeling Decisions 9.2 Explaining Why a Variable Was or Was Not Included 9.3 Communicating to Non-Technical Audiences 9.4 The PCPA Technical Report: Structure & Rubric

7.4 Gini Index, Lorenz Curves & ROC Curves

Key Takeaways Explain This Topic AI

The insurance Lorenz curve orders policies in ascending order of model-predicted pure premium, plotting cumulative percentage of earned exposure on the x-axis against cumulative percentage of actual losses on the y-axis.

The Gini coefficient quantifies risk discrimination as twice the area between the Lorenz curve and the 45-degree diagonal line of equality: Gini = 2 * Area(A) = 1 - 2 * Area(B), ranging from 0.0 (no separation) to 1.0 (extreme separation).

Because insurance losses are subject to intrinsic process risk (claim randomness), raw Gini cannot attain 1.0; actuaries compute Normalized Gini (Gini / Gini_max) against an oracle sort of actual losses to evaluate achieved discrimination relative to the theoretical upper bound.

For binary claim occurrence (claim vs. zero-claim), the Receiver Operating Characteristic (ROC) curve plots True Positive Rate vs. False Positive Rate; Area Under the Curve (AUC) equals the Concordance statistic C and relates to Gini via Gini = 2 * AUC - 1.

Discrimination metrics (Gini, AUC) evaluate only the rank order of predicted risks and are invariant under any strictly positive scalar multiplication or monotonic transformation; they provide zero indication of dollar calibration or rate adequacy.

Last updated: September 2026

Discrimination vs. Calibration in Actuarial Predictive Modeling

When evaluating a property and casualty (P&C) predictive model—whether a frequency-severity Generalized Linear Model (GLM), a Tweedie compound Poisson-Gamma regression, or a logistic large-loss model—actuaries must assess model performance across two distinct, complementary dimensions:

Discrimination (Risk Separation / Rank Ordering) : The model's ability to differentiate low-risk policyholders from high-risk policyholders. A highly discriminatory model successfully concentrates actual incurred losses into the highest predicted risk percentiles.

Calibration (Scale / Absolute Dollar Adequacy) : The model's ability to predict the true expected dollar loss cost. A well-calibrated model produces fitted values whose aggregate sum matches observed losses both across the entire portfolio and within specific rating segments.

In competitive insurance markets, discrimination is the primary weapon against adverse selection . If a competitor segments risks more granularly than your company, they will discount low-risk insureds and leave you with overpriced, unprofitable risks. However, evaluating discrimination requires specialized statistical metrics that are sensitive to policy exposure and severe claim skewness.

The Lorenz Curve for Insurance Pure Premium

The Lorenz curve , originally introduced by Max Lorenz in 1905 to depict economic income inequality, was adapted to casualty actuarial science by Frees, Meyers, and Cummings (2011, 2014). In economics, the curve plots the cumulative share of population against the cumulative share of income. In P&C ratemaking, the Lorenz curve assesses how effectively a predictive model concentrates actual claim dollars by ordering policies according to predicted pure premium. LORENZ CURVE CONSTRUCTION

  • Cumulative % of
  • Actual Losses (y)
  • 100% ┼───────────────────────────────────────────────────────────────┐
  • │ . ╱│
  • │ . ╱ │
  • │ . ╱ │
  • │ . ╱ │
  • │ . ╱ │
  • │ . ╱ Area A │
  • │ 45° Line of . ╱ (Between Line │
  • │ Perfect Equality . ╱ & Curve) │
  • │ (Gini = 0) . ╱ │
  • │ . ╱ │
  • │ . ╱ Empirical Lorenz Curve │
  • │ . ╱ L(u) [Sorted by mu_hat] │
  • │ . ╱ ───────────────────────── │
  • │ . ╱ ╱ │
  • │ . ╱ ╱ Area B │
  • │ . ╱ ╱ (Under Empirical │
  • │ . ╱ ╱ Curve) │
  • │ . ╱ ╱ │
  • │ . ╱ ╱ │
  • │ . ╱ ╱ │
  • 0% ┼──┴───────────────────────────┴────────────────────────────────┤
  • 0% 100%
  • Cumulative % of Earned Exposure (u)
  • The 3-Step Construction Protocol

To construct an insurance Lorenz curve from a validation dataset containing n n n policies, follow this three-step protocol:

Step 1: Sort Policies by Model-Predicted Pure Premium

Order all n n n policies in strictly ascending order of their model-predicted pure premium (or predicted loss cost per unit of exposure), μ ^ i \hat{\mu}_i μ ^ ​ i ​ : μ ^ ( 1 ) ≤ μ ^ ( 2 ) ≤ ⋯ ≤ μ ^ ( n ) \hat{\mu}_{(1)} \le \hat{\mu}_{(2)} \le \dots \le \hat{\mu}_{(n)} μ ^ ​ ( 1 ) ​ ≤ μ ^ ​ ( 2 ) ​ ≤ ⋯ ≤ μ ^ ​ ( n ) ​

Where ( i ) (i) ( i ) represents the index of the policy in the ordered sequence. Let e ( i ) e_{(i)} e ( i ) ​ denote the earned exposure (e.g., car-years, house-years) and y ( i ) y_{(i)} y ( i ) ​ denote the actual observed aggregate loss dollars incurred by policy ( i ) (i) ( i ) .

Step 2: Plot Cumulative Percentage of Earned Exposure on the X-Axis

For any policy cutoff t ∈ { 1 , 2 , … , n } t \in \{1, 2, \dots, n\} t ∈ { 1 , 2 , … , n } , calculate the cumulative fraction of total portfolio earned exposure: ν ( t ) = ∑ i = 1 t e ( i ) ∑ i = 1 n e ( i ) = ∑ i = 1 t e ( i ) E total , u ( t ) ∈ [ 0 , 1 ] \nu(t) = \frac{\sum_{i=1}^t e_{(i)}}{\sum_{i=1}^n e_{(i)}} = \frac{\sum_{i=1}^t e_{(i)}}{E_{\text{total}}}, \quad u(t) \in [0, 1] ν ( t ) = ∑ i = 1 n ​ e ( i ) ​ ∑ i = 1 t ​ e ( i ) ​ ​ = E total ​ ∑ i = 1 t ​ e ( i ) ​ ​ , u ( t ) ∈ [ 0 , 1 ]

The horizontal axis represents u u u , spanning from 0 % 0\% 0% to 100 % 100\% 100% of earned exposure.

Step 3: Plot Cumulative Percentage of Actual Losses on the Y-Axis

For the same policy cutoff t t t , calculate the cumulative fraction of total actual observed losses: L ( u ( t ) ) = ∑ i = 1 t y ( i ) ∑ i = 1 n y ( i ) = ∑ i = 1 t y ( i ) Y total , L ( u ( t ) ) ∈ [ 0 , 1 ] L(u(t)) = \frac{\sum_{i=1}^t y_{(i)}}{\sum_{i=1}^n y_{(i)}} = \frac{\sum_{i=1}^t y_{(i)}}{Y_{\text{total}}}, \quad L(u(t)) \in [0, 1] L ( u ( t )) = ∑ i = 1 n ​ y ( i ) ​ ∑ i = 1 t ​ y ( i ) ​ ​ = Y total ​ ∑ i = 1 t ​ y ( i ) ​ ​ , L ( u ( t )) ∈ [ 0 , 1 ]

The vertical axis represents L ( u ) L(u) L ( u ) , spanning from 0 % 0\% 0% to 100 % 100\% 100% of actual incurred loss dollars.

Interpreting the Geometry of the Lorenz Curve

The 45-Degree Diagonal Line of Perfect Equality ( L ( u ) = u L(u) = u L ( u ) = u ) :

If a pricing model has zero discriminatory capability—such as assigning the exact same flat average loss cost to every policyholder or predicting random numbers—the policies are ordered randomly with respect to risk. Under this uninformative baseline, the bottom 20 % 20\% 20% of exposure accounts for 20 % 20\% 20% of losses, the bottom 50 % 50\% 50% of exposure accounts for 50 % 50\% 50% of losses, and L ( u ) = u L(u) = u L ( u ) = u across the entire domain.

The Empirical Lorenz Curve ( L ( u ) L(u) L ( u ) ) :

Because the policies are sorted from lowest predicted risk to highest, an effective model places policyholders with near-zero claim likelihood at the beginning. Consequently, the empirical curve initially hugs the horizontal axis (e.g., the bottom 40 % 40\% 40% of exposure might incur only 6 % 6\% 6% of actual losses). As the curve accumulates higher-risk policies, its slope increases monotonically, rising steeply toward ( 1 , 1 ) (1, 1) ( 1 , 1 ) .

Curvature and Model Strength :

The greater the downward sag (bowing) of the Lorenz curve away from the 45-degree diagonal, the superior the model's ability to separate low-risk from high-risk insureds.

Derivation of the Gini Coefficient

The Gini coefficient ( G G G ) summarizes the discriminatory strength of the Lorenz curve into a single scalar statistic between 0.0 0.0 0.0 and 1.0 1.0 1.0 . Geometrically, it is defined as the ratio of the area between the 45-degree diagonal line of equality and the empirical Lorenz curve (Area A A A ) to the total area under the 45-degree diagonal: G = Area ( A ) Area under Diagonal G = \frac{\text{Area}(A)}{\text{Area under Diagonal}} G = Area under Diagonal Area ( A ) ​

Because the diagonal bisects the unit square with vertices ( 0 , 0 ) , ( 1 , 0 ) , ( 1 , 1 ) , ( 0 , 1 ) (0,0), (1,0), (1,1), (0,1) ( 0 , 0 ) , ( 1 , 0 ) , ( 1 , 1 ) , ( 0 , 1 ) , the total area under the diagonal is: Area under Diagonal = 1 2 × 1 × 1 = 0.5 \text{Area under Diagonal} = \frac{1}{2} \times 1 \times 1 = 0.5 Area under Diagonal = 2 1 ​ × 1 × 1 = 0.5

Substituting this into the definition: G = Area ( A ) 0.5 = 2 × Area ( A ) G = \frac{\text{Area}(A)}{0.5} = 2 \times \text{Area}(A) G = 0.5 Area ( A ) ​ = 2 × Area ( A )

Let Area ( B ) \text{Area}(B) Area ( B ) denote the area strictly underneath the empirical Lorenz curve L ( u ) L(u) L ( u ) from u = 0 u = 0 u = 0 to u = 1 u = 1 u = 1 : Area ( B ) = ∫ 0 1 L ( u ) d u \text{Area}(B) = \int_0^1 L(u) \, du Area ( B ) = ∫ 0 1 ​ L ( u ) d u

Because the sum of Area A A A and Area B B B equals the area of the lower triangle: Area ( A ) + Area ( B ) = 0.5 ⟹ Area ( A ) = 0.5 − Area ( B ) \text{Area}(A) + \text{Area}(B) = 0.5 \implies \text{Area}(A) = 0.5 - \text{Area}(B) Area ( A ) + Area ( B ) = 0.5 ⟹ Area ( A ) = 0.5 − Area ( B )

Substituting Area ( A ) \text{Area}(A) Area ( A ) into the Gini formula gives the classical actuarial derivation: G = 2 ( 0.5 − Area ( B ) ) = 1 − 2 × Area ( B ) = 1 − 2 ∫ 0 1 L ( u ) d u G = 2 \left( 0.5 - \text{Area}(B) \right) = 1 - 2 \times \text{Area}(B) = 1 - 2 \int_0^1 L(u) \, du G = 2 ( 0.5 − Area ( B ) ) = 1 − 2 × Area ( B ) = 1 − 2 ∫ 0 1 ​ L ( u ) d u

Discrete Calculation via Trapezoidal Rule

In practical actuarial applications, policyholder data is evaluated across m m m discrete ordered observations (or sorted quantiles, such as percentiles or ventiles). Let u 0 = 0 , u 1 , u 2 , … , u m = 1 u_0 = 0, u_1, u_2, \dots, u_m = 1 u 0 ​ = 0 , u 1 ​ , u 2 ​ , … , u m ​ = 1 be the cumulative exposure points, with corresponding cumulative actual loss fractions L ( u 0 ) = 0 , L ( u 1 ) , … , L ( u m ) = 1 L(u_0) = 0, L(u_1), \dots, L(u_m) = 1 L ( u 0 ​ ) = 0 , L ( u 1 ​ ) , … , L ( u m ​ ) = 1 .

Using the trapezoidal approximation for numerical integration: Area ( B ) ≈ ∑ k = 1 m L ( u k − 1 ) + L ( u k ) 2 × ( u k − u k − 1 ) \text{Area}(B) \approx \sum_{k=1}^m \frac{L(u_{k-1}) + L(u_k)}{2} \times (u_k - u_{k-1}) Area ( B ) ≈ k = 1 ∑ m ​ 2 L ( u k − 1 ​ ) + L ( u k ​ ) ​ × ( u k ​ − u k − 1 ​ )

Substituting Area ( B ) \text{Area}(B) Area ( B ) into the Gini equation: G = 1 − ∑ k = 1 m [ L ( u k − 1 ) + L ( u k ) ] ( u k − u k − 1 ) G = 1 - \sum_{k=1}^m \left[ L(u_{k-1}) + L(u_k) \right] (u_k - u_{k-1}) G = 1 − k = 1 ∑ m ​ [ L ( u k − 1 ​ ) + L ( u k ​ ) ] ( u k ​ − u k − 1 ​ )

When evaluating over m m m equal-exposure bins (such as 10 deciles where u k − u k − 1 = 1 m = 0.10 u_k - u_{k-1} = \frac{1}{m} = 0.10 u k ​ − u k − 1 ​ = m 1 ​ = 0.10 ): G = 1 − 1 m ∑ k = 1 m [ L ( u k − 1 ) + L ( u k ) ] G = 1 - \frac{1}{m} \sum_{k=1}^m \left[ L(u_{k-1}) + L(u_k) \right] G = 1 − m 1 ​ k = 1 ∑ m ​ [ L ( u k − 1 ​ ) + L ( u k ​ ) ]

Benchmark Gini Ranges in P&C Insurance

Gini Range Discrimination Quality Actuarial Context & Business Interpretation

G < 0.15 G < 0.15 G < 0.15 Poor / Weak Model provides marginal separation. Risk classification variables fail to segment loss propensity effectively.

0.15 ≤ G < 0.30 0.15 \le G < 0.30 0.15 ≤ G < 0.30 Moderate / Typical Standard range for personal auto physical damage (collision/comprehensive) and homeowners property where frequency is low and process risk dominates.

0.30 ≤ G < 0.45 0.30 \le G < 0.45 0.30 ≤ G < 0.45 Strong / High Highly competitive rating plan. Typical of sophisticated personal auto books incorporating telematics driving scores, credit-based insurance scores, and territory-vehicle interaction terms.

G ≥ 0.45 G \ge 0.45 G ≥ 0.45 Exceptional / Specialized Rare in standard personal lines. Observed in commercial casualty books with extreme risk heterogeneity (e.g., hazardous fleet trucking vs. local delivery).

The Normalized Gini: Benchmarking Against Inherent Process Risk

A critical conceptual trap on the CAS PCPA exam is assuming that an ideal insurance pricing model should achieve a Gini coefficient near 1.0 1.0 1.0 .

In economics, if one individual earned all income in an economy, the Lorenz curve would follow the bottom axis and right vertical edge, yielding G = 1.0 G = 1.0 G = 1.0 . However, in property and casualty insurance, claims are stochastic realizations governed by severe process risk (pure claim randomness) .

The Problem of Inherent Process Risk

Consider an omniscient actuary who knows the exact hypothetical true loss cost E [ Y i ∣ X i ] \mathbb{E}[Y_i \mid \mathbf{X}_i] E [ Y i ​ ∣ X i ​ ] for every policyholder in the portfolio (the theoretical "Bayes optimal" or "Oracle" model):

A high-risk commercial driver with a 30 % 30\% 30% annual claim probability still has a 70 % 70\% 70% probability of experiencing zero claims in any single policy year.

A pristine driver with a 1.5 % 1.5\% 1.5% annual claim probability can still suffer a catastrophic multi-car collision due to severe icy weather.

Because actual observed losses y i y_i y i ​ contain irreducible random process noise, even the true generating model cannot order individual realized claims perfectly. Realized losses will never align monotonically with expected risk, which bounds the empirical Gini well below 1.0 1.0 1.0 .

Constructing the Oracle (Maximum) Lorenz Curve

To establish the realistic upper ceiling of discrimination for a specific portfolio, actuaries calculate the theoretical maximum Gini , denoted G max ⁡ G_{\max} G m a x ​ :

Sort the validation policies in ascending order of actual observed losses , y i y_i y i ​ (or actual empirical pure premium y i / e i y_i / e_i y i ​ / e i ​ ).

All policyholders with zero claims ( y i = 0 y_i = 0 y i ​ = 0 ) are placed first. These zero-claim policies account for a massive fraction of exposure (often 85 % 85\% 85% to 95 % 95\% 95% in personal auto).

Policyholders with claims are then sorted from smallest dollar severity to largest dollar severity.

Calculate the resulting empirical Lorenz curve, L max ⁡ ( u ) L_{\max}(u) L m a x ​ ( u ) , and its associated Gini coefficient, G max ⁡ G_{\max} G m a x ​ .

The curve L max ⁡ ( u ) L_{\max}(u) L m a x ​ ( u ) remains flat along the horizontal axis ( L max ⁡ ( u ) = 0 L_{\max}(u) = 0 L m a x ​ ( u ) = 0 ) until all zero-claim exposures are exhausted, after which it rises steeply to 1.0 1.0 1.0 as the shock losses are accumulated. MAXIMUM GINI (G_max) VS. MODEL GINI

  • Cumulative % of
  • Actual Losses (y)
  • 100% ┼───────────────────────────────────────────────────────────────┐
  • │ . ╱ ││
  • │ . ╱ ││
  • │ . ╱ ││
  • │ . ╱ .││
  • │ . ╱ . ││
  • │ . ╱ . ││
  • │ . ╱ Model L(u) ││
  • │ . ╱ ........... ││
  • │ . ╱ .. ││
  • │ . ╱ .. ││
  • │ . ╱ .. ││
  • │ . ╱ .. ││
  • │ . ╱ .. ││
  • │ . ╱ .. ││
  • │ . ╱ .. ││
  • │ . ╱ .. ││
  • │ . ╱.. ││
  • │ . ╱.. ││
  • │ . ╱. ││
  • 0% ┼──┴───────────────────────────────────────────────────────────┴┤
  • 0% 88% 100%
  • Cumulative % of Earned Exposure (u)
  • ├─────────────────── Zero-Loss Policies ───────────────────────┤▲ Loss-Incurring
  • │ (L_max hugs x-axis = 0) │ Policies (L_max
  • rockets to 1)
  • The Normalized Gini Formula

The Normalized Gini coefficient (also known as the Gini index ratio) scales the model's achieved discrimination relative to this empirical maximum: G norm = G model G max ⁡ G_{\text{norm}} = \frac{G_{\text{model}}}{G_{\max}} G norm ​ = G m a x ​ G model ​ ​

Actuarial Interpretation

If a commercial auto collision model achieves G model = 0.28 G_{\text{model}} = 0.28 G model ​ = 0.28 , an executive might mistakenly judge the model as ineffective because 0.28 ≪ 1.0 0.28 \ll 1.0 0.28 ≪ 1.0 .

However, if the portfolio's maximum achievable Gini given claim frequency and process variance is G max ⁡ = 0.56 G_{\max} = 0.56 G m a x ​ = 0.56 , the normalized Gini is: G norm = 0.28 0.56 = 0.50 ( 50 % ) G_{\text{norm}} = \frac{0.28}{0.56} = 0.50 \quad (50\%) G norm ​ = 0.56 0.28 ​ = 0.50 ( 50% )

This demonstrates that the predictive model successfully captures 50 % 50\% 50% of all theoretically extractable risk discrimination present in the empirical data.