Study guide

8.3 How Charts Mislead

CAS Property & Casualty Predictive Analytics PCPA

Track your progress as you read

Finished sections get a check mark.

1 Chapter 1: PCPA Exam & Project Orientation

1.1 PCPA Exam Format, Scoring & Registration 1.2 The PCPA Project: Windows, Deliverables & Grading

2 Chapter 2: Dealing with Data — Sourcing, Importing & Assessing

2.1 Requirements Gathering & Assessing Data Relevance 2.2 Importing, Joining & Reshaping Data Sets 2.3 Exploratory Data Analysis & Evaluating a Data Set 2.4 Data Quality Under ASOP 23 & Modeling Under ASOP 56

3 Chapter 3: Dealing with Data — Conditioning P&C Data for a GLM

3.1 Exposure Bases, Weights & Data Grain 3.2 Missing Data Mechanisms & Imputation Strategies 3.3 Outlier Diagnostics, Trimming & Winsorization 3.4 Variable Transformation & Scaling

4 Chapter 4: Model Diagnostics & Selection — Building a GLM

4.1 Exponential Dispersion Family & Link Functions 4.2 Poisson Regression & Exposure Offsets 4.3 Overdispersion, Quasi-Poisson & Negative Binomial 4.4 Gamma & Inverse Gaussian Models for Claim Severity

5 Chapter 5: Model Diagnostics & Selection — Model Form & Predictors

5.1 Tweedie Compound Poisson-Gamma Modeling 5.2 Binomial & Logistic GLMs for Binary Outcomes 5.3 Categorical Predictors, Base Levels & High-Cardinality Grouping 5.4 Interaction Terms & Non-Linear Effects 5.5 Interpreting Coefficients & Multiplicative Relativities

6 Chapter 6: Model Diagnostics & Selection — Evaluating and Improving the Fit

6.1 Deviance, Likelihood Ratio Tests & Residual Diagnostics 6.2 Stepwise Selection & Information Criteria Penalties 6.3 Multicollinearity, Correlated Predictors & Aliasing 6.4 Under-fitting, Over-fitting & Cross-Validation

7 Chapter 7: Model Diagnostics & Selection — Validation & Model Choice

7.1 Actual vs. Predicted, Calibration & Loss Ratio Charts 7.2 Simple Quantile Plots & Measuring Lift 7.3 Double Lift Charts & Competing Model Evaluation 7.4 Gini Index, Lorenz Curves & ROC Curves

8 Chapter 8: Model Interpretation & Presentation — Tables, Charts & Exhibits

8.1 Designing Tables & Statistical Exhibits 8.2 Chart Selection & Graphical Perception 8.3 How Charts Mislead 8.4 One-Way, Two-Way & Partial Dependence Exhibits

9 Chapter 9: Model Interpretation & Presentation — Communicating the Analysis

9.1 Communicating Methodology & Modeling Decisions 9.2 Explaining Why a Variable Was or Was Not Included 9.3 Communicating to Non-Technical Audiences 9.4 The PCPA Technical Report: Structure & Rubric

8.3 How Charts Mislead

Key Takeaways Explain This Topic AI

Cairo's framework is that charts lie through badly chosen scales, hidden or inappropriate aggregation, cherry-picked ranges, and encodings that suggest a pattern the data does not contain.

A truncated bar axis exaggerates differences and a stretched aspect ratio can flatten or steepen an apparent trend without changing a single value.

Aggregation can reverse a relationship: Simpson's paradox appears in insurance data whenever a mix shift across segments is hidden inside a portfolio average.

Unweighted averages of rates and ratios are misleading in insurance because exposure differs enormously between records.

The defence is a checklist: read the axes, read the denominator, read the time range, and ask what is not shown.

Last updated: September 2026

Why This Is Examinable

PCPA task C-1 requires candidates to create and interpret statistical and graphical representations. Interpretation includes recognising when a chart is misleading — whether the chart came from a vendor, a competitor's filing, a colleague, or your own first draft. Cairo's How Charts Lie is the assigned reading, and its structure is a taxonomy of failures.

Most misleading charts are not fraudulent. They are produced by analysts using a default setting without thinking about what the default implies.

Failure 1: The Scale

Truncated bar axes. Covered in the previous section and worth repeating because it is the single most common distortion. A bar means length from a baseline; move the baseline and the meaning changes.

Aspect ratio. The same time series drawn tall and narrow shows a dramatic climb; drawn short and wide it looks flat. No number changes. When a trend's steepness is the point, the aspect ratio must be chosen deliberately and the axis range stated.

Dual axes. Two series on two scales in one frame can be made to cross, converge or diverge at will by choosing where each axis starts. A dual-axis chart implies a relationship that the analyst, not the data, selected. Use them only where the convention is established and expected — such as exposure bars behind a loss-cost line — and label both axes.

Inconsistent scales across panels. Comparing two charts whose y-axes differ is an invitation to a false conclusion. Identical axes are mandatory for small multiples.

Failure 2: The Denominator

Insurance is a business of ratios, and every ratio has a denominator that can be chosen badly.

Counts instead of rates. "Territory 7 had the most claims" usually means Territory 7 has the most exposure. The interesting statistic is claims per car-year.

Unweighted averages of rates. Averaging loss ratios across policies gives each policy equal weight regardless of premium volume. The portfolio loss ratio is sum(losses) / sum(premium) , and the two answers can differ substantially.

Changing denominators over time. A frequency series computed per policy in early years and per vehicle in later years has a trend that is entirely definitional.

Percentages of small bases. "Claims up 200%" reads dramatically until the reader learns the count went from 1 to 3.

Failure 3: The Range

Starting a time series at a convenient year is the oldest trick in the collection. A loss-ratio series beginning in an unusually good year shows deterioration; the same data beginning three years earlier shows a cycle.

Related distortions:

Immature periods. The most recent accident year's incurred losses are the least developed. Plotting them beside mature years shows an apparent improvement that is pure development lag. Either develop the years to a common maturity or plot them at a constant evaluation age.

Truncated categories. A "top 10 territories" chart that omits the remaining 40 can imply the top 10 are the whole story.

Excluded outliers shown without a note. Removing shock losses may be the right modelling decision, but a chart that does not disclose it overstates stability.

Failure 4: Aggregation That Reverses the Answer

The most serious version, because the chart is arithmetically correct and still wrong.

Simpson's paradox occurs when a relationship visible within every subgroup disappears or reverses when the subgroups are pooled. In insurance it is generally caused by a mix shift .

A worked example. An insurer's overall loss ratio rises from 62.0% to 67.8% between two years, and the portfolio chart shows deterioration. Split by line:

  • Segment Year 1 LR Year 1 premium Year 2 LR Year 2 premium
  • Personal auto 58% $80m 57% $40m
  • Commercial auto 78% $20m 75% $60m
  • Total 62.0% $100m 67.8% $100m

Both segments improved. The portfolio deteriorated because the book shifted toward the higher-loss-ratio segment. A chart showing only the total leads a reader to exactly the wrong action — tightening underwriting in segments that are in fact improving.

The defence is to show the segment detail, or at minimum to decompose the change into a rate effect and a mix effect.

Failure 5: Encoding a Pattern the Data Does Not Have

Connecting unordered categories with a line. A line implies continuity between adjacent points. Territories, vehicle classes and construction types have no natural order, so a line across them invents a trend.

Fitting a smooth curve through thin data. A trend line through eight points with wide confidence intervals asserts more than the data supports. Show the intervals, or show the points alone.

3-D effects and perspective. Depth distorts apparent length and area, so nearer bars read as larger. There is no case where a third dimension helps a two-variable comparison.

Rainbow colour scales on a continuous measure. Non-monotonic colour ramps create apparent boundaries where the data changes smoothly.

A Review Checklist

Before any exhibit goes into a report, read it as a sceptic:

Axes — Are both labelled with units? Does the bar axis start at zero? Are compared panels on identical scales?

Denominator — Is this a rate or a count? Weighted by what? Is the weighting stated?

Range — Why does the series start there? Are all periods at comparable maturity?

Aggregation — Could a mix shift be driving this? Does the pattern hold within segments?

Volume — Can the reader see which points are credible?

What is missing — Which categories, periods or records were excluded, and is the exclusion disclosed?

Warning

Apply this checklist to your own exhibits before you apply it to anyone else's. The project rubric asks the candidate to justify their choice of data and visual presentation, including clarity of purpose and appropriateness for the data, model, audience and business question. An exhibit that fails the checklist fails that criterion whether or not the underlying model is sound.