Study guide

10.3 Sampling Bias, Misleading Graphs, Base-Rate Fallacies, and Evaluating Media/Research Claims

LANTITE Numeracy Component Exam

Track your progress as you read

Finished sections get a check mark.

1 Chapter 1: Introduction, Test Structure & ACER Assessment Framework

1.1 LANTITE Numeracy Test Structure, Timing, and Administration 1.2 The ACER Assessment Framework: Contexts, Processes, and Performance Bands 1.3 Calculator-Available vs. Non-Calculator Strategy and Item Formats

2 Chapter 2: Number & Algebra I — Whole Numbers, Place Value, Integers, and Index Laws

2.1 Place Value, Rounding, Significant Figures, and Magnitude 2.2 Multi-Step Whole-Number Operations, Remainders, and Resource Allocation 2.3 Directed Numbers (Integers), Order of Operations, and Inverse Operations 2.4 Powers, Square Roots, Powers of Ten, and Scientific Notation

3 Chapter 3: Number & Algebra II — Fractions, Decimals, and Percentages

3.1 Fractions: Equivalence, Simplification, Comparison, and Operations 3.2 Decimals: Operations, Terminating and Recurring Decimals, and Equivalence 3.3 Percentages: Finding Percentages and Expressing Quantities as Percentages 3.4 Percentage Change, Discounts, Successive Changes, and Reverse Percentages

4 Chapter 4: Number & Algebra III — Ratios, Rates, Proportion, and Weighted Averages

4.1 Ratios, Simplification, Part-to-Part vs. Part-to-Whole, and Proportional Sharing 4.2 Rates, Unit Pricing, Fuel Consumption, and Speed–Distance–Time 4.3 Direct and Inverse Proportion, Currency Exchange, and Scaling 4.4 Weighted Averages, Assessment Gradebooks, and Combined Group Means

5 Chapter 5: Number & Algebra IV — Financial Numeracy, GST, Budgeting, and Algebraic Reasoning

5.1 Australian GST (10%), Pre-GST and Post-GST Prices, and Tiered Tax Tables 5.2 Personal and School Budgeting, Pay Rates, Utilities, and Break-Even Analysis 5.3 Simple Interest, Compound Growth, Depreciation, and Repayment Comparisons 5.4 Substituting into Formulae, Linear Equations, and Number Patterns

6 Chapter 6: Measurement & Geometry I — Metric Units, Perimeter, Area, Volume, and Time

6.1 Metric Units, Prefixes, Scale Reading, and Squared/Cubed Unit Conversions 6.2 Perimeter and Area of Rectangles, Triangles, Circles, and Composite 2D Shapes 6.3 Volume, Surface Area, Capacity, and Packing Problems 6.4 Elapsed Time, 12/24-Hour Timetables, School Bell Schedules, and Australian Time Zones

7 Chapter 7: Measurement & Geometry II — Spatial Reasoning, Angles, Scale Plans, and Navigation

7.1 Angle Properties, Polygons, Similar Figures, Symmetry, and Transformations 7.2 3D Solids, Nets, Faces/Edges/Vertices, and Orthographic Projections 7.3 Scale Drawings, Classroom Floor Plans, Map Ratios, and Area Scaling 7.4 Grid References, Coordinates, GPS Data, Compass Directions, and Bearings

8 Chapter 8: Statistics & Probability I — Reading and Interpreting Tables, Graphs, and Data Displays

8.1 Two-Way Contingency Tables, Relative Frequencies, and Venn Diagrams 8.2 Clustered and Stacked Bar Charts, Pie Charts, and Dual-Axis Line Graphs 8.3 Histograms, Cumulative Frequency, Stem-and-Leaf Plots, and Dot Plots 8.4 Scatterplots, Trend Lines, Bubble Charts, and Correlation vs. Causation

9 Chapter 9: Statistics & Probability II — Measures of Centre, Spread, Box Plots, and NAPLAN Data

9.1 Mean, Median, Mode, Frequency Table Averages, and the Effect of Outliers 9.2 Range, Quartiles, Interquartile Range (IQR), and Comparing Parallel Box Plots 9.3 Interpreting NAPLAN Displays, Proficiency Levels, Percentiles, and Standardised Scores

10 Chapter 10: Statistics & Probability III — Probability, Conditional Chance, and Evaluating Statistical Claims

10.1 Theoretical vs. Experimental Probability, Complementary Events, and Expected Frequency 10.2 Multi-Stage Events, Tree Diagrams, Replacement vs. Non-Replacement, and Conditional Probability 10.3 Sampling Bias, Misleading Graphs, Base-Rate Fallacies, and Evaluating Media/Research Claims

11 Chapter 11: Section 2 Mastery — Non-Calculator Mental Strategies, Estimation, and Verification

11.1 Mental Addition, Subtraction, Multiplication, and Division Strategies 11.2 Non-Calculator Benchmark Percentages, Fractional Shortcuts, and Decimal Scaling 11.3 Leading-Digit Estimation, Upper/Lower Bounds, Units Analysis, and Final Verification

10.3 Sampling Bias, Misleading Graphs, Base-Rate Fallacies, and Evaluating Media/Research Claims

Key Takeaways Explain This Topic AI

A sample represents a school or community only when selection is unbiased (simple or proportional stratified random sampling); convenience sampling, voluntary-response polls, undercoverage, and tiny samples distort findings.

The base-rate fallacy occurs when raw counts are compared across unequally sized groups without converting to proportional rates, or conversely when percentages are compared as if they were raw headcounts without knowing group totals.

Simpson's paradox (where subgroup trends reverse when combined due to unequal group weights) and survivorship bias (where early leavers alter longitudinal cohort averages) must be checked before making causal claims.

Validity asks whether data measure what a claim says and whether the conclusion follows from them; reliability asks whether results would be consistent if repeated, which larger samples, repeated measurements, and clear marking criteria improve.

In LANTITE True/False/Unable to determine items, mark a statement True only if the data verify it, False if the data disprove it, and Unable to determine if it needs unstated totals, outside time periods, or unproven causation.

Last updated: October 2026

Population vs. Sample and Sources of Sampling Bias

In statistical investigations, the population is the entire target group about which a school or researcher wishes to draw a conclusion (for example, all 1,200 1{,}200 1 , 200 families enrolled at a P–12 college), whereas a sample is the subset actually surveyed. For sample statistics to generalise validly to the population, the sample must be representative —meaning every subgroup of the population is included without systematic distortion.

The gold standard is random sampling :

Simple random sampling: Every member of the entire population has an equal chance of being selected (for example, using a random number generator on the complete school enrolment roll).

Stratified random sampling: The population is first divided into non-overlapping strata (such as Year 7 through Year 12), and a simple random sample is drawn from each stratum in exact proportion to its enrolment size.

By contrast, non-random methods introduce sampling bias :

Convenience sampling: Selecting individuals who are easiest to reach. For example, surveying only parents who attend a Tuesday 10 : 00 am 10\text{:}00\text{ am} 10 : 00 am P&C meeting systematically excludes parents who work full-time daytime shifts, while surveying students inside the library at lunchtime about extending library hours over-represents keen library users.

Voluntary-response (self-selection) bias: Inviting respondents to opt in to an online newsletter poll or return an optional feedback slip. People with strong complaints or passionate views are far more likely to respond than satisfied or neutral community members.

Undercoverage bias: Drawing a sample from an incomplete frame that omits key segments of the population—such as surveying only a Year 12 Extension Mathematics class to estimate whole-school attitudes toward daily homework.

Small sample size fallacy: Treating a tiny sample (such as interviewing 5 5 5 students at the bus bay) as conclusive evidence for a whole-school percentage.

The Base-Rate Fallacy: Raw Counts vs. Proportional Rates

One of the most frequent analytical traps in LANTITE Numeracy is confusing raw counts (absolute frequencies) with proportional rates (percentages or per-capita rates) when comparing groups of different total sizes.

Worked Example: Canteen Participation Across Unequal Cohorts

Suppose a secondary school records that 45 45 45 Year 7 students and 35 35 35 Year 11 students buy hot lunches from the canteen on Monday:

Comparing raw counts: Year 7 has more students buying lunch ( 45 > 35 45 > 35 45 > 35 ).

Comparing participation rates: Suppose the Year 7 cohort has 300 300 300 students in total, whereas the Year 11 cohort has 140 140 140 students in total. Converting each count to a proportion of its own base cohort gives: Year 7 rate = 45 300 = 0.15 = 15 % \text{Year 7 rate} = \frac{45}{300} = 0.15 = 15\% Year 7 rate = 300 45 ​ = 0.15 = 15% Year 11 rate = 35 140 = 0.25 = 25 % \text{Year 11 rate} = \frac{35}{140} = 0.25 = 25\% Year 11 rate = 140 35 ​ = 0.25 = 25%

Once base cohort sizes are accounted for, Year 11 has a substantially higher participation rate ( 25 % 25\% 25% vs. 15 % 15\% 15% ) despite having fewer buyers in raw headcount.

The converse base-rate trap occurs when a graph displays only percentages without cohort totals . If a chart shows that 60 % 60\% 60% of School A's graduates and 45 % 45\% 45% of School B's graduates entered university, you cannot determine which school sent a greater number of students to university unless the total number of graduates at each school is provided.

Simpson's Paradox, Survivorship Bias, and Misleading Visuals

Even when data are collected accurately, summary statistics and visuals can mislead readers in three important ways:

Simpson's Paradox (Subgroup Aggregation Reversal): A comparison that holds within every individual subgroup can reverse direction when the subgroups are combined into a single aggregate percentage if the groups have very different underlying compositions. For example, suppose School X and School Y both have 100 100 100 students tested: at School X, 48 80 = 60 % \frac{48}{80} = 60\% 80 48 ​ = 60% of EAL/D students and 18 20 = 90 % \frac{18}{20} = 90\% 20 18 ​ = 90% of non-EAL/D students meet a writing benchmark (overall 66 100 = 66 % \frac{66}{100} = 66\% 100 66 ​ = 66% ). At School Y, only 10 20 = 50 % \frac{10}{20} = 50\% 20 10 ​ = 50% of EAL/D students and 64 80 = 80 % \frac{64}{80} = 80\% 80 64 ​ = 80% of non-EAL/D students meet the benchmark, yet its overall combined rate is 74 100 = 74 % \frac{74}{100} = 74\% 100 74 ​ = 74% . School X outperforms School Y in both subgroups ( 60 % > 50 % 60\% > 50\% 60% > 50% and 90 % > 80 % 90\% > 80\% 90% > 80% ), but appears lower overall ( 66 % < 74 % 66\% < 74\% 66% < 74% ) solely because 80 % 80\% 80% of School X's cohort is in the EAL/D subgroup.

Survivorship Bias in Longitudinal Cohorts: Suppose a cohort's mean numeracy score rises from 62 % 62\% 62% in Year 10 to 71 % 71\% 71% in Year 12. Concluding that classroom instruction alone caused a 9 9 9 -percentage-point improvement ignores whether lower-scoring students left school after Year 10 for apprenticeships or vocational training, leaving a more selective surviving cohort in Year 12.

Misleading Graph Scales: Always inspect axis labels before interpreting visual height. A truncated vertical axis (starting a bar chart at 80 % 80\% 80% instead of 0 % 0\% 0% ) makes an 86 % 86\% 86% bar appear three times as tall as an 82 % 82\% 82% bar. Similarly, omitting uneven years on a horizontal time axis distorts the apparent gradient of growth.

Validity and Reliability of Data and Interpretations

ACER's framework names data and interpretation validity and reliability as in-scope statistics content. Keep the two ideas separate:

Idea Question to ask School example

Validity Do the data measure what the claim says they measure, and does the conclusion follow from them? Using a timed spelling quiz as evidence of reading comprehension is not valid, because the quiz measures a different skill.

Reliability Would the measurement or result be consistent if it were repeated with another sample, marker, or occasion? A mean from 6 6 6 students, or from one test day disrupted by illness, is an unreliable estimate of a cohort's typical performance.

Common threats to a valid interpretation:

Changed measures: comparing 2024 and 2026 pass rates after the test, marking scheme, or cut-off changed.

Mismatched populations: drawing conclusions about all students from data on volunteers or a single class.

Over-reach: claiming a cause from a correlation, or predicting far beyond the range of the data.

Reliability improves with larger samples, averages of several measurements, clear marking criteria (or two markers who agree), and results compared across several occasions rather than a single day. A result can be reliable without being valid: a bathroom scale that always reads 2 kg 2\text{ kg} 2 kg heavy is consistent but wrong, so check both properties before accepting a conclusion.

Evaluating Claims: "True", "False", or "Unable to Determine"

Approximately 20 – 30 % 20\text{--}30\% 20 – 30% of the LANTITE Numeracy test assesses the process of interpreting, evaluating, communicating, and representing mathematics . ACER practice items present a stimulus table or graph and ask you to mark each statement True , False , or Unable to determine (some items say Not possible to determine ):

Classification Strict Criterion Common LANTITE Triggers & Examples

True (supported) Directly verifiable by reading or calculating from the provided data Correct rate, difference, ratio, or percentage-point change calculated strictly within the plotted categories and years

False (contradicted) Directly disproved by calculation from the provided data Confusing raw count with percentage rate; reversing a conditional denominator; misreading a truncated axis

Unable to determine Requires external data or unstated assumptions not present in the stimulus Claiming a higher raw count when only percentages are given (no total N N N ); inferring causation from observational correlation; projecting beyond the plotted years

Worked Example: Classifying Claims from a School Excursion Summary

Suppose a table reports only the percentage of students attending a museum excursion across two campuses: Campus East ( 80 % 80\% 80% attendance) and Campus West ( 70 % 70\% 70% attendance), with a combined two-campus attendance rate of 74 % 74\% 74% :

Claim 1: "The attendance rate at Campus East was 10 10 10 percentage points higher than at Campus West." → \rightarrow → True ( 80 % − 70 % = 10 80\% - 70\% = 10 80% − 70% = 10 percentage points).

Claim 2: "Campus East and Campus West have the same total number of enrolled students." → \rightarrow → False (if both campuses had equal enrolments, the combined rate would be the simple midpoint 80 % + 70 % 2 = 75 % \frac{80\% + 70\%}{2} = 75\% 2 80% + 70% ​ = 75% ; because the weighted average is 74 % 74\% 74% , Campus West must have a larger total enrolment than Campus East).

Claim 3: "Exactly 160 160 160 students from Campus East attended the excursion." → \rightarrow → Unable to determine (no headcount or total enrolment number is given in the table).