Study guide

14.2 Measurement Systems, Dimensional Analysis, and Precision

California Subject Examinations for Teachers CSET

Track your progress as you read

Finished sections get a check mark.

1 Chapter 1: The CSET Program and the Multiple Subjects Examination

1.1 The CSET Program: Which Tests a California Teacher Actually Needs 1.2 CSET Multiple Subjects: Test Structure, Scoring, and Test-Day Mechanics

2 Chapter 2: Language Structure, Linguistics, and Non-Written Communication

2.1 Linguistics and Language Structure: Phonology, Morphology, Syntax, Semantics, and Pragmatics 2.2 First and Second Language Acquisition and ELD Instruction 2.3 Non-Written Communication, Listening, Speaking, and Media Analysis

3 Chapter 3: Literacy Development, Reading Comprehension, and Text Complexity

3.1 Foundations of Early Literacy: Print Concepts, Phonemic Awareness, and Phonics 3.2 Reading Fluency and Vocabulary Acquisition 3.3 Reading Comprehension of Literary and Informational Texts 3.4 Text Complexity and Matching Readers to Texts and Tasks

4 Chapter 4: Writing, Conventions, Research, and Literacy Assessment

4.1 The Writing Process, Discourse Modes, and Writing Applications 4.2 Conventions of Language: Grammar, Usage, Mechanics, and Spelling 4.3 Research Practices, Source Credibility, and Presenting Knowledge 4.4 Diagnostic Literacy Assessment, Running Records, and Miscue Analysis

5 Chapter 5: Ancient Civilizations and Medieval World History

5.1 Early River Valley Civilizations and the Foundations of Society 5.2 Classical Mediterranean Civilizations: Ancient Greece and Rome 5.3 Medieval and Early Modern Eras: Byzantium, Islam, Africa, the Americas, and the Renaissance

6 Chapter 6: United States History and Government

6.1 Indigenous North America, Colonial Settlement, and the American Revolution 6.2 Constitutional Foundations, Federalism, and the American System of Government 6.3 Westward Expansion, Sectional Conflict, the Civil War, and Reconstruction 6.4 Industrialization, the Progressive Era, World Wars, and the Civil Rights Movement

7 Chapter 7: California History and Geography

7.1 California Geography, Indigenous Nations, and the Spanish Mission Era 7.2 The Mexican Rancho Period, the Bear Flag Revolt, and the 1849 Gold Rush 7.3 California Statehood, Governance, Water Infrastructure, and Modern Economic Growth

8 Chapter 8: Social Science Skills: Geography, Civics, Economics, and Source Analysis

8.1 Chronological and Spatial Thinking: Timelines, Maps, and Geographic Tools 8.2 Core Concepts in Civics, Economics, and the Social Sciences 8.3 Analyzing Primary and Secondary Sources and Writing Historical Arguments

9 Chapter 9: Scientific Practices and Physical Science

9.1 Scientific Investigation, Engineering Design, and Crosscutting Concepts 9.2 Structure and Properties of Matter: Atoms, Elements, Compounds, and Chemical Reactions 9.3 Forces, Motion, Energy Transformations, and Waves

10 Chapter 10: Life Science and Ecology

10.1 Cell Biology, Cellular Organization, and Metabolic Processes 10.2 Genetics, Heredity, Molecular Biology, and Evolution 10.3 Ecosystems, Ecological Interactions, Energy Flow, and Biogeochemical Cycles

11 Chapter 11: Earth, Water, and Space Science

11.1 Earth's Interior, Plate Tectonics, and Geological Processes 11.2 Atmospheric Structure, Hydrology, Weather Systems, and Climate 11.3 Earth's Water: Oceans, Estuaries, Freshwater Systems, and Tidal Dynamics 11.4 Earth-Sun-Moon Dynamics, the Solar System, and the Universe

12 Chapter 12: Number Sense, Operations, and Fractions

12.1 Number Classifications, Place Value, Properties of Operations, and Integers 12.2 Number Theory, Prime Factorization, GCF/LCM, and Exponents 12.3 Fractions, Decimals, Percentages, and Proportional Problem Solving

13 Chapter 13: Algebra, Functions, and Geometry

13.1 Ratios, Rates, Proportions, and Scaling Relationships 13.2 Algebraic Expressions, Linear Equations, Systems, and Functions 13.3 Geometric Properties, Two-Dimensional Polygons, and Three-Dimensional Solids

14 Chapter 14: Coordinate Geometry, Measurement, Statistics, and Mathematical Practices

14.1 Coordinate Geometry, Linear Graphs, and Geometric Transformations 14.2 Measurement Systems, Dimensional Analysis, and Precision 14.3 Descriptive Statistics, Data Displays, and Probability Theory 14.4 Mathematical Practices: Reasoning, Modeling, Estimation, and Justification

15 Chapter 15: Physical Education: Movement, Fitness, Social Development, and Inclusion

15.1 Motor Development, Fundamental Movement Skills, and Movement Concepts 15.2 Fitness Principles, Exercise Physiology, Nutrition, and Safety 15.3 Self-Image, Social Development, and Personal and Social Responsibility 15.4 Movement Forms, Cultural Traditions, and Inclusive Adapted Physical Education

16 Chapter 16: Human Development: Cognition, Intelligence, Social and Physical Growth

16.1 Cognitive and Linguistic Development: Piaget, Vygotsky, and Information Processing 16.2 Perspectives on Intelligence, Play, and Individual Differences 16.3 Social-Emotional and Moral Development: Erikson, Kohlberg, and Attachment Theory 16.4 Physical Development, Ecological Systems, and Mandated Reporting

17 Chapter 17: Visual and Performing Arts: Dance, Music, and Theatre

17.1 Fundamental Elements of Dance, Choreographic Principles, and Cultural Styles 17.2 Core Elements of Music, Staff Notation, Rhythm, and Auditory Analysis 17.3 Music History, World Traditions, and Elementary Music Pedagogy 17.4 Elements of Theatre, Dramatic Structures, Acting Techniques, and Stagecraft

18 Chapter 18: Visual Art, Arts Integration, and Constructed-Response Mastery

18.1 Elements of Art, Principles of Design, and Visual Analysis 18.2 Art Media, Techniques, World Art History, and Art Criticism 18.3 California Arts Standards and Cross-Curricular Arts Integration 18.4 CSET Constructed-Response Strategy, Scoring Scale, and Domain-Specific Exemplars

14.2 Measurement Systems, Dimensional Analysis, and Precision

Key Takeaways Explain This Topic AI

The US Customary System relies on historic, non-decimal conversion ratios across length (12 in = 1 ft, 3 ft = 1 yd, 5,280 ft = 1 mi), weight (16 oz = 1 lb, 2,000 lb = 1 ton), and capacity (8 fl oz = 1 c, 2 c = 1 pt, 2 pt = 1 qt, 4 qt = 1 gal).

The International System of Units (SI / Metric) is a coherent base-ten decimal system organized by metric prefixes ( 10 ± n 10^{\pm n} 1 0 ± n ) connecting length (meter), mass (gram), and volume (liter), with physical coherence defined by 1 cm 3 = 1 mL = 1 g 1\text{ cm}^3 = 1\text{ mL} = 1\text{ g} 1 cm 3 = 1 mL = 1 g of water.

Dimensional analysis (the factor-label method) converts quantities by multiplying by unity fractions (conversion ratios equal to 1), systematically canceling unwanted units across single, rate, and multi-step conversions.

Dimensional scaling mandates that if linear dimensions scale by conversion factor k k k , surface areas scale by k 2 k^2 k 2 (e.g., 1 yd 2 = 9 ft 2 1\text{ yd}^2 = 9\text{ ft}^2 1 yd 2 = 9 ft 2 ), and volumes scale by k 3 k^3 k 3 (e.g., 1 yd 3 = 27 ft 3 , 1 m 3 = 1 , 000 L 1\text{ yd}^3 = 27\text{ ft}^3, 1\text{ m}^3 = 1,000\text{ L} 1 yd 3 = 27 ft 3 , 1 m 3 = 1 , 000 L ).

Measurement precision is determined by the smallest graduation of the tool; the Greatest Possible Error (GPE) is ± 1 2 \pm \frac{1}{2} ± 2 1 ​ the smallest unit of precision, and errors compound multiplicatively in area and volume calculations.

Last updated: August 2026

14.2 Measurement Systems, Dimensional Analysis, and Precision

CSET Focus: Measurement questions on CSET Multiple Subjects Subtest II assess your fluency with both the US Customary and SI Metric systems, your ability to execute multi-step dimensional analysis without computational errors, your mastery of linear-to-area-to-volume unit scaling, and your understanding of precision, accuracy, greatest possible error (GPE), and error propagation in classroom science and mathematics contexts.

1. Measurement Systems: US Customary vs. Metric / SI

Mathematics and science education in California requires mastery of two distinct measurement systems: the US Customary System (inherited from the British Imperial system) and the International System of Units (SI, commonly termed the Metric System ). MEASUREMENT SYSTEMS

  • ┌───────────────────────┴───────────────────────┐
  • US CUSTOMARY SYSTEM METRIC / SI SYSTEM
  • (Non-decimal, fraction-based) (Decimal, base-10 powers)
  • Length: in, ft, yd, mi • Length: millimeter, centimeter, meter, kilometer
  • Weight: oz, lb, ton • Mass: milligram, gram, kilogram
  • Capacity: fl oz, c, pt, qt, gal • Volume: milliliter, liter, cubic meter
  • 1. The US Customary System

The US Customary System uses distinct, non-uniform conversion ratios across dimensions:

Length 12 inches (in) = 1 foot (ft) 3 feet = 1 yard (yd) = 36 inches 12\text{ inches (in)} = 1\text{ foot (ft)} \qquad 3\text{ feet} = 1\text{ yard (yd)} = 36\text{ inches} 12 inches (in) = 1 foot (ft) 3 feet = 1 yard (yd) = 36 inches 5 , 280 feet = 1 , 760 yards = 1 mile (mi) 5,280\text{ feet} = 1,760\text{ yards} = 1\text{ mile (mi)} 5 , 280 feet = 1 , 760 yards = 1 mile (mi)

Weight (Avoirdupois) 16 ounces (oz) = 1 pound (lb) 2 , 000 pounds = 1 ton (T) 16\text{ ounces (oz)} = 1\text{ pound (lb)} \qquad 2,000\text{ pounds} = 1\text{ ton (T)} 16 ounces (oz) = 1 pound (lb) 2 , 000 pounds = 1 ton (T)

  • (Note: Customary dry weight ounces are distinct from fluid capacity ounces.)
  • Liquid Capacity / Volume

The hierarchical "Capacity Ladder": 8 fluid ounces (fl oz) = 1 cup (c) 8\text{ fluid ounces (fl oz)} = 1\text{ cup (c)} 8 fluid ounces (fl oz) = 1 cup (c) 2 cups = 1 pint (pt) = 16 fl oz 2\text{ cups} = 1\text{ pint (pt)} = 16\text{ fl oz} 2 cups = 1 pint (pt) = 16 fl oz 2 pints = 1 quart (qt) = 4 cups = 32 fl oz 2\text{ pints} = 1\text{ quart (qt)} = 4\text{ cups} = 32\text{ fl oz} 2 pints = 1 quart (qt) = 4 cups = 32 fl oz 4 quarts = 1 gallon (gal) = 8 pints = 16 cups = 128 fl oz 4\text{ quarts} = 1\text{ gallon (gal)} = 8\text{ pints} = 16\text{ cups} = 128\text{ fl oz} 4 quarts = 1 gallon (gal) = 8 pints = 16 cups = 128 fl oz

2. The Metric / SI System

The Metric System is a decimal base-10 system built on standard base units:

  • Length: Meter ( m \text{m} m )
  • Mass: Gram ( g \text{g} g ) / Kilogram ( kg \text{kg} kg )
  • Volume: Liter ( L \text{L} L ) / Cubic meter ( m 3 \text{m}^3 m 3 )
  • Time: Second ( s \text{s} s )
  • Temperature: Celsius ( ∘ C ^\circ\text{C} ∘ C ) / Kelvin ( K \text{K} K )
  • Metric Prefix Hierarchy

Metric prefixes apply uniformly across all base units by shifting decimal place values:

Prefix Symbol Multiplier (Scientific) Multiplier (Standard) Exemplar (with Meter)

kilo- k \text{k} k 10 3 10^3 1 0 3 1 , 000 1,000 1 , 000 1 kilometer (km) = 1 , 000 m 1\text{ kilometer (km)} = 1,000\text{ m} 1 kilometer (km) = 1 , 000 m

hecto- h \text{h} h 10 2 10^2 1 0 2 100 100 100 1 hectometer (hm) = 100 m 1\text{ hectometer (hm)} = 100\text{ m} 1 hectometer (hm) = 100 m

deka- da \text{da} da 10 1 10^1 1 0 1 10 10 10 1 dekameter (dam) = 10 m 1\text{ dekameter (dam)} = 10\text{ m} 1 dekameter (dam) = 10 m

[BASE] — 10 0 10^0 1 0 0 1 1 1 1 meter (m) / 1 gram (g) / 1 liter (L) 1\text{ meter (m)} / 1\text{ gram (g)} / 1\text{ liter (L)} 1 meter (m) /1 gram (g) /1 liter (L)

deci- d \text{d} d 10 − 1 10^{-1} 1 0 − 1 0.1 0.1 0.1 1 decimeter (dm) = 0.1 m 1\text{ decimeter (dm)} = 0.1\text{ m} 1 decimeter (dm) = 0.1 m ( 10 dm = 1 m 10\text{ dm} = 1\text{ m} 10 dm = 1 m )

centi- c \text{c} c 10 − 2 10^{-2} 1 0 − 2 0.01 0.01 0.01 1 centimeter (cm) = 0.01 m 1\text{ centimeter (cm)} = 0.01\text{ m} 1 centimeter (cm) = 0.01 m ( 100 cm = 1 m 100\text{ cm} = 1\text{ m} 100 cm = 1 m )

milli- m \text{m} m 10 − 3 10^{-3} 1 0 − 3 0.001 0.001 0.001 1 millimeter (mm) = 0.001 m 1\text{ millimeter (mm)} = 0.001\text{ m} 1 millimeter (mm) = 0.001 m ( 1 , 000 mm = 1 m 1,000\text{ mm} = 1\text{ m} 1 , 000 mm = 1 m )

micro- μ \mu μ 10 − 6 10^{-6} 1 0 − 6 0.000001 0.000001 0.000001 1 micrometer ( μ m) = 10 − 6 m 1\text{ micrometer (}\mu\text{m)} = 10^{-6}\text{ m} 1 micrometer ( μ m) = 1 0 − 6 m

Classroom Mnemonic: "King Henry Died By Drinking Chocolate Milk" (Kilo, Hecto, Deka, Base, Deci, Centi, Milli).

Metric System Coherence (The Water Standard)

A defining elegance of the metric system is the physical bridge connecting length, volume, and mass for pure water at 4 ∘ C 4^\circ\text{C} 4 ∘ C : 1 cm 3 = 1 milliliter (mL) = 1 gram (g) 1\text{ cm}^3 = 1\text{ milliliter (mL)} = 1\text{ gram (g)} 1 cm 3 = 1 milliliter (mL) = 1 gram (g) 1 dm 3 = 1 , 000 cm 3 = 1 liter (L) = 1 kilogram (kg) 1\text{ dm}^3 = 1,000\text{ cm}^3 = 1\text{ liter (L)} = 1\text{ kilogram (kg)} 1 dm 3 = 1 , 000 cm 3 = 1 liter (L) = 1 kilogram (kg) 1 m 3 = 1 , 000 L = 1 metric ton = 1 , 000 kg 1\text{ m}^3 = 1,000\text{ L} = 1\text{ metric ton} = 1,000\text{ kg} 1 m 3 = 1 , 000 L = 1 metric ton = 1 , 000 kg

Cross-System Benchmark Approximations

Dimension US Customary Unit Metric / SI Equivalent Approximate Conversion Factor

Length 1 inch 1\text{ inch} 1 inch 2.54 cm 2.54\text{ cm} 2.54 cm 1 in = 2.54 cm 1\text{ in} = 2.54\text{ cm} 1 in = 2.54 cm (Exact definition)

Length 1 foot 1\text{ foot} 1 foot 0.3048 m 0.3048\text{ m} 0.3048 m 1 m ≈ 3.281 ft ≈ 39.37 in 1\text{ m} \approx 3.281\text{ ft} \approx 39.37\text{ in} 1 m ≈ 3.281 ft ≈ 39.37 in

Length 1 mile 1\text{ mile} 1 mile 1.609 km 1.609\text{ km} 1.609 km 1 km ≈ 0.621 mi 1\text{ km} \approx 0.621\text{ mi} 1 km ≈ 0.621 mi

Mass / Weight 1 pound (lb) 1\text{ pound (lb)} 1 pound (lb) 453.592 g ≈ 0.454 kg 453.592\text{ g} \approx 0.454\text{ kg} 453.592 g ≈ 0.454 kg 1 kg ≈ 2.205 lb 1\text{ kg} \approx 2.205\text{ lb} 1 kg ≈ 2.205 lb

Mass / Weight 1 ounce (oz) 1\text{ ounce (oz)} 1 ounce (oz) 28.35 g 28.35\text{ g} 28.35 g 100 g ≈ 3.527 oz 100\text{ g} \approx 3.527\text{ oz} 100 g ≈ 3.527 oz

Capacity 1 gallon (gal) 1\text{ gallon (gal)} 1 gallon (gal) 3.785 L 3.785\text{ L} 3.785 L 1 L ≈ 0.264 gal ≈ 1.057 qt 1\text{ L} \approx 0.264\text{ gal} \approx 1.057\text{ qt} 1 L ≈ 0.264 gal ≈ 1.057 qt

Capacity 1 fluid ounce 1\text{ fluid ounce} 1 fluid ounce 29.57 mL 29.57\text{ mL} 29.57 mL 1 cup ≈ 236.6 mL 1\text{ cup} \approx 236.6\text{ mL} 1 cup ≈ 236.6 mL

Temperature Conversion Formulas F = 9 5 C + 32 = 1.8 C + 32 C = 5 9 ( F − 32 ) F = \frac{9}{5}C + 32 = 1.8C + 32 \qquad C = \frac{5}{9}(F - 32) F = 5 9 ​ C + 32 = 1.8 C + 32 C = 9 5 ​ ( F − 32 )

Freezing Point of Water: 32 ∘ F = 0 ∘ C 32^\circ\text{F} = 0^\circ\text{C} 3 2 ∘ F = 0 ∘ C

Normal Human Body Temperature: 98.6 ∘ F = 37.0 ∘ C 98.6^\circ\text{F} = 37.0^\circ\text{C} 98. 6 ∘ F = 37. 0 ∘ C

  • Boiling Point of Water: 212 ∘ F = 100 ∘ C 212^\circ\text{F} = 100^\circ\text{C} 21 2 ∘ F = 10 0 ∘ C
  • 2. Dimensional Analysis and Higher-Dimensional Conversions

Dimensional Analysis (the Factor-Label Method ) is a systematic mathematical procedure that treats units algebraically. Conversion factors are written as unity fractions (fractions equal to 1, since the numerator and denominator represent equivalent physical quantities). Units are aligned so that unwanted units cancel diagonally.

General Execution Algorithm: Given Quantity × ( Target Unit Given Unit ) = Converted Quantity \text{Given Quantity} \times \left(\frac{\text{Target Unit}}{\text{Given Unit}}\right) = \text{Converted Quantity} Given Quantity × ( Given Unit Target Unit ​ ) = Converted Quantity

Multi-Step Chained Rate Conversions

When converting compound rates (e.g., speed from miles per hour to feet per second), chain conversion fractions for both the numerator (distance) and denominator (time):

Worked Example: Convert 60 miles per hour (mph) 60\text{ miles per hour (mph)} 60 miles per hour (mph) into feet per second (ft/s) \text{feet per second (ft/s)} feet per second (ft/s) : 60 miles 1 hour × ( 5 , 280 feet 1 mile ) × ( 1 hour 60 minutes ) × ( 1 minute 60 seconds ) = 60 × 5 , 280 × 1 × 1 1 × 1 × 60 × 60 ft/s = 316 , 800 3 , 600 ft/s = 88 ft/s \frac{60\text{ miles}}{1\text{ hour}} \times \left( \frac{5,280\text{ feet}}{1\text{ mile}} \right) \times \left( \frac{1\text{ hour}}{60\text{ minutes}} \right) \times \left( \frac{1\text{ minute}}{60\text{ seconds}} \right) = \frac{60 \times 5,280 \times 1 \times 1}{1 \times 1 \times 60 \times 60}\text{ ft/s} = \frac{316,800}{3,600}\text{ ft/s} = 88\text{ ft/s} 1 hour 60 miles ​ × ( 1 mile 5 , 280 feet ​ ) × ( 60 minutes 1 hour ​ ) × ( 60 seconds 1 minute ​ ) = 1 × 1 × 60 × 60 60 × 5 , 280 × 1 × 1 ​ ft/s = 3 , 600 316 , 800 ​ ft/s = 88 ft/s

Square and Cubic Unit Conversions (Dimensional Scaling)

A pervasive student error is failing to square or cube the linear conversion factor when converting areas or volumes: 1 Yard = 3 Feet 1 Square Yard = 9 Square Feet 1 Cubic Yard = 27 Cubic Feet

  • ┌──────────────┐ ┌──────┬──────┬──────┐ ┌──────┬──────┬──────┐
  • │ 3 Feet (1 yd)│ │ 1 ft²│ 1 ft²│ 1 ft²│ 3 ft │ │ │ │
  • └──────────────┘ ├──────┼──────┼──────┤ (1 yd) ├──────┼──────┼──────┤ 3 ft
  • │ 1 ft²│ 1 ft²│ 1 ft²│ │ │ │ │ (1 yd)
  • ├──────┼──────┼──────┤ ├──────┼──────┼──────┤
  • │ 1 ft²│ 1 ft²│ 1 ft²│ │ │ │ │
  • └──────┴──────┴──────┘ └──────┴──────┴──────┘
  • 3 Feet (1 yd) 3 Feet × 3 Feet

Mathematical Derivations:

Square Area Conversion: If 1 yd = 3 ft 1\text{ yd} = 3\text{ ft} 1 yd = 3 ft , then: 1 yd 2 = ( 1 yd ) × ( 1 yd ) = ( 3 ft ) × ( 3 ft ) = 9 ft 2 1\text{ yd}^2 = (1\text{ yd}) \times (1\text{ yd}) = (3\text{ ft}) \times (3\text{ ft}) = 9\text{ ft}^2 1 yd 2 = ( 1 yd ) × ( 1 yd ) = ( 3 ft ) × ( 3 ft ) = 9 ft 2 1 ft 2 = ( 12 in ) × ( 12 in ) = 144 in 2 1\text{ ft}^2 = (12\text{ in}) \times (12\text{ in}) = 144\text{ in}^2 1 ft 2 = ( 12 in ) × ( 12 in ) = 144 in 2 1 m 2 = ( 100 cm ) × ( 100 cm ) = 10 , 000 cm 2 = 10 6 mm 2 1\text{ m}^2 = (100\text{ cm}) \times (100\text{ cm}) = 10,000\text{ cm}^2 = 10^6\text{ mm}^2 1 m 2 = ( 100 cm ) × ( 100 cm ) = 10 , 000 cm 2 = 1 0 6 mm 2 1 hectare (ha) = 100 m × 100 m = 10 , 000 m 2 1\text{ hectare (ha)} = 100\text{ m} \times 100\text{ m} = 10,000\text{ m}^2 1 hectare (ha) = 100 m × 100 m = 10 , 000 m 2

Cubic Volume Conversion: If 1 yd = 3 ft 1\text{ yd} = 3\text{ ft} 1 yd = 3 ft , then: 1 yd 3 = ( 3 ft ) 3 = 3 3 ft 3 = 27 ft 3 1\text{ yd}^3 = (3\text{ ft})^3 = 3^3\text{ ft}^3 = 27\text{ ft}^3 1 yd 3 = ( 3 ft ) 3 = 3 3 ft 3 = 27 ft 3 1 ft 3 = ( 12 in ) 3 = 1 , 728 in 3 1\text{ ft}^3 = (12\text{ in})^3 = 1,728\text{ in}^3 1 ft 3 = ( 12 in ) 3 = 1 , 728 in 3 1 m 3 = ( 100 cm ) 3 = 1 , 000 , 000 cm 3 = 10 6 mL = 1 , 000 L 1\text{ m}^3 = (100\text{ cm})^3 = 1,000,000\text{ cm}^3 = 10^6\text{ mL} = 1,000\text{ L} 1 m 3 = ( 100 cm ) 3 = 1 , 000 , 000 cm 3 = 1 0 6 mL = 1 , 000 L

3. Precision, Accuracy, and Measurement Error

Every empirical physical measurement entails inherent uncertainty governed by the resolution of the measuring instrument.

Accuracy vs. Precision

Accuracy: The closeness of a measured value to the true, accepted, or standard value (freedom from systematic bias).

Precision: The degree of agreement among repeated measurements under identical conditions (reproducibility) OR the fineness of the scale graduation (resolution). High Accuracy, High Precision High Precision, Low Accuracy Low Accuracy, Low Precision

  • (Centered & Tight) (Off-Center & Tight) (Scattered & Wide)
  • ◎◎◎ ◎ ◎
  • ◎ ● ◎ ◎ ●●● ● ◎ ●
  • ◎◎◎ ◎ ●
  • Significant Digits (Significant Figures)

Significant digits communicate the precision of a reported measurement:

Non-Zero Digits: Always significant ( 48.7 ⟹ 3 48.7 \implies 3 48.7 ⟹ 3 sig figs).

Captive (Interior) Zeros: Zeros between non-zero digits are always significant ( 6 , 008 ⟹ 4 6,008 \implies 4 6 , 008 ⟹ 4 sig figs).

Leading Zeros: Zeros preceding the first non-zero digit are placeholders and never significant ( 0.0042 ⟹ 2 0.0042 \implies 2 0.0042 ⟹ 2 sig figs).

Trailing Zeros:

Trailing zeros in a number containing a decimal point are significant ( 75.00 ⟹ 4 75.00 \implies 4 75.00 ⟹ 4 sig figs).

Trailing zeros in a whole number without an explicit decimal point are ambiguous ( 3 , 400 ⟹ 2 3,400 \implies 2 3 , 400 ⟹ 2 sig figs; write as 3.400 × 10 3 3.400 \times 10^3 3.400 × 1 0 3 for 4 sig figs).

Computational Rules for Significant Digits:

Addition / Subtraction: Round result to the same decimal place as the least precise measurement (e.g., 12.1 cm + 3.456 cm = 15.556 ⟹ 15.6 cm 12.1\text{ cm} + 3.456\text{ cm} = 15.556 \implies 15.6\text{ cm} 12.1 cm + 3.456 cm = 15.556 ⟹ 15.6 cm ).

Multiplication / Division: Round result to the same number of significant digits as the measurement with the fewest significant figures (e.g., 4.2 m × 1.35 m = 5.67 ⟹ 5.7 m 2 4.2\text{ m} \times 1.35\text{ m} = 5.67 \implies 5.7\text{ m}^2 4.2 m × 1.35 m = 5.67 ⟹ 5.7 m 2 ).

Greatest Possible Error (GPE) and Tolerance Intervals

The Greatest Possible Error (GPE) (or margin of measurement error) of any direct reading is defined as half the smallest unit of measurement (half of the tool's scale graduation): GPE = ± 1 2 × ( Smallest Graduation Unit ) \text{GPE} = \pm \frac{1}{2} \times (\text{Smallest Graduation Unit}) GPE = ± 2 1 ​ × ( Smallest Graduation Unit )

Example: A measurement reported as 14.8 cm 14.8\text{ cm} 14.8 cm is measured to the nearest tenth of a centimeter ( 0.1 cm 0.1\text{ cm} 0.1 cm ). GPE = ± 0.1 cm 2 = ± 0.05 cm \text{GPE} = \pm \frac{0.1\text{ cm}}{2} = \pm 0.05\text{ cm} GPE = ± 2 0.1 cm ​ = ± 0.05 cm Tolerance Interval = [ 14.8 − 0.05 , 14.8 + 0.05 ] = [ 14.75 cm , 14.85 cm ] \text{Tolerance Interval} = [14.8 - 0.05, \; 14.8 + 0.05] = [14.75\text{ cm}, \; 14.85\text{ cm}] Tolerance Interval = [ 14.8 − 0.05 , 14.8 + 0.05 ] = [ 14.75 cm , 14.85 cm ]

Relative Error and Percent Error Relative Error = GPE Reported Measurement or ∣ Experimental Value − Actual Value ∣ Actual Value \text{Relative Error} = \frac{\text{GPE}}{\text{Reported Measurement}} \quad \text{or} \quad \frac{|\text{Experimental Value} - \text{Actual Value}|}{\text{Actual Value}} Relative Error = Reported Measurement GPE ​ or Actual Value ∣ Experimental Value − Actual Value ∣ ​ Percent Error = Relative Error × 100 % \text{Percent Error} = \text{Relative Error} \times 100\% Percent Error = Relative Error × 100%

Error Propagation in Derived Measurements

When linear dimensions with measurement tolerances are combined to calculate perimeter, area, or volume, uncertainties propagate:

Perimeter: Uncertainties add linearly ( GPE P = 2 GPE l + 2 GPE w \text{GPE}_P = 2\text{GPE}_l + 2\text{GPE}_w GPE P ​ = 2 GPE l ​ + 2 GPE w ​ ).

Area Range: Area min ⁡ = ( l − GPE l ) ( w − GPE w ) Area max ⁡ = ( l + GPE l ) ( w + GPE w ) \text{Area}_{\min} = (l - \text{GPE}_l)(w - \text{GPE}_w) \qquad \text{Area}_{\max} = (l + \text{GPE}_l)(w + \text{GPE}_w) Area m i n ​ = ( l − GPE l ​ ) ( w − GPE w ​ ) Area m a x ​ = ( l + GPE l ​ ) ( w + GPE w ​ )

Volume Range: Vol min ⁡ = ( l − GPE l ) ( w − GPE w ) ( h − GPE h ) Vol max ⁡ = ( l + GPE l ) ( w + GPE w ) ( h + GPE h ) \text{Vol}_{\min} = (l - \text{GPE}_l)(w - \text{GPE}_w)(h - \text{GPE}_h) \qquad \text{Vol}_{\max} = (l + \text{GPE}_l)(w + \text{GPE}_w)(h + \text{GPE}_h) Vol m i n ​ = ( l − GPE l ​ ) ( w − GPE w ​ ) ( h − GPE h ​ ) Vol m a x ​ = ( l + GPE l ​ ) ( w + GPE w ​ ) ( h + GPE h ​ )

Dimensional Analysis & Measurement Error Matrix

Measurement Concept Mathematical Formulation Classroom / Engineering Application Common Misconception

Unit Factor Unit B Unit A = 1 \frac{\text{Unit } B}{\text{Unit } A} = 1 Unit A Unit B ​ = 1 Multi-step metric/customary conversions Inverting conversion ratio (multiplying instead of dividing)

Area Scaling Area Factor = k 2 \text{Area Factor} = k^2 Area Factor = k 2 Flooring, sodding, paint coverage ( 1 yd 2 = 9 ft 2 1\text{ yd}^2 = 9\text{ ft}^2 1 yd 2 = 9 ft 2 ) Assuming 1 yd 2 = 3 ft 2 1\text{ yd}^2 = 3\text{ ft}^2 1 yd 2 = 3 ft 2 (linear confusion)

Volume Scaling Volume Factor = k 3 \text{Volume Factor} = k^3 Volume Factor = k 3 Concrete, soil, water storage ( 1 yd 3 = 27 ft 3 1\text{ yd}^3 = 27\text{ ft}^3 1 yd 3 = 27 ft 3 ) Assuming 1 yd 3 = 9 ft 3 1\text{ yd}^3 = 9\text{ ft}^3 1 yd 3 = 9 ft 3 or 3 ft 3 3\text{ ft}^3 3 ft 3

GPE ± 1 2 × Scale Unit \pm \frac{1}{2} \times \text{Scale Unit} ± 2 1 ​ × Scale Unit Quantifying measurement tolerance Believing GPE equals the whole unit rather than half

Percent Error ∣ Exp − Actual ∣ Actual × 100 % \frac{\vert\text{Exp} - \text{Actual}\vert}{\text{Actual}} \times 100\% Actual ∣ Exp − Actual ∣ ​ × 100% Laboratory science calibration Dividing by experimental value instead of theoretical actual

Loading diagram... Dimensional Analysis and Measurement Error Pipeline