Study guide

Geometry, Thermal Expansion, and Mass

ASQ Certified Calibration Technician CCT

Track your progress as you read

Finished sections get a check mark.

1 SI Definitions and Realizations

The Seven SI Base Units and the 2019 Revision Realizing SI Units in the Laboratory

2 Derived Units, Prefixes, and Constants

Derived Units and Physical Calculations SI Prefixes and Compound-Unit Conversions Physical Constants and Their Applications

3 Measurement Standards and Selection

Types and Roles of Measurement Standards Selecting Standards for an Operational Hierarchy

4 Traceability and Standard Substitution

Traceability Evidence and Impact Review Evaluating and Authorizing Standard Substitution

5 Dimensional and Mechanical Metrology

Linear Displacement and Dimensional Instruments Geometry, Thermal Expansion, and Mass Force, Torque, Pressure, Density, and Viscosity

6 Temperature, Humidity, Volume, and Flow

Temperature Sensors and Thermometer Corrections Humidity, Volume, and Flow

7 Electrical, Optical, and Time Measurements

Voltage, Current, Resistance, and AC Measurement Time, Frequency, Light, Power, and Energy

8 Measurement Methods

Direct, Indirect, and Ratio Methods Transfer, Differential, and UUT Substitution Methods

9 Instrument Characteristics and Measurement Data

Sensitivity, Variability, and Precision Bias, Linearity, Stability, and Hysteresis Data Formats, Readability, and Suitability Resolution, Confidentiality, and Data Integrity

10 Specifications and Error Sources

Interpreting IM&TE Specification Terms Specification Calculations and Operating Qualifiers Instrument, Operator, and Circuit Errors Environmental, Geometric, and Interference Errors

11 Measurement Assurance

Check Standards and Statistical Process Control Proficiency Comparisons and Gage R&R

12 Procedures and Governing Requirements

Procedure Structure and Published Practice Sources Method Development, Deviations, and Handling Regulations, Contracts, and Requirement Precedence

13 Instrument Adjustment and Standardization

Calibration, Zero, and Span Adjustment Linearization, Nulling, and Digital Adjustment

14 Calibration Environment

Temperature and Humidity Control ESD, Dust, Vibration, and Pressure

15 Operations, Roles, and Scheduling

Receiving, As-Found Testing, and Calibration Flow Asset Identification, Tracking, and Release Laboratory Roles and Initial Scheduling Interval Review, Overdue Control, and Workloads

16 Method and Software Validation

Method Verification and Validation Studies Software, Firmware, and Spreadsheet Validation

17 Records and Formal Reporting

Controlled Records and Calibration Certificates Status Labels and Out-of-Tolerance Reporting

18 Uncertainty Concepts and Decision Risk

Error, Uncertainty, and Measurand Definition TAR, TUR, Tolerance Consumption, and Capability Conformity Decisions and False-Accept Risk Guard Bands and Conformity Reporting

19 Uncertainty Models and Budgets

Measurement Models and Uncertainty Contributions Distribution Selection and Budget Assembly

20 Type A and Type B Evaluation

Type A Statistics and Repeatability Outlier Review and Worked Type A Analysis Type B Distribution Models

21 Uncertainty Reporting and Applied Mathematics

Propagation, Covariance, and Effective Degrees of Freedom Coverage Factors and Expanded-Uncertainty Reporting Notation, Unit Conversions, Ratios, and Decibels Rounding, Algebra, Graphs, and Angular Conversions

22 Quality Systems and Tools

Quality-System Components, Planning, and Improvement The Seven Basic Quality Tools

23 Audits and Corrective Action

Audit Types, Planning, and Nonconformance Control Impact Assessment, Root Cause, and Effectiveness

24 Safety, Standards, and Professional Conduct

Electrical, Pressure, Chemical, and Laboratory Hazards PPE, Safety Data Sheets, 6S, and Safe Restoration Quality Standards, GUM, and VIM Accreditation Scope and Professional Ethics

Geometry, Thermal Expansion, and Mass

Key Takeaways Explain This Topic AI

An Abbe offset converts angular misalignment into a first-order displacement error.

Dimensional expansion depends on material coefficient, length, and temperature relative to the reference condition.

Mass comparison in air may require buoyancy correction based on air and object densities.

Last updated: October 2026

Geometric Principles, Alignment & Thermal Expansion

Metrological accuracy depends as much on geometry and environment as on instrument quality.

Ernst Abbe's Comparator Principle

Formulated in 1890 by German physicist Ernst Abbe, this principle is the foundational law of dimensional tool design:

"The measuring instrument must always be constructed so that the measuring distance is a straight-line continuation of the graduated scale used as the reference standard."

When the reference scale and measuring axis are collinear (as in an outside micrometer), any angular tilting or wobble (pitch or yaw by angle θ \theta θ ) of the moving member causes only a negligible second-order error : e second-order = L ( 1 − cos ⁡ θ ) ≈ L θ 2 2 e_{\text{second-order}} = L (1 - \cos\theta) \approx L \frac{\theta^2}{2} e second-order ​ = L ( 1 − cos θ ) ≈ L 2 θ 2 ​

When an instrument violates Abbe's principle (as in calipers, height gages, and coordinate measuring arms), the measurement axis is separated from the reference scale by an offset distance d d d . Any angular tilt θ \theta θ of the slider jaw generates a catastrophic first-order Abbe error : e Abbe = d ⋅ tan ⁡ θ ≈ d ⋅ θ e_{\text{Abbe}} = d \cdot \tan\theta \approx d \cdot \theta e Abbe ​ = d ⋅ tan θ ≈ d ⋅ θ

For example, on a caliper measuring a part at the tip of 50 mm 50\text{ mm} 50 mm jaws ( d = 50 mm d = 50\text{ mm} d = 50 mm ), an imperceptible jaw play of just 0.05 ∘ 0.05^\circ 0.0 5 ∘ ( 0.00087 rad 0.00087\text{ rad} 0.00087 rad ) yields an error of: e Abbe = 50 mm × 0.000873 = 0.044 mm ( 44 μ m ) e_{\text{Abbe}} = 50\text{ mm} \times 0.000873 = 0.044\text{ mm} \quad (44\ \mu\text{m}) e Abbe ​ = 50 mm × 0.000873 = 0.044 mm ( 44 μ m )

Cosine Error

Cosine error occurs when an instrument's measuring probe or axis of displacement is misaligned with the intended line of measurement by an angle θ \theta θ .

In lever-type dial test indicators , the stylus must be aligned parallel to the measured surface ( 0 ∘ 0^\circ 0 ∘ ). If the stylus is inclined at an angle θ \theta θ relative to the surface plane, the indicated dial deflection overstates the true perpendicular movement: L true = L indicated ⋅ cos ⁡ θ L_{\text{true}} = L_{\text{indicated}} \cdot \cos\theta L true ​ = L indicated ​ ⋅ cos θ

In bore gages and coordinate measurements , if the measuring instrument traverses across an oblique angle θ \theta θ , the indicated length overstates the true orthogonal distance: L indicated = L true cos ⁡ θ L_{\text{indicated}} = \frac{L_{\text{true}}}{\cos\theta} L indicated ​ = cos θ L true ​ ​

Thermal Expansion and the 20 ∘ C 20^\circ\text{C} 2 0 ∘ C Standard Reference Temperature

Per ISO 1:2022 , the universal standard reference temperature for geometrical product specifications and dimensional verification is exactly 20 ∘ C 20^\circ\text{C} 2 0 ∘ C ( 68 ∘ F 68^\circ\text{F} 6 8 ∘ F ) .

When a workpiece ( w w w ) and a measurement standard ( s s s ) deviate from 20 ∘ C 20^\circ\text{C} 2 0 ∘ C , the net differential thermal expansion error Δ L \Delta L Δ L is modeled by: Δ L = L 0 [ α w ( T w − 20 ∘ C ) − α s ( T s − 20 ∘ C ) ] \Delta L = L_0 \left[ \alpha_w (T_w - 20^\circ\text{C}) - \alpha_s (T_s - 20^\circ\text{C}) \right] Δ L = L 0 ​ [ α w ​ ( T w ​ − 2 0 ∘ C ) − α s ​ ( T s ​ − 2 0 ∘ C ) ]

Where:

  • L 0 L_0 L 0 ​ = nominal length at 20 ∘ C 20^\circ\text{C} 2 0 ∘ C
  • α w , α s \alpha_w, \alpha_s α w ​ , α s ​ = linear thermal expansion coefficients of workpiece and standard
  • T w , T s T_w, T_s T w ​ , T s ​ = actual temperatures of workpiece and standard

Thermal stabilization is established by the procedure and uncertainty requirement. Verify equilibrium and gradients using temperature information; a fixed “one hour per inch” rule is not a universal guarantee. Material, mass, packaging, air flow, and the initial temperature difference all affect equilibration.

Mass Metrology and Buoyancy Correction

Mass metrology distinguishes true mass from conventional mass . Conventional mass is the mass of a reference of density 8000 kg/m³ that balances the object at 20°C in air of density 1.2 kg/m³. It is a defined convention, not simply any balance indication obtained in ambient air. Use the certificate’s quantity and reference density consistently.

Electronic Analytical Balances

Modern analytical balances utilize Electromagnetic Force Compensation (EMFC) . The weight pan rests on a mechanical flexure linkage connected to a coil suspended inside a permanent magnet's field. When a sample is loaded, an optical position detector senses deflection; a servo amplifier increases direct current through the coil to generate an opposing Lorentz force ( F = B ⋅ I ⋅ L F = B \cdot I \cdot L F = B ⋅ I ⋅ L ) returning the mechanism to optical null. The current required is proportional to the downward gravitational force.

Common balance tests: method-specific setup and limits

Repeatability (Precision): Determined by loading and unloading a test mass (typically 50% to 100% of capacity) a prescribed number of times (ten in this example). The sample standard deviation s s s quantifies random repeatability error.

Linearity (Accuracy across Span): Evaluated at the required test points, for example these five levels from zero to full capacity (e.g., 0%, 25%, 50%, 75%, 100%). Identifies multi-breakpoint span non-linearities.

Eccentricity (Corner Load Error): Verifies that off-center loading does not distort results. A test load (usually 1 / 3 1/3 1/3 capacity) is placed sequentially at the center, front-left, rear-left, rear-right, and front-right quadrants of the pan. Maximum allowable difference must not exceed the instrument specification.

Precision Standards and Weight Classifications

System Selection Important properties

OIML R111 E, F, or M class appropriate to the work Class-dependent limits for mass error, uncertainty, construction, density, and magnetic behavior.

ASTM E617 Class appropriate to the work Check the applicable edition and certificate; do not infer equivalence from class names alone.

Material and construction requirements depend on nominal value and class. Not every OIML weight must be monolithic stainless steel.

Air Buoyancy Correction

When weighing in air, the fluid buoyant upward force equals the weight of displaced air (Archimedes' Principle). If the sample density ρ \rho ρ differs from the reference weight density ρ r \rho_{r} ρ r ​ , an apparent mass error is introduced.

The fundamental Air Buoyancy Correction Equation is: m = m r ⋅ 1 − ρ a ρ r 1 − ρ a ρ m = m_r \cdot \frac{1 - \frac{\rho_a}{\rho_r}}{1 - \frac{\rho_a}{\rho}} m = m r ​ ⋅ 1 − ρ ρ a ​ ​ 1 − ρ r ​ ρ a ​ ​ ​

Where:

  • m m m = true mass of the object
  • m r m_r m r ​ = apparent mass indication relative to the stated reference (reference weight balance reading)

ρ a \rho_a ρ a ​ = air density at ambient conditions (nominally 1.2 kg/m 3 1.2\text{ kg/m}^3 1.2 kg/m 3 at sea level, 20 ∘ C 20^\circ\text{C} 2 0 ∘ C , 50% RH)

ρ r \rho_{r} ρ r ​ is the actual or assigned reference density used in the model; 8000 kg/m³ is the conventional reference density, not the exact density of every stainless-steel weight. Here m r m_r m r ​ is the apparent reading referred to the true calibrated mass of that reference. Convert conventional certificate values appropriately before applying a general true-mass model.

  • ρ \rho ρ = true density of the object being weighed
  • Practical Buoyancy Impact

When calibrating water volumes for pipette verification ( ρ water ≈ 1000 kg/m 3 \rho_{\text{water}} \approx 1000\text{ kg/m}^3 ρ water ​ ≈ 1000 kg/m 3 ): m m r = 1 − 1.2 / 8000 1 − 1.2 / 1000 = 1 − 0.00015 1 − 0.00120 = 0.99985 0.99880 ≈ 1.001051 \frac{m}{m_r} = \frac{1 - 1.2 / 8000}{1 - 1.2 / 1000} = \frac{1 - 0.00015}{1 - 0.00120} = \frac{0.99985}{0.99880} \approx 1.001051 m r ​ m ​ = 1 − 1.2/1000 1 − 1.2/8000 ​ = 1 − 0.00120 1 − 0.00015 ​ = 0.99880 0.99985 ​ ≈ 1.001051

Failing to apply the buoyancy correction when weighing water introduces a systematic negative bias of 0.105 % 0.105\% 0.105% ( 1050 ppm 1050\text{ ppm} 1050 ppm ) —a severe error in micro-pipette calibration.