Study guide
Geometry, Thermal Expansion, and Mass
ASQ Certified Calibration Technician CCT
Track your progress as you read
Finished sections get a check mark.
1 SI Definitions and Realizations
The Seven SI Base Units and the 2019 Revision Realizing SI Units in the Laboratory
2 Derived Units, Prefixes, and Constants
Derived Units and Physical Calculations SI Prefixes and Compound-Unit Conversions Physical Constants and Their Applications
3 Measurement Standards and Selection
Types and Roles of Measurement Standards Selecting Standards for an Operational Hierarchy
4 Traceability and Standard Substitution
Traceability Evidence and Impact Review Evaluating and Authorizing Standard Substitution
5 Dimensional and Mechanical Metrology
Linear Displacement and Dimensional Instruments Geometry, Thermal Expansion, and Mass Force, Torque, Pressure, Density, and Viscosity
6 Temperature, Humidity, Volume, and Flow
Temperature Sensors and Thermometer Corrections Humidity, Volume, and Flow
7 Electrical, Optical, and Time Measurements
Voltage, Current, Resistance, and AC Measurement Time, Frequency, Light, Power, and Energy
8 Measurement Methods
Direct, Indirect, and Ratio Methods Transfer, Differential, and UUT Substitution Methods
9 Instrument Characteristics and Measurement Data
Sensitivity, Variability, and Precision Bias, Linearity, Stability, and Hysteresis Data Formats, Readability, and Suitability Resolution, Confidentiality, and Data Integrity
10 Specifications and Error Sources
Interpreting IM&TE Specification Terms Specification Calculations and Operating Qualifiers Instrument, Operator, and Circuit Errors Environmental, Geometric, and Interference Errors
11 Measurement Assurance
Check Standards and Statistical Process Control Proficiency Comparisons and Gage R&R
12 Procedures and Governing Requirements
Procedure Structure and Published Practice Sources Method Development, Deviations, and Handling Regulations, Contracts, and Requirement Precedence
13 Instrument Adjustment and Standardization
Calibration, Zero, and Span Adjustment Linearization, Nulling, and Digital Adjustment
14 Calibration Environment
Temperature and Humidity Control ESD, Dust, Vibration, and Pressure
15 Operations, Roles, and Scheduling
Receiving, As-Found Testing, and Calibration Flow Asset Identification, Tracking, and Release Laboratory Roles and Initial Scheduling Interval Review, Overdue Control, and Workloads
16 Method and Software Validation
Method Verification and Validation Studies Software, Firmware, and Spreadsheet Validation
17 Records and Formal Reporting
Controlled Records and Calibration Certificates Status Labels and Out-of-Tolerance Reporting
18 Uncertainty Concepts and Decision Risk
Error, Uncertainty, and Measurand Definition TAR, TUR, Tolerance Consumption, and Capability Conformity Decisions and False-Accept Risk Guard Bands and Conformity Reporting
19 Uncertainty Models and Budgets
Measurement Models and Uncertainty Contributions Distribution Selection and Budget Assembly
20 Type A and Type B Evaluation
Type A Statistics and Repeatability Outlier Review and Worked Type A Analysis Type B Distribution Models
21 Uncertainty Reporting and Applied Mathematics
Propagation, Covariance, and Effective Degrees of Freedom Coverage Factors and Expanded-Uncertainty Reporting Notation, Unit Conversions, Ratios, and Decibels Rounding, Algebra, Graphs, and Angular Conversions
22 Quality Systems and Tools
Quality-System Components, Planning, and Improvement The Seven Basic Quality Tools
23 Audits and Corrective Action
Audit Types, Planning, and Nonconformance Control Impact Assessment, Root Cause, and Effectiveness
24 Safety, Standards, and Professional Conduct
Electrical, Pressure, Chemical, and Laboratory Hazards PPE, Safety Data Sheets, 6S, and Safe Restoration Quality Standards, GUM, and VIM Accreditation Scope and Professional Ethics
Geometry, Thermal Expansion, and Mass
Key Takeaways Explain This Topic AI
An Abbe offset converts angular misalignment into a first-order displacement error.
Dimensional expansion depends on material coefficient, length, and temperature relative to the reference condition.
Mass comparison in air may require buoyancy correction based on air and object densities.
Last updated: October 2026
Geometric Principles, Alignment & Thermal Expansion
Metrological accuracy depends as much on geometry and environment as on instrument quality.
Ernst Abbe's Comparator Principle
Formulated in 1890 by German physicist Ernst Abbe, this principle is the foundational law of dimensional tool design:
"The measuring instrument must always be constructed so that the measuring distance is a straight-line continuation of the graduated scale used as the reference standard."
When the reference scale and measuring axis are collinear (as in an outside micrometer), any angular tilting or wobble (pitch or yaw by angle θ \theta θ ) of the moving member causes only a negligible second-order error : e second-order = L ( 1 − cos θ ) ≈ L θ 2 2 e_{\text{second-order}} = L (1 - \cos\theta) \approx L \frac{\theta^2}{2} e second-order = L ( 1 − cos θ ) ≈ L 2 θ 2
When an instrument violates Abbe's principle (as in calipers, height gages, and coordinate measuring arms), the measurement axis is separated from the reference scale by an offset distance d d d . Any angular tilt θ \theta θ of the slider jaw generates a catastrophic first-order Abbe error : e Abbe = d ⋅ tan θ ≈ d ⋅ θ e_{\text{Abbe}} = d \cdot \tan\theta \approx d \cdot \theta e Abbe = d ⋅ tan θ ≈ d ⋅ θ
For example, on a caliper measuring a part at the tip of 50 mm 50\text{ mm} 50 mm jaws ( d = 50 mm d = 50\text{ mm} d = 50 mm ), an imperceptible jaw play of just 0.05 ∘ 0.05^\circ 0.0 5 ∘ ( 0.00087 rad 0.00087\text{ rad} 0.00087 rad ) yields an error of: e Abbe = 50 mm × 0.000873 = 0.044 mm ( 44 μ m ) e_{\text{Abbe}} = 50\text{ mm} \times 0.000873 = 0.044\text{ mm} \quad (44\ \mu\text{m}) e Abbe = 50 mm × 0.000873 = 0.044 mm ( 44 μ m )
Cosine Error
Cosine error occurs when an instrument's measuring probe or axis of displacement is misaligned with the intended line of measurement by an angle θ \theta θ .
In lever-type dial test indicators , the stylus must be aligned parallel to the measured surface ( 0 ∘ 0^\circ 0 ∘ ). If the stylus is inclined at an angle θ \theta θ relative to the surface plane, the indicated dial deflection overstates the true perpendicular movement: L true = L indicated ⋅ cos θ L_{\text{true}} = L_{\text{indicated}} \cdot \cos\theta L true = L indicated ⋅ cos θ
In bore gages and coordinate measurements , if the measuring instrument traverses across an oblique angle θ \theta θ , the indicated length overstates the true orthogonal distance: L indicated = L true cos θ L_{\text{indicated}} = \frac{L_{\text{true}}}{\cos\theta} L indicated = cos θ L true
Thermal Expansion and the 20 ∘ C 20^\circ\text{C} 2 0 ∘ C Standard Reference Temperature
Per ISO 1:2022 , the universal standard reference temperature for geometrical product specifications and dimensional verification is exactly 20 ∘ C 20^\circ\text{C} 2 0 ∘ C ( 68 ∘ F 68^\circ\text{F} 6 8 ∘ F ) .
When a workpiece ( w w w ) and a measurement standard ( s s s ) deviate from 20 ∘ C 20^\circ\text{C} 2 0 ∘ C , the net differential thermal expansion error Δ L \Delta L Δ L is modeled by: Δ L = L 0 [ α w ( T w − 20 ∘ C ) − α s ( T s − 20 ∘ C ) ] \Delta L = L_0 \left[ \alpha_w (T_w - 20^\circ\text{C}) - \alpha_s (T_s - 20^\circ\text{C}) \right] Δ L = L 0 [ α w ( T w − 2 0 ∘ C ) − α s ( T s − 2 0 ∘ C ) ]
Where:
- L 0 L_0 L 0 = nominal length at 20 ∘ C 20^\circ\text{C} 2 0 ∘ C
- α w , α s \alpha_w, \alpha_s α w , α s = linear thermal expansion coefficients of workpiece and standard
- T w , T s T_w, T_s T w , T s = actual temperatures of workpiece and standard
Thermal stabilization is established by the procedure and uncertainty requirement. Verify equilibrium and gradients using temperature information; a fixed “one hour per inch” rule is not a universal guarantee. Material, mass, packaging, air flow, and the initial temperature difference all affect equilibration.
Mass Metrology and Buoyancy Correction
Mass metrology distinguishes true mass from conventional mass . Conventional mass is the mass of a reference of density 8000 kg/m³ that balances the object at 20°C in air of density 1.2 kg/m³. It is a defined convention, not simply any balance indication obtained in ambient air. Use the certificate’s quantity and reference density consistently.
Electronic Analytical Balances
Modern analytical balances utilize Electromagnetic Force Compensation (EMFC) . The weight pan rests on a mechanical flexure linkage connected to a coil suspended inside a permanent magnet's field. When a sample is loaded, an optical position detector senses deflection; a servo amplifier increases direct current through the coil to generate an opposing Lorentz force ( F = B ⋅ I ⋅ L F = B \cdot I \cdot L F = B ⋅ I ⋅ L ) returning the mechanism to optical null. The current required is proportional to the downward gravitational force.
Common balance tests: method-specific setup and limits
Repeatability (Precision): Determined by loading and unloading a test mass (typically 50% to 100% of capacity) a prescribed number of times (ten in this example). The sample standard deviation s s s quantifies random repeatability error.
Linearity (Accuracy across Span): Evaluated at the required test points, for example these five levels from zero to full capacity (e.g., 0%, 25%, 50%, 75%, 100%). Identifies multi-breakpoint span non-linearities.
Eccentricity (Corner Load Error): Verifies that off-center loading does not distort results. A test load (usually 1 / 3 1/3 1/3 capacity) is placed sequentially at the center, front-left, rear-left, rear-right, and front-right quadrants of the pan. Maximum allowable difference must not exceed the instrument specification.
Precision Standards and Weight Classifications
System Selection Important properties
OIML R111 E, F, or M class appropriate to the work Class-dependent limits for mass error, uncertainty, construction, density, and magnetic behavior.
ASTM E617 Class appropriate to the work Check the applicable edition and certificate; do not infer equivalence from class names alone.
Material and construction requirements depend on nominal value and class. Not every OIML weight must be monolithic stainless steel.
Air Buoyancy Correction
When weighing in air, the fluid buoyant upward force equals the weight of displaced air (Archimedes' Principle). If the sample density ρ \rho ρ differs from the reference weight density ρ r \rho_{r} ρ r , an apparent mass error is introduced.
The fundamental Air Buoyancy Correction Equation is: m = m r ⋅ 1 − ρ a ρ r 1 − ρ a ρ m = m_r \cdot \frac{1 - \frac{\rho_a}{\rho_r}}{1 - \frac{\rho_a}{\rho}} m = m r ⋅ 1 − ρ ρ a 1 − ρ r ρ a
Where:
- m m m = true mass of the object
- m r m_r m r = apparent mass indication relative to the stated reference (reference weight balance reading)
ρ a \rho_a ρ a = air density at ambient conditions (nominally 1.2 kg/m 3 1.2\text{ kg/m}^3 1.2 kg/m 3 at sea level, 20 ∘ C 20^\circ\text{C} 2 0 ∘ C , 50% RH)
ρ r \rho_{r} ρ r is the actual or assigned reference density used in the model; 8000 kg/m³ is the conventional reference density, not the exact density of every stainless-steel weight. Here m r m_r m r is the apparent reading referred to the true calibrated mass of that reference. Convert conventional certificate values appropriately before applying a general true-mass model.
- ρ \rho ρ = true density of the object being weighed
- Practical Buoyancy Impact
When calibrating water volumes for pipette verification ( ρ water ≈ 1000 kg/m 3 \rho_{\text{water}} \approx 1000\text{ kg/m}^3 ρ water ≈ 1000 kg/m 3 ): m m r = 1 − 1.2 / 8000 1 − 1.2 / 1000 = 1 − 0.00015 1 − 0.00120 = 0.99985 0.99880 ≈ 1.001051 \frac{m}{m_r} = \frac{1 - 1.2 / 8000}{1 - 1.2 / 1000} = \frac{1 - 0.00015}{1 - 0.00120} = \frac{0.99985}{0.99880} \approx 1.001051 m r m = 1 − 1.2/1000 1 − 1.2/8000 = 1 − 0.00120 1 − 0.00015 = 0.99880 0.99985 ≈ 1.001051
Failing to apply the buoyancy correction when weighing water introduces a systematic negative bias of 0.105 % 0.105\% 0.105% ( 1050 ppm 1050\text{ ppm} 1050 ppm ) —a severe error in micro-pipette calibration.