Study guide
Linear Displacement and Dimensional Instruments
ASQ Certified Calibration Technician CCT
Track your progress as you read
Finished sections get a check mark.
1 SI Definitions and Realizations
The Seven SI Base Units and the 2019 Revision Realizing SI Units in the Laboratory
2 Derived Units, Prefixes, and Constants
Derived Units and Physical Calculations SI Prefixes and Compound-Unit Conversions Physical Constants and Their Applications
3 Measurement Standards and Selection
Types and Roles of Measurement Standards Selecting Standards for an Operational Hierarchy
4 Traceability and Standard Substitution
Traceability Evidence and Impact Review Evaluating and Authorizing Standard Substitution
5 Dimensional and Mechanical Metrology
Linear Displacement and Dimensional Instruments Geometry, Thermal Expansion, and Mass Force, Torque, Pressure, Density, and Viscosity
6 Temperature, Humidity, Volume, and Flow
Temperature Sensors and Thermometer Corrections Humidity, Volume, and Flow
7 Electrical, Optical, and Time Measurements
Voltage, Current, Resistance, and AC Measurement Time, Frequency, Light, Power, and Energy
8 Measurement Methods
Direct, Indirect, and Ratio Methods Transfer, Differential, and UUT Substitution Methods
9 Instrument Characteristics and Measurement Data
Sensitivity, Variability, and Precision Bias, Linearity, Stability, and Hysteresis Data Formats, Readability, and Suitability Resolution, Confidentiality, and Data Integrity
10 Specifications and Error Sources
Interpreting IM&TE Specification Terms Specification Calculations and Operating Qualifiers Instrument, Operator, and Circuit Errors Environmental, Geometric, and Interference Errors
11 Measurement Assurance
Check Standards and Statistical Process Control Proficiency Comparisons and Gage R&R
12 Procedures and Governing Requirements
Procedure Structure and Published Practice Sources Method Development, Deviations, and Handling Regulations, Contracts, and Requirement Precedence
13 Instrument Adjustment and Standardization
Calibration, Zero, and Span Adjustment Linearization, Nulling, and Digital Adjustment
14 Calibration Environment
Temperature and Humidity Control ESD, Dust, Vibration, and Pressure
15 Operations, Roles, and Scheduling
Receiving, As-Found Testing, and Calibration Flow Asset Identification, Tracking, and Release Laboratory Roles and Initial Scheduling Interval Review, Overdue Control, and Workloads
16 Method and Software Validation
Method Verification and Validation Studies Software, Firmware, and Spreadsheet Validation
17 Records and Formal Reporting
Controlled Records and Calibration Certificates Status Labels and Out-of-Tolerance Reporting
18 Uncertainty Concepts and Decision Risk
Error, Uncertainty, and Measurand Definition TAR, TUR, Tolerance Consumption, and Capability Conformity Decisions and False-Accept Risk Guard Bands and Conformity Reporting
19 Uncertainty Models and Budgets
Measurement Models and Uncertainty Contributions Distribution Selection and Budget Assembly
20 Type A and Type B Evaluation
Type A Statistics and Repeatability Outlier Review and Worked Type A Analysis Type B Distribution Models
21 Uncertainty Reporting and Applied Mathematics
Propagation, Covariance, and Effective Degrees of Freedom Coverage Factors and Expanded-Uncertainty Reporting Notation, Unit Conversions, Ratios, and Decibels Rounding, Algebra, Graphs, and Angular Conversions
22 Quality Systems and Tools
Quality-System Components, Planning, and Improvement The Seven Basic Quality Tools
23 Audits and Corrective Action
Audit Types, Planning, and Nonconformance Control Impact Assessment, Root Cause, and Effectiveness
24 Safety, Standards, and Professional Conduct
Electrical, Pressure, Chemical, and Laboratory Hazards PPE, Safety Data Sheets, 6S, and Safe Restoration Quality Standards, GUM, and VIM Accreditation Scope and Professional Ethics
Linear Displacement and Dimensional Instruments
Key Takeaways Explain This Topic AI
Gage blocks, micrometers, indicators, calipers, and interferometers serve different dimensional measurement tasks.
Measuring force, wringing, surface condition, and stabilization affect dimensional results.
ISO gage-block grades and ASME grading conventions must not be treated as interchangeable labels.
Last updated: October 2026
Dimensional and mechanical metrology establishes physical interchangeability, structural integrity, and manufacturing compliance across modern engineering disciplines. Calibration technicians must master instrument mechanics, error physics (such as Abbe offset and cosine misalignment), and strict environmental stabilization at the standard reference temperature of 20 ∘ C 20^\circ\text{C} 2 0 ∘ C ( 68 ∘ F 68^\circ\text{F} 6 8 ∘ F ). Calibration rigor extends from nanoscale gage block wringing to multi-megapascal deadweight pressure testing and kinematic viscosity determinations.
Linear Displacement Standards and Measuring Instruments
Linear displacement constitutes the most frequent measurement category in industrial calibration laboratories. Achieving metrological traceability requires selecting reference standards and instruments whose measurement uncertainties, contact geometries, and resolutions align with the required Test Uncertainty Ratio (using the task’s capability and decision-rule requirements).
Gage Blocks (End Standards)
Gage blocks represent the physical realization of length standards in dimensional calibration. Governed internationally by ISO 3650 and in the United States by ASME B89.1.9 , gage blocks are rectangular or square blocks with two flat, parallel measuring faces finished to a mirror surface (roughness R a ≤ 0.025 μ m R_a \le 0.025\ \mu\text{m} R a ≤ 0.025 μ m ).
ISO 3650 grade Typical role Selection consideration
K Calibration reference Use calibrated deviations and uncertainty.
0 Precision laboratory work Verify the actual certificate and method.
1 Inspection Grade alone does not establish process uncertainty.
2 Working and setting Protect surfaces and control wear.
Do not equate legacy ASME grade 00 with ISO grade K. Grade designations and permissible errors depend on the standard and edition.
Material Considerations and Thermal Expansion
High-Carbon Chromium Alloy Steel: α ≈ 11.5 × 10 − 6 K − 1 \alpha \approx 11.5 \times 10^{-6}\text{ K}^{-1} α ≈ 11.5 × 1 0 − 6 K − 1 . Excellent wear resistance and dimensional stability; vulnerable to atmospheric corrosion; magnetic.
Tungsten Carbide: α ≈ 4.5 × 10 − 6 K − 1 \alpha \approx 4.5 \times 10^{-6}\text{ K}^{-1} α ≈ 4.5 × 1 0 − 6 K − 1 . Extremely hard (up to 1500 HV 1500\text{ HV} 1500 HV ) and wear-resistant; high density ( 14 to 15 g/cm 3 14\text{ to }15\text{ g/cm}^3 14 to 15 g/cm 3 ); lower thermal expansion coefficient requires rigorous math corrections when calibrating steel artifacts.
Zirconia Ceramic: α ≈ 9.5 × 10 − 6 K − 1 \alpha \approx 9.5 \times 10^{-6}\text{ K}^{-1} α ≈ 9.5 × 1 0 − 6 K − 1 . Chemically inert, resistant to ordinary corrosion, subject to material and handling limitations, non-magnetic, and resistant to scratch burrs. Thermal expansion closely matches structural alloy steels.
The Science of Wringing
Wringing is the phenomenon where two ultra-flat surfaces adhere strongly when brought into sliding contact. The bond is established through a combination of molecular van der Waals forces , atmospheric pressure, and surface tension from a microscopic interstitial liquid film (~ 0.025 μ m 0.025\ \mu\text{m} 0.025 μ m or 1 μ in 1\ \mu\text{in} 1 μ in thick).
Cleaning: Degrease blocks using high-purity filtered mineral spirits or trichloroethane substitutes. Wipe dry with lint-free optical paper or clean chamois.
Stoning: Inspect faces for burrs and damage. Abrasive stoning can alter a calibrated surface and is performed only by trained personnel when specifically permitted by the manufacturer’s maintenance procedure.
Lubrication: Use the approved wringing preparation for the material and surface, leaving only the intended thin film. Do not assume every block requires an identical oil or a demonstrably monomolecular film.
Engagement: Cross the blocks perpendicularly at mid-span, apply gentle normal force (approx. 20 to 30 N 20\text{ to }30\text{ N} 20 to 30 N ), and twist the blocks into alignment until smooth, cohesive resistance is felt.
Calibration of reference grade blocks is performed via optical interferometry (using monochromatic helium-neon lasers or cadmium lamps and the fractional fringe method) or by differential mechanical comparison against primary masters using high-resolution dual-probe comparator stations.
Hand-Held Dimensional Tools
Instrument Standard Resolution Common Travel / Span Dominant Calibration Error Source
Outside Micrometer 0.01 mm 0.01\text{ mm} 0.01 mm / 0.0001 in 0.0001\text{ in} 0.0001 in 25 mm 25\text{ mm} 25 mm / 1 in 1\text{ in} 1 in increments Spindle lead-screw pitch error, anvil wear, flexure
Vernier Caliper 0.02 mm 0.02\text{ mm} 0.02 mm / 0.001 in 0.001\text{ in} 0.001 in 0 to 150 − 300 mm 0\text{ to }150-300\text{ mm} 0 to 150 − 300 mm Abbe error from jaw play, parallax reading error
Dial Caliper 0.01 mm 0.01\text{ mm} 0.01 mm / 0.001 in 0.001\text{ in} 0.001 in 0 to 150 − 300 mm 0\text{ to }150-300\text{ mm} 0 to 150 − 300 mm Rack-and-pinion dirt accumulation, gear tooth wear
Digital Caliper 0.01 mm 0.01\text{ mm} 0.01 mm / 0.0005 in 0.0005\text{ in} 0.0005 in 0 to 150 − 300 mm 0\text{ to }150-300\text{ mm} 0 to 150 − 300 mm Capacitive scale contamination, jaw misalignment
Plunger Dial Indicator 0.01 to 0.001 mm 0.01\text{ to }0.001\text{ mm} 0.01 to 0.001 mm 1 to 50 mm 1\text{ to }50\text{ mm} 1 to 50 mm Internal rack-pinion gear hysteresis, spring tension variation
Lever Test Indicator 0.002 to 0.001 mm 0.002\text{ to }0.001\text{ mm} 0.002 to 0.001 mm 0.5 to 1.0 mm 0.5\text{ to }1.0\text{ mm} 0.5 to 1.0 mm Cosine error from stylus angle, pivot friction
Micrometer Calibration Protocols
Outside micrometers incorporate a precision ground lead screw with a typical metric pitch of 0.5 mm 0.5\text{ mm} 0.5 mm or an inch pitch of 0.025 in 0.025\text{ in} 0.025 in (40 threads per inch); these pitches are not equal. The following are illustrative micrometer checks; test points, force, flatness limits, and accessories follow the model and applicable method:
Spindle and Anvil Flatness: Evaluated using an optical flat under monochromatic light (helium λ = 587.6 nm \lambda = 587.6\text{ nm} λ = 587.6 nm , where each dark fringe represents λ / 2 ≈ 0.3 μ m \lambda / 2 \approx 0.3\ \mu\text{m} λ /2 ≈ 0.3 μ m of elevation departure). Acceptable working tolerance is typically ≤ 2 \le 2 ≤ 2 fringes ( 0.6 μ m 0.6\ \mu\text{m} 0.6 μ m ).
Anvil Parallelism: Evaluated using a set of four optical parallel blocks whose thicknesses vary by one-quarter turn of the spindle ( 0.125 mm 0.125\text{ mm} 0.125 mm steps), ensuring parallelism is verified at four distinct radial orientations.
Scale Linearity: Calibrated using Grade 0 gage blocks selected at non-repeating spindle fractions (e.g., 2.5 , 5.1 , 7.7 , 10.3 , 12.9 , 15.0 , 17.6 , 20.2 , 22.8 , 25.0 mm 2.5, 5.1, 7.7, 10.3, 12.9, 15.0, 17.6, 20.2, 22.8, 25.0\text{ mm} 2.5 , 5.1 , 7.7 , 10.3 , 12.9 , 15.0 , 17.6 , 20.2 , 22.8 , 25.0 mm ) to expose progressive pitch error and periodic screw drunken-thread errors.
Ratchet Stop Force: The ratchet stop or friction thimble must deliver the repeatable measuring force specified for that model and procedure.
Electromechanical and Optical Transducers
Linear variable differential transformers (LVDTs): An excited primary and opposed secondary coils detect movable-core displacement. Near the designed null, the ideal secondary difference is zero; real devices can have residual output. The response is approximately linear over a specified range. A contactless core can reduce friction, but practical resolution is limited by noise, electronics, mechanics, and the setup, rather than being infinite.
Optical Comparators: Project a magnified, telecentric shadow profile or surface image onto a ground-glass screen equipped with crosshairs and protractor graduations ( 360 ∘ 360^\circ 36 0 ∘ ). Profile illumination uses transmitted light behind the part; surface illumination uses incident light for surface features. Calibration verifies lens magnification accuracy ( 10 × , 20 × , 50 × , 100 × 10\times, 20\times, 50\times, 100\times 10 × , 20 × , 50 × , 100 × ) using precision etched glass grid scales or chrome tooling balls, checking distortion across the full screen field of view.