Study guide

Linear Displacement and Dimensional Instruments

ASQ Certified Calibration Technician CCT

Track your progress as you read

Finished sections get a check mark.

1 SI Definitions and Realizations

The Seven SI Base Units and the 2019 Revision Realizing SI Units in the Laboratory

2 Derived Units, Prefixes, and Constants

Derived Units and Physical Calculations SI Prefixes and Compound-Unit Conversions Physical Constants and Their Applications

3 Measurement Standards and Selection

Types and Roles of Measurement Standards Selecting Standards for an Operational Hierarchy

4 Traceability and Standard Substitution

Traceability Evidence and Impact Review Evaluating and Authorizing Standard Substitution

5 Dimensional and Mechanical Metrology

Linear Displacement and Dimensional Instruments Geometry, Thermal Expansion, and Mass Force, Torque, Pressure, Density, and Viscosity

6 Temperature, Humidity, Volume, and Flow

Temperature Sensors and Thermometer Corrections Humidity, Volume, and Flow

7 Electrical, Optical, and Time Measurements

Voltage, Current, Resistance, and AC Measurement Time, Frequency, Light, Power, and Energy

8 Measurement Methods

Direct, Indirect, and Ratio Methods Transfer, Differential, and UUT Substitution Methods

9 Instrument Characteristics and Measurement Data

Sensitivity, Variability, and Precision Bias, Linearity, Stability, and Hysteresis Data Formats, Readability, and Suitability Resolution, Confidentiality, and Data Integrity

10 Specifications and Error Sources

Interpreting IM&TE Specification Terms Specification Calculations and Operating Qualifiers Instrument, Operator, and Circuit Errors Environmental, Geometric, and Interference Errors

11 Measurement Assurance

Check Standards and Statistical Process Control Proficiency Comparisons and Gage R&R

12 Procedures and Governing Requirements

Procedure Structure and Published Practice Sources Method Development, Deviations, and Handling Regulations, Contracts, and Requirement Precedence

13 Instrument Adjustment and Standardization

Calibration, Zero, and Span Adjustment Linearization, Nulling, and Digital Adjustment

14 Calibration Environment

Temperature and Humidity Control ESD, Dust, Vibration, and Pressure

15 Operations, Roles, and Scheduling

Receiving, As-Found Testing, and Calibration Flow Asset Identification, Tracking, and Release Laboratory Roles and Initial Scheduling Interval Review, Overdue Control, and Workloads

16 Method and Software Validation

Method Verification and Validation Studies Software, Firmware, and Spreadsheet Validation

17 Records and Formal Reporting

Controlled Records and Calibration Certificates Status Labels and Out-of-Tolerance Reporting

18 Uncertainty Concepts and Decision Risk

Error, Uncertainty, and Measurand Definition TAR, TUR, Tolerance Consumption, and Capability Conformity Decisions and False-Accept Risk Guard Bands and Conformity Reporting

19 Uncertainty Models and Budgets

Measurement Models and Uncertainty Contributions Distribution Selection and Budget Assembly

20 Type A and Type B Evaluation

Type A Statistics and Repeatability Outlier Review and Worked Type A Analysis Type B Distribution Models

21 Uncertainty Reporting and Applied Mathematics

Propagation, Covariance, and Effective Degrees of Freedom Coverage Factors and Expanded-Uncertainty Reporting Notation, Unit Conversions, Ratios, and Decibels Rounding, Algebra, Graphs, and Angular Conversions

22 Quality Systems and Tools

Quality-System Components, Planning, and Improvement The Seven Basic Quality Tools

23 Audits and Corrective Action

Audit Types, Planning, and Nonconformance Control Impact Assessment, Root Cause, and Effectiveness

24 Safety, Standards, and Professional Conduct

Electrical, Pressure, Chemical, and Laboratory Hazards PPE, Safety Data Sheets, 6S, and Safe Restoration Quality Standards, GUM, and VIM Accreditation Scope and Professional Ethics

Linear Displacement and Dimensional Instruments

Key Takeaways Explain This Topic AI

Gage blocks, micrometers, indicators, calipers, and interferometers serve different dimensional measurement tasks.

Measuring force, wringing, surface condition, and stabilization affect dimensional results.

ISO gage-block grades and ASME grading conventions must not be treated as interchangeable labels.

Last updated: October 2026

Dimensional and mechanical metrology establishes physical interchangeability, structural integrity, and manufacturing compliance across modern engineering disciplines. Calibration technicians must master instrument mechanics, error physics (such as Abbe offset and cosine misalignment), and strict environmental stabilization at the standard reference temperature of 20 ∘ C 20^\circ\text{C} 2 0 ∘ C ( 68 ∘ F 68^\circ\text{F} 6 8 ∘ F ). Calibration rigor extends from nanoscale gage block wringing to multi-megapascal deadweight pressure testing and kinematic viscosity determinations.

Linear Displacement Standards and Measuring Instruments

Linear displacement constitutes the most frequent measurement category in industrial calibration laboratories. Achieving metrological traceability requires selecting reference standards and instruments whose measurement uncertainties, contact geometries, and resolutions align with the required Test Uncertainty Ratio (using the task’s capability and decision-rule requirements).

Gage Blocks (End Standards)

Gage blocks represent the physical realization of length standards in dimensional calibration. Governed internationally by ISO 3650 and in the United States by ASME B89.1.9 , gage blocks are rectangular or square blocks with two flat, parallel measuring faces finished to a mirror surface (roughness R a ≤ 0.025 μ m R_a \le 0.025\ \mu\text{m} R a ​ ≤ 0.025 μ m ).

ISO 3650 grade Typical role Selection consideration

K Calibration reference Use calibrated deviations and uncertainty.

0 Precision laboratory work Verify the actual certificate and method.

1 Inspection Grade alone does not establish process uncertainty.

2 Working and setting Protect surfaces and control wear.

Do not equate legacy ASME grade 00 with ISO grade K. Grade designations and permissible errors depend on the standard and edition.

Material Considerations and Thermal Expansion

High-Carbon Chromium Alloy Steel: α ≈ 11.5 × 10 − 6 K − 1 \alpha \approx 11.5 \times 10^{-6}\text{ K}^{-1} α ≈ 11.5 × 1 0 − 6 K − 1 . Excellent wear resistance and dimensional stability; vulnerable to atmospheric corrosion; magnetic.

Tungsten Carbide: α ≈ 4.5 × 10 − 6 K − 1 \alpha \approx 4.5 \times 10^{-6}\text{ K}^{-1} α ≈ 4.5 × 1 0 − 6 K − 1 . Extremely hard (up to 1500 HV 1500\text{ HV} 1500 HV ) and wear-resistant; high density ( 14 to 15 g/cm 3 14\text{ to }15\text{ g/cm}^3 14 to 15 g/cm 3 ); lower thermal expansion coefficient requires rigorous math corrections when calibrating steel artifacts.

Zirconia Ceramic: α ≈ 9.5 × 10 − 6 K − 1 \alpha \approx 9.5 \times 10^{-6}\text{ K}^{-1} α ≈ 9.5 × 1 0 − 6 K − 1 . Chemically inert, resistant to ordinary corrosion, subject to material and handling limitations, non-magnetic, and resistant to scratch burrs. Thermal expansion closely matches structural alloy steels.

The Science of Wringing

Wringing is the phenomenon where two ultra-flat surfaces adhere strongly when brought into sliding contact. The bond is established through a combination of molecular van der Waals forces , atmospheric pressure, and surface tension from a microscopic interstitial liquid film (~ 0.025 μ m 0.025\ \mu\text{m} 0.025 μ m or 1 μ in 1\ \mu\text{in} 1 μ in thick).

Cleaning: Degrease blocks using high-purity filtered mineral spirits or trichloroethane substitutes. Wipe dry with lint-free optical paper or clean chamois.

Stoning: Inspect faces for burrs and damage. Abrasive stoning can alter a calibrated surface and is performed only by trained personnel when specifically permitted by the manufacturer’s maintenance procedure.

Lubrication: Use the approved wringing preparation for the material and surface, leaving only the intended thin film. Do not assume every block requires an identical oil or a demonstrably monomolecular film.

Engagement: Cross the blocks perpendicularly at mid-span, apply gentle normal force (approx. 20 to 30 N 20\text{ to }30\text{ N} 20 to 30 N ), and twist the blocks into alignment until smooth, cohesive resistance is felt.

Calibration of reference grade blocks is performed via optical interferometry (using monochromatic helium-neon lasers or cadmium lamps and the fractional fringe method) or by differential mechanical comparison against primary masters using high-resolution dual-probe comparator stations.

Hand-Held Dimensional Tools

Instrument Standard Resolution Common Travel / Span Dominant Calibration Error Source

Outside Micrometer 0.01 mm 0.01\text{ mm} 0.01 mm / 0.0001 in 0.0001\text{ in} 0.0001 in 25 mm 25\text{ mm} 25 mm / 1 in 1\text{ in} 1 in increments Spindle lead-screw pitch error, anvil wear, flexure

Vernier Caliper 0.02 mm 0.02\text{ mm} 0.02 mm / 0.001 in 0.001\text{ in} 0.001 in 0 to 150 − 300 mm 0\text{ to }150-300\text{ mm} 0 to 150 − 300 mm Abbe error from jaw play, parallax reading error

Dial Caliper 0.01 mm 0.01\text{ mm} 0.01 mm / 0.001 in 0.001\text{ in} 0.001 in 0 to 150 − 300 mm 0\text{ to }150-300\text{ mm} 0 to 150 − 300 mm Rack-and-pinion dirt accumulation, gear tooth wear

Digital Caliper 0.01 mm 0.01\text{ mm} 0.01 mm / 0.0005 in 0.0005\text{ in} 0.0005 in 0 to 150 − 300 mm 0\text{ to }150-300\text{ mm} 0 to 150 − 300 mm Capacitive scale contamination, jaw misalignment

Plunger Dial Indicator 0.01 to 0.001 mm 0.01\text{ to }0.001\text{ mm} 0.01 to 0.001 mm 1 to 50 mm 1\text{ to }50\text{ mm} 1 to 50 mm Internal rack-pinion gear hysteresis, spring tension variation

Lever Test Indicator 0.002 to 0.001 mm 0.002\text{ to }0.001\text{ mm} 0.002 to 0.001 mm 0.5 to 1.0 mm 0.5\text{ to }1.0\text{ mm} 0.5 to 1.0 mm Cosine error from stylus angle, pivot friction

Micrometer Calibration Protocols

Outside micrometers incorporate a precision ground lead screw with a typical metric pitch of 0.5 mm 0.5\text{ mm} 0.5 mm or an inch pitch of 0.025 in 0.025\text{ in} 0.025 in (40 threads per inch); these pitches are not equal. The following are illustrative micrometer checks; test points, force, flatness limits, and accessories follow the model and applicable method:

Spindle and Anvil Flatness: Evaluated using an optical flat under monochromatic light (helium λ = 587.6 nm \lambda = 587.6\text{ nm} λ = 587.6 nm , where each dark fringe represents λ / 2 ≈ 0.3 μ m \lambda / 2 \approx 0.3\ \mu\text{m} λ /2 ≈ 0.3 μ m of elevation departure). Acceptable working tolerance is typically ≤ 2 \le 2 ≤ 2 fringes ( 0.6 μ m 0.6\ \mu\text{m} 0.6 μ m ).

Anvil Parallelism: Evaluated using a set of four optical parallel blocks whose thicknesses vary by one-quarter turn of the spindle ( 0.125 mm 0.125\text{ mm} 0.125 mm steps), ensuring parallelism is verified at four distinct radial orientations.

Scale Linearity: Calibrated using Grade 0 gage blocks selected at non-repeating spindle fractions (e.g., 2.5 , 5.1 , 7.7 , 10.3 , 12.9 , 15.0 , 17.6 , 20.2 , 22.8 , 25.0 mm 2.5, 5.1, 7.7, 10.3, 12.9, 15.0, 17.6, 20.2, 22.8, 25.0\text{ mm} 2.5 , 5.1 , 7.7 , 10.3 , 12.9 , 15.0 , 17.6 , 20.2 , 22.8 , 25.0 mm ) to expose progressive pitch error and periodic screw drunken-thread errors.

Ratchet Stop Force: The ratchet stop or friction thimble must deliver the repeatable measuring force specified for that model and procedure.

Electromechanical and Optical Transducers

Linear variable differential transformers (LVDTs): An excited primary and opposed secondary coils detect movable-core displacement. Near the designed null, the ideal secondary difference is zero; real devices can have residual output. The response is approximately linear over a specified range. A contactless core can reduce friction, but practical resolution is limited by noise, electronics, mechanics, and the setup, rather than being infinite.

Optical Comparators: Project a magnified, telecentric shadow profile or surface image onto a ground-glass screen equipped with crosshairs and protractor graduations ( 360 ∘ 360^\circ 36 0 ∘ ). Profile illumination uses transmitted light behind the part; surface illumination uses incident light for surface features. Calibration verifies lens magnification accuracy ( 10 × , 20 × , 50 × , 100 × 10\times, 20\times, 50\times, 100\times 10 × , 20 × , 50 × , 100 × ) using precision etched glass grid scales or chrome tooling balls, checking distortion across the full screen field of view.