Study guide
1.3 Measurement Systems & Unit Conversions
ASQ Certified Quality Inspector CQI
Track your progress as you read
Finished sections get a check mark.
1 Chapter 1: Shop Mathematics & Algebra
1.1 Basic Shop Math & Precision Measurement 1.2 Basic Algebra & Technical Formulas 1.3 Measurement Systems & Unit Conversions
2 Chapter 2: Geometry & Applied Shop Trigonometry
2.1 Applied Shop Geometry 2.2 Right-Triangle Trigonometry 2.3 Shop Trigonometry Applications & Sine Bars
3 Chapter 3: Handheld Variable & Attribute Gages
3.1 Variable Hand Measuring Instruments 3.2 Fixed Attribute & Limit Gages 3.3 Transfer Gages & Precision Accessories 3.4 Special Gages: Electronic, Pneumatic, Force & Environmental Instrumentation
4 Chapter 4: Surface Plate Inspection, Optical Systems & CMMs
4.1 Gage Selection, Care & Environmental Control 4.2 Surface Plate Tools & Layout Inspection 4.3 Optical Comparators & Vision Systems 4.4 Coordinate Measuring Machines (CMM) & 3-2-1 Alignment 4.5 Gage Correlation & Cross-Instrument Agreement
5 Chapter 5: Surface Metrology, Calibration Systems & MSA
5.1 Surface Texture & Finish Measurement 5.2 Calibration Systems & NIST Traceability 5.3 Measurement System Analysis (MSA) & Gage R&R 5.4 Measuring Mass, Form & Profile, and Inclination
6 Chapter 6: Technical Drawing & Blueprint Reading
6.1 Engineering Drawing Structure & Conventions 6.2 Views, Sectioning & Feature Representation 6.3 Dimensions, Tolerancing & Fit Classifications
7 Chapter 7: Geometric Dimensioning & Tolerancing (GD&T)
7.1 GD&T Fundamentals & Datum Reference Frames 7.2 Material Condition Modifiers & Bonus Tolerance 7.3 Form & Orientation Tolerances 7.4 Location, Profile & Runout Tolerances
8 Chapter 8: Sampling Inspection & Acceptance Sampling Plans
8.1 Sampling Fundamentals & Operating Characteristic (OC) Curves 8.2 Attribute Sampling with ANSI/ASQ Z1.4 8.3 Variables Sampling with ANSI/ASQ Z1.9
9 Chapter 9: Inspection Planning, Processes & Material Disposition
9.1 Inspection Planning, Receiving & In-Process Inspection 9.2 First Article Inspection (FAI) & Documentation 9.3 Nonconforming Material Control & MRB 9.4 Inspection Errors & Human Factors 9.5 Product Traceability, Age Control & Shelf Life
10 Chapter 10: Materials Testing & Nondestructive Examination
10.1 Mechanical & Destructive Testing 10.2 Surface & Subsurface NDE Methods 10.3 Volumetric & Electromagnetic NDE Methods 10.4 Functionality, Force & Elastomer Hardness Testing 10.5 Software for Test Equipment & Software Validation
11 Chapter 11: Statistical Process Control & Process Capability
11.1 Statistics Fundamentals & Normal Distribution 11.2 Control Charts for Variables 11.3 Control Charts for Attributes & Run Rules 11.4 Process Capability & Performance Analysis
12 Chapter 12: Quality Systems, Continuous Improvement & Safety
12.1 The 7 Classic Quality Control Tools 12.2 Continuous Improvement & Problem-Solving Methodologies 12.3 Quality Management Systems, Audits & CAPA 12.4 Workplace Safety, Environmental Controls & PPE 12.5 Failure Mode and Effects Analysis (FMEA) & Fault Tree Analysis (FTA)
13 Chapter 13: Quality Fundamentals, Teams & Documentation Systems
13.1 Quality Improvement Concepts, Products & Processes 13.2 Audit Tools, Tracing Techniques & Audit Communication 13.3 Employees as Resources: Empowerment, Team Roles & Team Development 13.4 Quality Documentation, Reference Standards & Document Control
1.3 Measurement Systems & Unit Conversions
Key Takeaways Explain This Topic AI
By international agreement (1959), 1 inch equals exactly 25.4 millimeters; this is an exact legal definition and must never be rounded to 25 mm in precision metrology.
The SI metric system is coherent and decimal-based, using base units (meter, kilogram, second) and derived units such as Newtons (force) and Pascals (stress).
The international standard reference temperature for dimensional inspection is 20°C (68°F) per ISO 1; deviations from this temperature cause linear thermal expansion error according to ΔL = L₀ · α · ΔT.
In angular metrology, one degree equals 60 minutes of arc (60') and 3600 seconds of arc (3600''); 1 minute of arc converts to approximately 0.01667 decimal degrees.
One micrometer (micron, μm) is equivalent to 0.001 mm or approximately 39.37 microinches (μin), providing the standard bridge between metric and customary surface finish specifications.
Last updated: September 2026
- 1.3 Measurement Systems & Unit Conversions
- US Customary and SI Metric Systems in Modern Quality Inspection
Global supply chains require quality inspectors to work fluently across two predominant measurement systems:
US Customary System (Inch-Pound) : Historically derived from British Imperial measures, commonly used in North American aerospace, commercial manufacturing, and civil infrastructure. Primary dimensional units include the inch (in), foot (ft), and mil / thou (0.001 in).
International System of Units (SI Metric) : A coherent, decimal-based system established by the General Conference on Weights and Measures (CGPM) and governed globally by the BIPM ( Bureau International des Poids et Mesures ).
Base Units and Derived Metrology Units
The SI system is built upon seven fundamental base units. For the CQI body of knowledge, four are directly applicable:
- Length : Meter (m)
- Mass : Kilogram (kg)
- Time : Second (s)
- Thermodynamic Temperature : Kelvin (K)
Derived units are formed by algebraic combinations of base units:
Force : Newton (N), where 1 N = 1 kg ⋅ m/s 2 1\text{ N} = 1\text{ kg}\cdot\text{m/s}^2 1 N = 1 kg ⋅ m/s 2 . Used in pull testing, crimp tensile verification, and hardness test indenter loading.
Pressure / Stress : Pascal (Pa), where 1 Pa = 1 N/m 2 1\text{ Pa} = 1\text{ N/m}^2 1 Pa = 1 N/m 2 . In materials testing, tensile and yield strengths are typically reported in Megapascals ( 1 MPa = 10 6 Pa = 1 N/mm 2 1\text{ MPa} = 10^6\text{ Pa} = 1\text{ N/mm}^2 1 MPa = 1 0 6 Pa = 1 N/mm 2 ) or kilopounds per square inch (ksi).
Energy / Work : Joule (J), where 1 J = 1 N ⋅ m 1\text{ J} = 1\text{ N}\cdot\text{m} 1 J = 1 N ⋅ m . Used in Charpy and Izod impact toughness testing.
Standard Metric Prefixes in Quality Control
Metric prefixes scale units by powers of ten, eliminating awkward numbers of trailing or leading zeros:
- Prefix Symbol Multiplication Factor Scientific Notation Common Metrology Application
- giga G 1,000,000,000 10^9 Modulus of elasticity (GPa)
- mega M 1,000,000 10^6 Material tensile strength (MPa)
- kilo k 1,000 10^3 Test load / mass (kN, kg)
- centi c 0.01 10^-2 Visual layout scales (cm)
- milli m 0.001 10^-3 Drawing dimensions, caliper resolution (mm)
- micro μ 0.000001 10^-6 Surface roughness (Ra in μm), coating thickness
- nano n 0.000000001 10^-9 Optical interferometry, semiconductor metrology (nm)
- Exact Conversion Factors and Dimensional Conversions
Converting between customary and metric units requires exact mathematical factors to maintain gage calibration integrity.
The Exact Inch-to-Millimeter Standard
On July 1, 1959, the international standards organizations of the United States, United Kingdom, Canada, Australia, New Zealand, and South Africa adopted the International Yard and Pound Agreement , defining: 1 inch ≡ 25.4 millimeters (exactly) 1\text{ inch} \equiv 25.4\text{ millimeters (exactly)} 1 inch ≡ 25.4 millimeters (exactly)
Because this definition is exact by treaty, 25.4 25.4 25.4 has an infinite number of significant digits ( 25.4000 … 25.4000\dots 25.4000 … ).
From this exact definition: 1 mm = 1 25.4 in ≈ 0.0393700787 … in ≈ 0.039370 in 1\text{ mm} = \frac{1}{25.4}\text{ in} \approx 0.0393700787\dots\text{ in} \approx 0.039370\text{ in} 1 mm = 25.4 1 in ≈ 0.0393700787 … in ≈ 0.039370 in
Microinch to Micrometer (Micron) Conversions
Surface texture callouts on American prints often specify roughness in microinches (μin), while ISO drawings specify micrometers (μm): 1 inch = 10 6 μ in = 25.4 mm = 25 , 400 μ m 1\text{ inch} = 10^6\mu\text{in} = 25.4\text{ mm} = 25,400\mu\text{m} 1 inch = 1 0 6 μ in = 25.4 mm = 25 , 400 μ m
Dividing both sides: 1 μ in = 0.0254 μ m (exactly) 1\mu\text{in} = 0.0254\mu\text{m (exactly)} 1 μ in = 0.0254 μ m (exactly) 1 μ m = 1 0.0254 μ in ≈ 39.3701 μ in ≈ 40 μ in (rule of thumb) 1\mu\text{m} = \frac{1}{0.0254}\mu\text{in} \approx 39.3701\mu\text{in} \approx 40\mu\text{in (rule of thumb)} 1 μ m = 0.0254 1 μ in ≈ 39.3701 μ in ≈ 40 μ in (rule of thumb)
Shop Example : A blueprint calls for a ground seal surface with R a ≤ 16 μ in R_a \le 16\mu\text{in} R a ≤ 16 μ in . The shop profilometer reads in micrometers (μm). Target R a = 16 μ in × 0.0254 μ m / μ in = 0.4064 μ m ≈ 0.40 μ m \text{Target } R_a = 16\mu\text{in} \times 0.0254\mu\text{m}/\mu\text{in} = 0.4064\mu\text{m} \approx 0.40\mu\text{m} Target R a = 16 μ in × 0.0254 μ m / μ in = 0.4064 μ m ≈ 0.40 μ m
Dual Dimensioning and Conversion Procedures
When converting fractional or decimal drawing callouts:
Fractional Inch to Millimeter :
Convert fraction to decimal inch first, then multiply by 25.4: 7 16 in = 0.4375 in ⟹ 0.4375 × 25.4 = 11.1125 mm \frac{7}{16}\text{ in} = 0.4375\text{ in} \implies 0.4375 \times 25.4 = 11.1125\text{ mm} 16 7 in = 0.4375 in ⟹ 0.4375 × 25.4 = 11.1125 mm
Tolerance Conversion Rule :
Always convert the tolerance with at least the same degree of relative precision as the original specification.
If a tolerance is + / − 0.001 in +/- 0.001\text{ in} + / − 0.001 in : 0.001 × 25.4 = ± 0.0254 mm 0.001 \times 25.4 = \pm 0.0254\text{ mm} 0.001 × 25.4 = ± 0.0254 mm (rounded to + / − 0.025 mm +/- 0.025\text{ mm} + / − 0.025 mm ).
If a tolerance is + / − 0.0001 in +/- 0.0001\text{ in} + / − 0.0001 in ("one tenth"): 0.0001 × 25.4 = ± 0.00254 mm 0.0001 \times 25.4 = \pm 0.00254\text{ mm} 0.0001 × 25.4 = ± 0.00254 mm ( + / − 2.54 μ m +/- 2.54\mu\text{m} + / − 2.54 μ m ).
- Measurement Property US Customary Unit Metric (SI) Unit Exact / Conversion Factor
- Linear Dimension inch (in) millimeter (mm) 1 in = 25.4 mm (exact)
- Fine Clearance / Tolerance mil / thou (0.001 in) micrometer (μm) 1 mil = 25.4 μm (exact)
- Surface Roughness microinch (μin) micrometer (μm) 1 μin = 0.0254 μm (exact)
- Force pound-force (lbf) Newton (N) 1 lbf ≈ 4.44822 N
- Pressure / Stress psi / ksi MPa 1 ksi ≈ 6.89476 MPa
- Mass pound (lb) kilogram (kg) 1 lb = 0.45359237 kg (exact)
- Temperature Scales and Thermal Expansion Metrology
Temperature is the single most pervasive environmental source of error in precision dimensional measurement.
Temperature Scale Conversions
Quality laboratories and shop floors monitor ambient conditions in degrees Fahrenheit (°F) or degrees Celsius (°C): T ∘ F = ( 9 5 × T ∘ C ) + 32 = ( 1.8 × T ∘ C ) + 32 T_{^\circ\text{F}} = \left(\frac{9}{5} \times T_{^\circ\text{C}}\right) + 32 = (1.8 \times T_{^\circ\text{C}}) + 32 T ∘ F = ( 5 9 × T ∘ C ) + 32 = ( 1.8 × T ∘ C ) + 32 T ∘ C = 5 9 × ( T ∘ F − 32 ) = T ∘ F − 32 1.8 T_{^\circ\text{C}} = \frac{5}{9} \times (T_{^\circ\text{F}} - 32) = \frac{T_{^\circ\text{F}} - 32}{1.8} T ∘ C = 9 5 × ( T ∘ F − 32 ) = 1.8 T ∘ F − 32
Key Checkpoint : At what temperature do the scales read the same value? Setting F = C F = C F = C yields − 40 ∘ F = − 40 ∘ C -40^\circ\text{F} = -40^\circ\text{C} − 4 0 ∘ F = − 4 0 ∘ C .
Standard Reference Temperature: 20°C (68°F)
Under ISO 1 and ASME B89.6.2 , the international standard reference temperature for industrial length measurements is 20 ∘ C 20^\circ\text{C} 2 0 ∘ C ( 68 ∘ F 68^\circ\text{F} 6 8 ∘ F ) .
All drawing dimensions, tolerances, and calibration certificates apply strictly at 20 ∘ C 20^\circ\text{C} 2 0 ∘ C . When parts or measuring instruments deviate from this temperature, they expand or contract according to their material composition.
Linear Thermal Expansion Formula
The thermal growth or shrinkage of a dimension is calculated as: Δ L = L 0 ⋅ α ⋅ Δ T \Delta L = L_0 \cdot \alpha \cdot \Delta T Δ L = L 0 ⋅ α ⋅ Δ T
where:
- Δ L \Delta L Δ L = Change in length (same units as L 0 L_0 L 0 )
- L 0 L_0 L 0 = Nominal length at standard reference temperature
α \alpha α = Coefficient of Thermal Expansion (CTE), expressed in in/in/ ∘ F \text{in/in/}^\circ\text{F} in/in/ ∘ F or mm/mm/ ∘ C \text{mm/mm/}^\circ\text{C} mm/mm/ ∘ C
Δ T = T actual − T reference \Delta T = T_{\text{actual}} - T_{\text{reference}} Δ T = T actual − T reference (where T ref = 68 ∘ F T_{\text{ref}} = 68^\circ\text{F} T ref = 6 8 ∘ F or 20 ∘ C 20^\circ\text{C} 2 0 ∘ C )
Typical Coefficients of Thermal Expansion (CTE)
- Material CTE (α) in Metric (x 10^-6 / °C) CTE (α) in Customary (x 10^-6 / °F)
- Plain Carbon / Tool Steel 11.5 x 10^-6 6.4 x 10^-6
- Stainless Steel (304 Austenitic) 17.3 x 10^-6 9.6 x 10^-6
- Aluminum Alloys (6061) 23.0 x 10^-6 12.8 x 10^-6
- Brass / Bronze Alloys 18.5 x 10^-6 10.3 x 10^-6
- Granite (Surface Plate) 6.0 x 10^-6 3.3 x 10^-6
- Tungsten Carbide 5.0 x 10^-6 2.8 x 10^-6
- Thermal Expansion Inspection Scenario: Differential Growth
An inspector checks a 10.0000 -inch 10.0000\text{-inch} 10.0000 -inch long 6061-aluminum housing on a shop floor where the temperature is 88 ∘ F 88^\circ\text{F} 8 8 ∘ F ( 20 ∘ F 20^\circ\text{F} 2 0 ∘ F above the 68 ∘ F 68^\circ\text{F} 6 8 ∘ F standard) using a steel gage mastered at 68 ∘ F 68^\circ\text{F} 6 8 ∘ F .
Thermal growth of the aluminum part: Δ L Al = 10.0000 × ( 12.8 × 10 − 6 ) × ( 88 − 68 ) = 10 × 0.0000128 × 20 = + 0.00256 in \Delta L_{\text{Al}} = 10.0000 \times (12.8 \times 10^{-6}) \times (88 - 68) = 10 \times 0.0000128 \times 20 = +0.00256\text{ in} Δ L Al = 10.0000 × ( 12.8 × 1 0 − 6 ) × ( 88 − 68 ) = 10 × 0.0000128 × 20 = + 0.00256 in
The aluminum part has expanded by more than two and a half thousandths of an inch simply due to ambient temperature! If the tolerance is + / − 0.001 in +/- 0.001\text{ in} + / − 0.001 in , an in-spec part will appear defective unless thermally normalized or mathematically compensated.
Angular Units: Degrees, Minutes, Seconds vs Decimal Degrees
Angular dimensions specify orientations, bevels, tapers, and feature locations on bolt circles.
Sexagesimal System (Degrees, Minutes, Seconds)
In traditional shop trigonometry and bevel protractor inspection, angles are subdivided sexagesimally (base-60):
1 full circle = 360 ∘ (degrees) 1\text{ full circle} = 360^\circ\text{ (degrees)} 1 full circle = 36 0 ∘ (degrees)
1 ∘ = 60 ′ (arcminutes or minutes) 1^\circ = 60'\text{ (arcminutes or minutes)} 1 ∘ = 6 0 ′ (arcminutes or minutes)
1 ′ = 60 ′ ′ (arcseconds or seconds) 1' = 60''\text{ (arcseconds or seconds)} 1 ′ = 6 0 ′′ (arcseconds or seconds)
Consequently, 1 ∘ = 3600 ′ ′ 1^\circ = 3600'' 1 ∘ = 360 0 ′′ .
Converting DMS to Decimal Degrees (DD) Decimal Degrees = D + ( M 60 ) + ( S 3600 ) \text{Decimal Degrees} = D + \left(\frac{M}{60}\right) + \left(\frac{S}{3600}\right) Decimal Degrees = D + ( 60 M ) + ( 3600 S )
Worked Example : An optical dividing head reads an angular index of 42 ∘ 27 ′ 36 ′ ′ 42^\circ 27' 36'' 4 2 ∘ 2 7 ′ 3 6 ′′ . DD = 42 + ( 27 60 ) + ( 36 3600 ) = 42 + 0.4500 + 0.0100 = 42.4600 ∘ \text{DD} = 42 + \left(\frac{27}{60}\right) + \left(\frac{36}{3600}\right) = 42 + 0.4500 + 0.0100 = 42.4600^\circ DD = 42 + ( 60 27 ) + ( 3600 36 ) = 42 + 0.4500 + 0.0100 = 42.460 0 ∘
Converting Decimal Degrees to DMS
To convert 35.6125 ∘ 35.6125^\circ 35.612 5 ∘ to degrees, minutes, and seconds:
Whole degrees = 35 ∘ 35^\circ 3 5 ∘ .
Multiply fractional part by 60: 0.6125 × 60 = 36.75 ′ 0.6125 \times 60 = 36.75' 0.6125 × 60 = 36.7 5 ′ (Whole minutes = 36 ′ 36' 3 6 ′ ).
Multiply remaining fractional minute by 60: 0.75 × 60 = 45 ′ ′ 0.75 \times 60 = 45'' 0.75 × 60 = 4 5 ′′ .
Result: 35 ∘ 36 ′ 45 ′ ′ 35^\circ 36' 45'' 3 5 ∘ 3 6 ′ 4 5 ′′ .
Vernier Universal Bevel Protractor
A standard toolmaker's vernier bevel protractor has a main scale graduated in whole degrees and a vernier plate graduated in 5-minute ( 5 ′ 5' 5 ′ ) increments from 0 to 60 on both sides.
Since 5 ′ = 5 60 ∘ = 1 12 ∘ ≈ 0.0833 ∘ 5' = \frac{5}{60}^\circ = \frac{1}{12}^\circ \approx 0.0833^\circ 5 ′ = 60 5 ∘ = 12 1 ∘ ≈ 0.083 3 ∘ , the tool provides direct angular resolution of one-twelfth of a degree.
Real Shop Inspection Scenarios & Common Exam Traps
Exam Trap: Approximating 1 Inch as 25 mm :
Machinists often use 25 mm 25\text{ mm} 25 mm as a rough rule of thumb, but doing so on an inspection report introduces an error of ( 25.4 − 25.0 ) / 25.4 × 100 % = 1.57 % (25.4 - 25.0) / 25.4 \times 100\% = 1.57\% ( 25.4 − 25.0 ) /25.4 × 100% = 1.57% . Over a 4-inch part, that error equals 0.063 in 0.063\text{ in} 0.063 in ( 1.6 mm 1.6\text{ mm} 1.6 mm )—vastly exceeding precision machining tolerances! Always use the exact factor 25.4 mm 25.4\text{ mm} 25.4 mm .
Exam Trap: Inverting the Temperature Order of Operations :
When converting ∘ F ^\circ\text{F} ∘ F to ∘ C ^\circ\text{C} ∘ C , the subtractive term must be calculated before multiplying by 5 / 9 5/9 5/9 : C = ( F − 32 ) × 5 / 9 C = (F - 32) \times 5/9 C = ( F − 32 ) × 5/9 . Candidates who calculate F − ( 32 × 5 / 9 ) F - (32 \times 5/9) F − ( 32 × 5/9 ) subtract 17.78 17.78 17.78 instead, creating massive errors.
Exam Trap: Arcminute as a Decimal Fraction of a Degree :
Never write 25 ∘ 30 ′ 25^\circ 30' 2 5 ∘ 3 0 ′ as 25.30 ∘ 25.30^\circ 25.3 0 ∘ ! Because there are 60 minutes in a degree, 30 ′ 30' 3 0 ′ is exactly half a degree ( 0.50 ∘ 0.50^\circ 0.5 0 ∘ ), so 25 ∘ 30 ′ = 25.50 ∘ 25^\circ 30' = 25.50^\circ 2 5 ∘ 3 0 ′ = 25.5 0 ∘ .