Interpreting IM&TE Specification Terms

ASQ Certified Calibration Technician CCT

Track your progress as you read

Finished sections get a check mark.

1 SI Definitions and Realizations

The Seven SI Base Units and the 2019 Revision Realizing SI Units in the Laboratory

2 Derived Units, Prefixes, and Constants

Derived Units and Physical Calculations SI Prefixes and Compound-Unit Conversions Physical Constants and Their Applications

3 Measurement Standards and Selection

Types and Roles of Measurement Standards Selecting Standards for an Operational Hierarchy

4 Traceability and Standard Substitution

Traceability Evidence and Impact Review Evaluating and Authorizing Standard Substitution

5 Dimensional and Mechanical Metrology

Linear Displacement and Dimensional Instruments Geometry, Thermal Expansion, and Mass Force, Torque, Pressure, Density, and Viscosity

6 Temperature, Humidity, Volume, and Flow

Temperature Sensors and Thermometer Corrections Humidity, Volume, and Flow

7 Electrical, Optical, and Time Measurements

Voltage, Current, Resistance, and AC Measurement Time, Frequency, Light, Power, and Energy

8 Measurement Methods

Direct, Indirect, and Ratio Methods Transfer, Differential, and UUT Substitution Methods

9 Instrument Characteristics and Measurement Data

Sensitivity, Variability, and Precision Bias, Linearity, Stability, and Hysteresis Data Formats, Readability, and Suitability Resolution, Confidentiality, and Data Integrity

10 Specifications and Error Sources

Interpreting IM&TE Specification Terms Specification Calculations and Operating Qualifiers Instrument, Operator, and Circuit Errors Environmental, Geometric, and Interference Errors

11 Measurement Assurance

Check Standards and Statistical Process Control Proficiency Comparisons and Gage R&R

12 Procedures and Governing Requirements

Procedure Structure and Published Practice Sources Method Development, Deviations, and Handling Regulations, Contracts, and Requirement Precedence

13 Instrument Adjustment and Standardization

Calibration, Zero, and Span Adjustment Linearization, Nulling, and Digital Adjustment

14 Calibration Environment

Temperature and Humidity Control ESD, Dust, Vibration, and Pressure

15 Operations, Roles, and Scheduling

Receiving, As-Found Testing, and Calibration Flow Asset Identification, Tracking, and Release Laboratory Roles and Initial Scheduling Interval Review, Overdue Control, and Workloads

16 Method and Software Validation

Method Verification and Validation Studies Software, Firmware, and Spreadsheet Validation

17 Records and Formal Reporting

Controlled Records and Calibration Certificates Status Labels and Out-of-Tolerance Reporting

18 Uncertainty Concepts and Decision Risk

Error, Uncertainty, and Measurand Definition TAR, TUR, Tolerance Consumption, and Capability Conformity Decisions and False-Accept Risk Guard Bands and Conformity Reporting

19 Uncertainty Models and Budgets

Measurement Models and Uncertainty Contributions Distribution Selection and Budget Assembly

20 Type A and Type B Evaluation

Type A Statistics and Repeatability Outlier Review and Worked Type A Analysis Type B Distribution Models

21 Uncertainty Reporting and Applied Mathematics

Propagation, Covariance, and Effective Degrees of Freedom Coverage Factors and Expanded-Uncertainty Reporting Notation, Unit Conversions, Ratios, and Decibels Rounding, Algebra, Graphs, and Angular Conversions

22 Quality Systems and Tools

Quality-System Components, Planning, and Improvement The Seven Basic Quality Tools

23 Audits and Corrective Action

Audit Types, Planning, and Nonconformance Control Impact Assessment, Root Cause, and Effectiveness

24 Safety, Standards, and Professional Conduct

Electrical, Pressure, Chemical, and Laboratory Hazards PPE, Safety Data Sheets, 6S, and Safe Restoration Quality Standards, GUM, and VIM Accreditation Scope and Professional Ethics

Interpreting IM&TE Specification Terms

Key Takeaways Explain This Topic AI

Percent of reading, percent of range, and counts produce different error contributions.

A full-scale bound becomes a larger relative fraction when the reading is small.

Specifications and process tolerances serve different purposes and must be compared using the complete measurement requirement.

Last updated: October 2026

Metrology Subject Focus: Calibration technicians must interpret, calculate, and apply equipment specifications to evaluate whether Inspection, Measuring, and Test Equipment (IM&TE) meets manufacturer performance limits and satisfies process tolerance requirements.

In calibration science and quality engineering, an IM&TE specification represents the formal operational boundaries within which an instrument manufacturer warrants an instrument will perform, or within which an in-house metrology system governs measurement capability. Interpreting these specifications requires understanding the underlying physical mechanisms—such as quantization limits, resistive divider thermal drift, amplifier offsets, and mechanical friction—that dictate how measurement errors scale across an instrument's dynamic range.

A rigorous understanding of specification terms enables calibration technicians to calculate the Maximum Permissible Error (MPE) for any test point, determine compliance during calibration verification, and establish whether an instrument possesses adequate accuracy to support specific manufacturing or testing tolerances.

Core Specification Formats

Instrument manufacturers describe measurement accuracy using various mathematical expressions. Each format reflects different internal physical error sources.

Percent of Full Scale (%FS)

Under a Percent of Full Scale (%FS) specification, the maximum permissible absolute error is fixed across the entire operating span of the selected range: MPE abs = ± ( % FS 100 ) × Full Scale Value \text{MPE}_{\text{abs}} = \pm \left(\frac{\%\text{FS}}{100}\right) \times \text{Full Scale Value} MPE abs ​ = ± ( 100 % FS ​ ) × Full Scale Value

Because the absolute error bound remains constant regardless of the displayed value, the relative error (error expressed as a percentage of the measured value) increases sharply as the indicated value decreases: Relative Error = MPE abs Indicated Value × 100 % = % FS × Full Scale Value Indicated Value \text{Relative Error} = \frac{\text{MPE}_{\text{abs}}}{\text{Indicated Value}} \times 100\% = \frac{\%\text{FS} \times \text{Full Scale Value}}{\text{Indicated Value}} Relative Error = Indicated Value MPE abs ​ ​ × 100% = Indicated Value % FS × Full Scale Value ​

The Low-Scale Divergence Phenomenon

Consider a pressure gauge with a full scale of 100 psi 100\text{ psi} 100 psi and an accuracy specification of ± 1 % FS \pm 1\%\text{ FS} ± 1% FS :

The absolute error bound is constant: ± ( 0.01 × 100 psi ) = ± 1.0 psi \pm (0.01 \times 100\text{ psi}) = \pm 1.0\text{ psi} ± ( 0.01 × 100 psi ) = ± 1.0 psi .

At an indicated pressure of 100 psi 100\text{ psi} 100 psi , the relative error is ± 1.0 % \pm 1.0\% ± 1.0% .

At an indicated pressure of 50 psi 50\text{ psi} 50 psi , the relative error is ± 1.0 psi 50 psi × 100 % = ± 2.0 % \frac{\pm 1.0\text{ psi}}{50\text{ psi}} \times 100\% = \pm 2.0\% 50 psi ± 1.0 psi ​ × 100% = ± 2.0% .

At an indicated pressure of 10 psi 10\text{ psi} 10 psi , the relative error escalates to ± 1.0 psi 10 psi × 100 % = ± 10.0 % \frac{\pm 1.0\text{ psi}}{10\text{ psi}} \times 100\% = \pm 10.0\% 10 psi ± 1.0 psi ​ × 100% = ± 10.0% .

At an indicated pressure of 2 psi 2\text{ psi} 2 psi , the relative error reaches ± 1.0 psi 2 psi × 100 % = ± 50.0 % \frac{\pm 1.0\text{ psi}}{2\text{ psi}} \times 100\% = \pm 50.0\% 2 psi ± 1.0 psi ​ × 100% = ± 50.0% .

Evaluate the actual absolute bound at the selected reading and range. A low reading is not automatically invalid: fixed range, floor, and count terms may dominate, so compare their combined effect with the application requirement. Use the valid range giving adequate resolution and uncertainty without exceeding ratings.

Percent of Range (% of Range)

Interpret percent of range using the manufacturer’s definition. Some specifications use span (URL minus LRL); others use a selected nominal range magnitude. The following span equations and examples assume that the datasheet explicitly defines range as span. Do not apply that convention blindly to a bipolar or suppressed scale. Range Span = URL − LRL \text{Range Span} = \text{URL} - \text{LRL} Range Span = URL − LRL MPE abs = ± ( % Range 100 ) × ( URL − LRL ) \text{MPE}_{\text{abs}} = \pm \left(\frac{\%\text{Range}}{100}\right) \times (\text{URL} - \text{LRL}) MPE abs ​ = ± ( 100 % Range ​ ) × ( URL − LRL )

For an instrument whose scale begins at zero ( 0 to 100 V 0\text{ to }100\text{ V} 0 to 100 V ), range and full scale are numerically identical. However, for bipolar , compound , or suppressed scales, the distinction is significant:

Compound Pressure Gauge ( − 14.7 psig to + 60.0 psig -14.7\text{ psig to }+60.0\text{ psig} − 14.7 psig to + 60.0 psig ): The full scale might be stated as 60 psig 60\text{ psig} 60 psig , but the range span is 60.0 − ( − 14.7 ) = 74.7 psi 60.0 - (-14.7) = 74.7\text{ psi} 60.0 − ( − 14.7 ) = 74.7 psi .

Environmental Chamber Sensor ( − 50.0 ∘ C to + 150.0 ∘ C -50.0^\circ\text{C to }+150.0^\circ\text{C} − 50. 0 ∘ C to + 150. 0 ∘ C ): The range span is 150.0 − ( − 50.0 ) = 200.0 ∘ C 150.0 - (-50.0) = 200.0^\circ\text{C} 150.0 − ( − 50.0 ) = 200. 0 ∘ C . A ± 0.2 % of range \pm 0.2\%\text{ of range} ± 0.2% of range specification yields MPE abs = ± ( 0.002 × 200.0 ∘ C ) = ± 0.4 ∘ C \text{MPE}_{\text{abs}} = \pm (0.002 \times 200.0^\circ\text{C}) = \pm 0.4^\circ\text{C} MPE abs ​ = ± ( 0.002 × 200. 0 ∘ C ) = ± 0. 4 ∘ C across the entire thermal span.

Percent of Reading (%rdg or % of Indicated Value)

A Percent of Reading specification states that the permissible error scales directly with the magnitude of the measured quantity: MPE abs = ± ( % rdg 100 ) × ∣ Indicated Value ∣ \text{MPE}_{\text{abs}} = \pm \left(\frac{\%\text{rdg}}{100}\right) \times |\text{Indicated Value}| MPE abs ​ = ± ( 100 % rdg ​ ) × ∣ Indicated Value ∣

Under this format, the relative error remains constant across the entire operating range, while the absolute error contracts proportionally as the indicated value decreases. This characteristic is typical of high-end electronic standards, ratio transformers, and optical encoders where error mechanisms are dominated by amplifier gain stability and resistive divider ratios rather than fixed noise floors.

Number of Counts and Least Significant Digits (LSD)

Digital multimeters (DMMs), frequency counters, and digital indicators include a quantization floor term expressed as a number of counts or digits of the least significant digit (LSD) . This term accounts for:

Analog-to-digital converter (ADC) quantization uncertainty ( ± 0.5 count \pm 0.5\text{ count} ± 0.5 count rounding).

Internal comparator noise and digital jitter.

Input amplifier baseline DC offset voltage.

The absolute value of the count specification depends directly on the display resolution of the active range: MPE counts = ± ( Number of Counts ) × ( Scale Resolution ) \text{MPE}_{\text{counts}} = \pm (\text{Number of Counts}) \times (\text{Scale Resolution}) MPE counts ​ = ± ( Number of Counts ) × ( Scale Resolution )

For example, if a hypothetical DMM on its 10.00000 V 10.00000\text{ V} 10.00000 V range has a resolution of 0.00001 V 0.00001\text{ V} 0.00001 V ( 10 μ V 10\ \mu\text{V} 10 μ V ), an accuracy component specified as ± 3 counts \pm 3\text{ counts} ± 3 counts represents an absolute error floor of: ± ( 3 × 10 μ V ) = ± 30 μ V \pm (3 \times 10\ \mu\text{V}) = \pm 30\ \mu\text{V} ± ( 3 × 10 μ V ) = ± 30 μ V

If the technician switches the DMM to the 100.0000 V 100.0000\text{ V} 100.0000 V range (where resolution is 0.0001 V = 100 μ V 0.0001\text{ V} = 100\ \mu\text{V} 0.0001 V = 100 μ V ), those same ± 3 counts \pm 3\text{ counts} ± 3 counts now represent ± 300 μ V \pm 300\ \mu\text{V} ± 300 μ V .

Floor Terms and Combined Specifications

Precision electronic IM&TE specifications rarely consist of a single term. They combine a proportional term (tracking input magnitude) with a fixed floor term (accounting for residual noise, thermal EMFs, and leakage): MPE abs = ± ( % rdg term + Floor term ) \text{MPE}_{\text{abs}} = \pm (\%\text{rdg} \text{ term} + \text{Floor term}) MPE abs ​ = ± ( % rdg term + Floor term )

Common combinations include:

± ( % of reading + % of range ) \pm (\%\text{ of reading} + \%\text{ of range}) ± ( % of reading + % of range )

± ( % of reading + % of full scale ) \pm (\%\text{ of reading} + \%\text{ of full scale}) ± ( % of reading + % of full scale )

± ( % of reading + number of counts ) \pm (\%\text{ of reading} + \text{number of counts}) ± ( % of reading + number of counts )

± ( ppm of reading + ppm of range ) \pm (\text{ppm of reading} + \text{ppm of range}) ± ( ppm of reading + ppm of range ) , where 1 ppm = 0.0001 % = 1 × 10 − 6 1\text{ ppm} = 0.0001\% = 1 \times 10^{-6} 1 ppm = 0.0001% = 1 × 1 0 − 6 .

Applying an output specification

A sourcing instrument and a measuring instrument can use similar specification formats but describe different operations. A source’s bound applies to the quantity delivered at its specified terminals and load. A meter’s bound applies to its indication under the specified input and settings. Verify whether the denominator is the source setting, displayed reading, selected range, or fixed nominal span. The same numeric ppm value can therefore produce different absolute bounds.

For a hypothetical source setting of 2 V on a 10 V range, a 20 ppm setting term contributes 40 microvolts. A 5 ppm range term contributes another 50 microvolts. Their specified total bound is 90 microvolts before any other applicable terms. Changing to a higher range can increase the floor without changing the setting term. Also check load current, lead drop, remote-sense configuration, settling time, and compliance limits. A source that cannot sustain its specified output into the actual load cannot be judged suitable from the unloaded accuracy table alone.