Study guide

Bias, Linearity, Stability, and Hysteresis

ASQ Certified Calibration Technician CCT

Track your progress as you read

Finished sections get a check mark.

1 SI Definitions and Realizations

The Seven SI Base Units and the 2019 Revision Realizing SI Units in the Laboratory

2 Derived Units, Prefixes, and Constants

Derived Units and Physical Calculations SI Prefixes and Compound-Unit Conversions Physical Constants and Their Applications

3 Measurement Standards and Selection

Types and Roles of Measurement Standards Selecting Standards for an Operational Hierarchy

4 Traceability and Standard Substitution

Traceability Evidence and Impact Review Evaluating and Authorizing Standard Substitution

5 Dimensional and Mechanical Metrology

Linear Displacement and Dimensional Instruments Geometry, Thermal Expansion, and Mass Force, Torque, Pressure, Density, and Viscosity

6 Temperature, Humidity, Volume, and Flow

Temperature Sensors and Thermometer Corrections Humidity, Volume, and Flow

7 Electrical, Optical, and Time Measurements

Voltage, Current, Resistance, and AC Measurement Time, Frequency, Light, Power, and Energy

8 Measurement Methods

Direct, Indirect, and Ratio Methods Transfer, Differential, and UUT Substitution Methods

9 Instrument Characteristics and Measurement Data

Sensitivity, Variability, and Precision Bias, Linearity, Stability, and Hysteresis Data Formats, Readability, and Suitability Resolution, Confidentiality, and Data Integrity

10 Specifications and Error Sources

Interpreting IM&TE Specification Terms Specification Calculations and Operating Qualifiers Instrument, Operator, and Circuit Errors Environmental, Geometric, and Interference Errors

11 Measurement Assurance

Check Standards and Statistical Process Control Proficiency Comparisons and Gage R&R

12 Procedures and Governing Requirements

Procedure Structure and Published Practice Sources Method Development, Deviations, and Handling Regulations, Contracts, and Requirement Precedence

13 Instrument Adjustment and Standardization

Calibration, Zero, and Span Adjustment Linearization, Nulling, and Digital Adjustment

14 Calibration Environment

Temperature and Humidity Control ESD, Dust, Vibration, and Pressure

15 Operations, Roles, and Scheduling

Receiving, As-Found Testing, and Calibration Flow Asset Identification, Tracking, and Release Laboratory Roles and Initial Scheduling Interval Review, Overdue Control, and Workloads

16 Method and Software Validation

Method Verification and Validation Studies Software, Firmware, and Spreadsheet Validation

17 Records and Formal Reporting

Controlled Records and Calibration Certificates Status Labels and Out-of-Tolerance Reporting

18 Uncertainty Concepts and Decision Risk

Error, Uncertainty, and Measurand Definition TAR, TUR, Tolerance Consumption, and Capability Conformity Decisions and False-Accept Risk Guard Bands and Conformity Reporting

19 Uncertainty Models and Budgets

Measurement Models and Uncertainty Contributions Distribution Selection and Budget Assembly

20 Type A and Type B Evaluation

Type A Statistics and Repeatability Outlier Review and Worked Type A Analysis Type B Distribution Models

21 Uncertainty Reporting and Applied Mathematics

Propagation, Covariance, and Effective Degrees of Freedom Coverage Factors and Expanded-Uncertainty Reporting Notation, Unit Conversions, Ratios, and Decibels Rounding, Algebra, Graphs, and Angular Conversions

22 Quality Systems and Tools

Quality-System Components, Planning, and Improvement The Seven Basic Quality Tools

23 Audits and Corrective Action

Audit Types, Planning, and Nonconformance Control Impact Assessment, Root Cause, and Effectiveness

24 Safety, Standards, and Professional Conduct

Electrical, Pressure, Chemical, and Laboratory Hazards PPE, Safety Data Sheets, 6S, and Safe Restoration Quality Standards, GUM, and VIM Accreditation Scope and Professional Ethics

Bias, Linearity, Stability, and Hysteresis

Key Takeaways Explain This Topic AI

Bias is an estimate of systematic measurement error and differs from random dispersion.

Endpoint and least-squares linearity use different reference lines; no universal factor of two relates their residuals.

Hysteresis depends on approach history, while drift describes change over time.

Last updated: October 2026

  • Systematic Error and Measurement Bias
  • Error Decomposition: Systematic vs. Random

Every measurement error ( E E E ) consists of two distinct components: E = x indicated − x true = E systematic + E random E = x_{\text{indicated}} - x_{\text{true}} = E_{\text{systematic}} + E_{\text{random}} E = x indicated ​ − x true ​ = E systematic ​ + E random ​

Random Error: Varies unpredictably in sign and magnitude between observations; cannot be eliminated, but can be reduced by averaging replicate measurements ( 1 / n 1/\sqrt{n} 1/ n ​ ).

Systematic Error: Remains constant or varies in a predictable manner across replicate measurements under specified conditions. Cannot be reduced by averaging replicate measurements!

Measurement Bias (VIM 2.18)

Measurement bias is the estimate of a systematic error. It is defined quantitatively as the difference between the expectation of the measurement results (the mean of an infinite series of replicate observations y ˉ \bar{y} y ˉ ​ ) and an accepted reference quantity value ( y ref y_{\text{ref}} y ref ​ ): b = y ˉ − y ref b = \bar{y} - y_{\text{ref}} b = y ˉ ​ − y ref ​

Corrected vs. Uncorrected Bias

Estimate and correct significant recognized systematic effects in the measurement model where appropriate, retaining uncertainty in those corrections. An observed error includes random effects and is not automatically an exactly known bias. Any intentionally uncorrected significant effect requires an appropriate evaluation and honest reporting; an uncertainty entry alone should not conceal a known offset. y corrected = y indicated − b = y indicated + C y_{\text{corrected}} = y_{\text{indicated}} - b = y_{\text{indicated}} + C y corrected ​ = y indicated ​ − b = y indicated ​ + C

Where C = − b C = -b C = − b is the correction .

Corrections and residual uncertainty

Apply a significant estimated systematic correction when the model requires it and include the correction’s uncertainty. A correction changes the estimate; an uncertainty describes dispersion. Do not automatically add absolute bias to expanded uncertainty or replace a known correction with a guard band. If a result is intentionally reported uncorrected, use a documented method that accounts for the uncorrected effect and explains the reporting and decision consequences.

  • Linearity and Non-Linearity Evaluation Models
  • Concept of Linearity

Linearity is the property of a measuring system where the output indication is directly proportional to the input measurand across the entire specified operating range. In reality, all transducers exhibit physical departures from ideal proportionality due to material non-linearities, magnetic saturation, or geometric linkage kinematics.

Three Standard Linearity Models

Depending on the instrument standard (e.g., ASME, IEEE, ISA), non-linearity is calculated using one of three reference lines:

Endpoint (Terminal) Linearity:

The reference line connects the calibration point at zero (0% span) directly to the calibration point at full scale (100% span) .

Maximum deviation Δ y max ⁡ \Delta y_{\max} Δ y m a x ​ is evaluated against this fixed chord.

Trait: The line is fixed by its endpoints; noise there can strongly affect the residuals. It is not universally the largest possible linearity measure.

Best-Fit Straight Line (BFSL) / Independent Linearity:

The reference line is determined by linear least-squares regression across all calibration test points, optimizing both slope and intercept to minimize the sum of squared residuals: min ⁡ ∑ i = 1 N [ y i − ( m x i + c ) ] 2 \min \sum_{i=1}^N [y_i - (m x_i + c)]^2 min i = 1 ∑ N ​ [ y i ​ − ( m x i ​ + c ) ] 2

Trait: Least squares minimizes the sum of squared residuals, not the maximum absolute residual. A minimum-zone fit is a different optimization. No universal factor relates BFSL and endpoint linearity; use the datasheet’s definition.

Zero-Based Linearity:

The reference line is constrained to pass through the calibrated zero point ( c = 0 c = 0 c = 0 ), with the slope optimized via least-squares across the remaining span.

Non-Linearity Calculation Formula

Non-linearity may be specified in engineering units, as a percentage of span or reading, or under another defined convention. Identify both the reference-line definition and denominator before comparing values. Non-Linearity (% FS) = max ⁡ ∣ y actual − y reference ∣ y span × 100 % \text{Non-Linearity (\% FS)} = \frac{\max\lvert y_{\text{actual}}-y_{\text{reference}}\rvert}{y_{\text{span}}} \times 100\% Non-Linearity (% FS) = y span ​ max ∣ y actual ​ − y reference ​ ∣ ​ × 100%

  • Stability, Drift Rates, and Aging Physics
  • Metrological Stability (VIM 4.19)

Stability is the ability of a measuring instrument to maintain its metrological properties constant over time. It is quantified not as a single number, but by characterizing its inverse: drift .

Drift (VIM 4.21)

Drift is a continuous or incremental change of an indication over time, attributable to changes in the metrological properties of the measuring system, independent of any change in the measurand or external influence quantities.

Zero Drift (Offset Drift): A parallel shift in the calibration curve where the zero intercept changes, but the slope remains constant. Caused by mechanical relaxation, thermal strain relief, or residual charge buildup.

Span Drift (Gain Drift): A rotational change in the slope of the calibration curve where sensitivity changes over time. Caused by aging of reference zener diodes, magnet demagnetization, or spring alloy fatigue.

Physics of Aging in Standards

Zener voltage standards: References can change with aging, package stress, temperature history, and other influences. A logarithmic expression can be an empirical model for a particular history, but is not a universal law for all references. Validate any prediction and include residual drift uncertainty.

Liquid-in-Glass Thermometers: Glass bulbs undergo secular contraction over decades as amorphous glass molecules slowly settle into a relaxed amorphous structure, shrinking the bulb volume and inducing a progressive positive zero drift of several tenths of a degree Celsius.

Precision Standard Resistors: Manganin or Evanohm wire wound on ceramic bobbins experiences long-term resistance drift due to surface oxidation, moisture absorption, and microscopic wire work-hardening relief.

Optimizing Calibration Intervals via Drift Modeling

Historical calibration offsets can be plotted and modeled to estimate drift. Predictions carry uncertainty and may fail after shock, repair, or changed use. Review the interval using observed stability and risk; ILAC-G24/OIML D 10 describes review methods rather than guaranteeing a future limit crossing.

  • Hysteresis, Deadband, and Threshold
  • Hysteresis (VIM 4.20)

Hysteresis is the property of a measuring system whereby the output indication for a given input stimulus depends on the sequence of preceding input values—specifically, whether the operating point was approached from an increasing direction or a decreasing direction.

Physical Causes of Hysteresis

Mechanical Friction and Backlash: Play in gear teeth (such as the rack-and-pinion movement of dial calipers and Bourdon tube linkage pivots).

Viscoelastic Creep and Internal Molecular Friction: Non-ideal elasticity in metallic Bourdon tubes, diaphragm capsules, and load cell shear webs. When deformed, crystal grain boundaries undergo minute plastic shear, requiring finite relaxation time to return.

Magnetic Domain Wall Pinning (Barkhausen Effect): In electromagnetic cores (LVDTs, current transformers), magnetic domain walls become pinned on crystal dislocations, creating the classic B-H magnetic hysteresis loop.

Calibration Protocol for Hysteresis

To detect hysteresis, calibration procedures define suitable ascending and descending runs , for example at these five test levels (e.g., 0%, 25%, 50%, 75%, 100%, 75%, 50%, 25%, 0%): H ( x ) = ∣ y descending ( x ) − y ascending ( x ) ∣ H(x) = |y_{\text{descending}}(x) - y_{\text{ascending}}(x)| H ( x ) = ∣ y descending ​ ( x ) − y ascending ​ ( x ) ∣ Maximum Hysteresis (% FS) = H max ⁡ y FS × 100 % \text{Maximum Hysteresis (\% FS)} = \frac{H_{\max}}{y_{\text{FS}}} \times 100\% Maximum Hysteresis (% FS) = y FS ​ H m a x ​ ​ × 100%

Operational Rule: Preserve the required approach direction when evaluating hysteresis. If a point is overshot, follow the method’s reset and re-approach instructions; do not silently substitute a descending observation for an ascending one.

Discrimination Threshold

The discrimination threshold describes the largest input change that still produces no detectable indication change under the stated conditions. Resolution instead concerns the smallest change producing a perceptible response. Noise, friction, input level, and how the change is applied can affect both. Distinguish this threshold from the bidirectional interval described by dead band. See VIM terminology .

Deadband

Deadband (dead zone) is the maximum interval through which an input quantity can be varied in both directions without producing a detectable change in the output indication.

Unlike hysteresis (where the output changes, but follows two separate curves), deadband represents a complete plateau of non-responsiveness , predominantly caused by mechanical clearance between intermeshing gears or software digital filtering algorithms.