Method Verification and Validation Studies

ASQ Certified Calibration Technician CCT

Track your progress as you read

Finished sections get a check mark.

1 SI Definitions and Realizations

The Seven SI Base Units and the 2019 Revision Realizing SI Units in the Laboratory

2 Derived Units, Prefixes, and Constants

Derived Units and Physical Calculations SI Prefixes and Compound-Unit Conversions Physical Constants and Their Applications

3 Measurement Standards and Selection

Types and Roles of Measurement Standards Selecting Standards for an Operational Hierarchy

4 Traceability and Standard Substitution

Traceability Evidence and Impact Review Evaluating and Authorizing Standard Substitution

5 Dimensional and Mechanical Metrology

Linear Displacement and Dimensional Instruments Geometry, Thermal Expansion, and Mass Force, Torque, Pressure, Density, and Viscosity

6 Temperature, Humidity, Volume, and Flow

Temperature Sensors and Thermometer Corrections Humidity, Volume, and Flow

7 Electrical, Optical, and Time Measurements

Voltage, Current, Resistance, and AC Measurement Time, Frequency, Light, Power, and Energy

8 Measurement Methods

Direct, Indirect, and Ratio Methods Transfer, Differential, and UUT Substitution Methods

9 Instrument Characteristics and Measurement Data

Sensitivity, Variability, and Precision Bias, Linearity, Stability, and Hysteresis Data Formats, Readability, and Suitability Resolution, Confidentiality, and Data Integrity

10 Specifications and Error Sources

Interpreting IM&TE Specification Terms Specification Calculations and Operating Qualifiers Instrument, Operator, and Circuit Errors Environmental, Geometric, and Interference Errors

11 Measurement Assurance

Check Standards and Statistical Process Control Proficiency Comparisons and Gage R&R

12 Procedures and Governing Requirements

Procedure Structure and Published Practice Sources Method Development, Deviations, and Handling Regulations, Contracts, and Requirement Precedence

13 Instrument Adjustment and Standardization

Calibration, Zero, and Span Adjustment Linearization, Nulling, and Digital Adjustment

14 Calibration Environment

Temperature and Humidity Control ESD, Dust, Vibration, and Pressure

15 Operations, Roles, and Scheduling

Receiving, As-Found Testing, and Calibration Flow Asset Identification, Tracking, and Release Laboratory Roles and Initial Scheduling Interval Review, Overdue Control, and Workloads

16 Method and Software Validation

Method Verification and Validation Studies Software, Firmware, and Spreadsheet Validation

17 Records and Formal Reporting

Controlled Records and Calibration Certificates Status Labels and Out-of-Tolerance Reporting

18 Uncertainty Concepts and Decision Risk

Error, Uncertainty, and Measurand Definition TAR, TUR, Tolerance Consumption, and Capability Conformity Decisions and False-Accept Risk Guard Bands and Conformity Reporting

19 Uncertainty Models and Budgets

Measurement Models and Uncertainty Contributions Distribution Selection and Budget Assembly

20 Type A and Type B Evaluation

Type A Statistics and Repeatability Outlier Review and Worked Type A Analysis Type B Distribution Models

21 Uncertainty Reporting and Applied Mathematics

Propagation, Covariance, and Effective Degrees of Freedom Coverage Factors and Expanded-Uncertainty Reporting Notation, Unit Conversions, Ratios, and Decibels Rounding, Algebra, Graphs, and Angular Conversions

22 Quality Systems and Tools

Quality-System Components, Planning, and Improvement The Seven Basic Quality Tools

23 Audits and Corrective Action

Audit Types, Planning, and Nonconformance Control Impact Assessment, Root Cause, and Effectiveness

24 Safety, Standards, and Professional Conduct

Electrical, Pressure, Chemical, and Laboratory Hazards PPE, Safety Data Sheets, 6S, and Safe Restoration Quality Standards, GUM, and VIM Accreditation Scope and Professional Ethics

Method Verification and Validation Studies

Key Takeaways Explain This Topic AI

Verify that the laboratory can perform a standard method before introducing it.

Validate nonstandard, modified, and laboratory-developed methods for intended use.

Select relevant precision, bias, range, robustness, or other characteristics rather than mandating every possible test.

Last updated: October 2026

In modern metrology, the validity of a measurement result depends just as heavily on the mathematical methodology and automated software execution as it does on the physical hardware standards. Under ISO/IEC 17025:2017, laboratories cannot simply assume that a published test method, automated Python script, or complex Excel spreadsheet functions correctly. Every procedure and software tool deployed to collect, calculate, or report calibration data must be formally verified or validated before being placed into routine production service.

Method Verification vs. Method Validation per ISO/IEC 17025

A central concept tested on the ASQ CCT examination is the critical operational distinction between Method Verification and Method Validation governed by ISO/IEC 17025 Clause 7.2.

Method Verification (Clause 7.2.1.5)

Method verification is the provision of objective evidence that the laboratory can properly perform a recognized, published standard method before introducing it into service. Verification applies when the laboratory adopts:

Consensus standards published by international or national standards organizations (e.g., ASTM E145 for ovens, ISO 6789 for hand torque tools, applicable electrical calibration methods (IEEE 488 is an instrument-interface standard)).

Standard calibration procedures published in original equipment manufacturer (OEM) service and calibration manuals.

Recognized metrology guides published by regional metrology organizations (such as EURAMET or SIM).

Verification Protocol: Demonstrate that the facility, personnel, equipment, and environment can achieve the method’s required performance. Reference artifacts, precision studies, uncertainty evaluation, and relevant comparisons can provide evidence. An interlaboratory comparison is not a mandatory component of every individual method verification.

Method Validation (Clause 7.2.2)

Method validation is the confirmation by examination and the provision of objective evidence that the particular requirements for a specific intended use are fulfilled. ISO/IEC 17025 requires validation to the extent necessary for intended use when the laboratory uses:

Non-standard methods developed entirely in-house.

Laboratory-designed custom test fixtures or automated procedures.

Published standard methods that have been modified (e.g., changing test points, using alternative excitation voltages, or testing at non-standard temperatures).

Standard methods applied outside their intended operational scope (e.g., using a procedure designed for laboratory ambient temperatures to calibrate sensors inside a cryogenic chamber).

Metrological Parameter Method Verification (Standard Methods) Method Validation (Custom / Modified Methods)

Core Objective Prove laboratory competence to run an established method Prove the method is scientifically sound, fit for purpose, and robust

Primary Scrutiny Lab capabilities (standards, environment, technician skill) Method capabilities (physics, algorithms, cross-sensitivities, limits)

• Linearity & Range Verify within published OEM limits Mathematically determine and prove dynamic working range
• Limit of Detection Not required unless specified in standard Evaluate when relevant to intended use

Robustness Testing Rely on tolerances defined in standard Deliberately perturb environmental/electrical inputs to test stability

Uncertainty budget Confirm the laboratory implementation and relevant uncertainty. Develop or adapt an appropriate supported model and evaluate its components; a new budget need not always start from scratch.

Selecting validation characteristics for intended use

When validating a custom or modified calibration method, the Technical Manager selects relevant performance characteristics and acceptance criteria. The following are possible characteristics, not seven universal requirements for every calibration:

Trueness and Accuracy

Demonstrate that the method provides measurement results free from uncorrected systematic bias. Trueness is verified by comparing measurement results against certified reference materials (CRMs), primary intrinsic standards, or by participating in Proficiency Testing (PT) / Interlaboratory Comparisons (ILC).

Performance is evaluated using the Normalized Error Ratio ( E n E_n E n ​ ): E n = ∣ x lab − x ref ∣ U lab 2 + U ref 2 E_n = \frac{|x_{\text{lab}} - x_{\text{ref}}|}{\sqrt{U_{\text{lab}}^2 + U_{\text{ref}}^2}} E n ​ = U lab 2 ​ + U ref 2 ​ ​ ∣ x lab ​ − x ref ​ ∣ ​

Where x lab x_{\text{lab}} x lab ​ and x ref x_{\text{ref}} x ref ​ are the laboratory's measured value and the reference value, and U lab U_{\text{lab}} U lab ​ and U ref U_{\text{ref}} U ref ​ are their respective expanded measurement uncertainties ( k = 2 k=2 k = 2 ). For a comparable, uncorrelated comparison, agreement is supported at the points tested if: E n ≤ 1.0 E_n \le 1.0 E n ​ ≤ 1.0

An absolute score above one prompts investigation of the results, uncertainty, correlation, and comparison conditions; it does not diagnose a unique cause.

Precision (Repeatability and Reproducibility)

Repeatability ( s r s_r s r ​ ): Closeness of agreement between independent test results obtained under identical conditions (same technician, same reference standard, same environmental setup, over a short time interval).

Intermediate Precision: Variation under changed conditions within a laboratory, such as operators or days. Reproducibility conditions in VIM involve different locations and measuring systems. Choose replicate counts and study design for the intended performance claim; ten to thirty observations is not a universal minimum.

Linearity and Working Range

The LOD and LOQ factors below illustrate one blank-standard-deviation/slope model with its adopted criteria. They are not universal calibration requirements or definitions for every method. Verify the model, distribution, and intended detection or quantification performance. A nonlinear method can be valid if its model and uncertainty satisfy the intended use.

Verify that the measurement response is directly proportional to the physical stimulus across the entire working span. The technician plots measured values against reference values and performs a least-squares linear regression: y = m x + b y = m x + b y = m x + b

Set application-specific criteria. A large R 2 R^2 R 2 alone does not demonstrate acceptable residual errors or uncertainty and that the residuals exhibit a random distribution without systematic curvature.

Limit of Detection (LOD) and Limit of Quantitation (LOQ)

For sensitive instrumentation (e.g., optical power meters, picoammeters, micro-balances), the laboratory may need to establish applicable detection and quantitation limits:

Limit of Detection (LOD): The lowest quantity that can be reliably distinguished from baseline electrical/mechanical noise: LOD example = 3.3 ⋅ s 0 S \text{LOD}_{\text{example}} = 3.3 \cdot \frac{s_0}{S} LOD example ​ = 3.3 ⋅ S s 0 ​ ​

Limit of Quantitation (LOQ): The lowest concentration or level that can be quantitatively measured with acceptable uncertainty: LOQ = 10 ⋅ s 0 S \text{LOQ} = 10 \cdot \frac{s_0}{S} LOQ = 10 ⋅ S s 0 ​ ​

where s 0 s_0 s 0 ​ is the standard deviation of baseline blank readings, and S S S is the slope (sensitivity) of the calibration curve.

Measurement Range and Dynamic Span

Establish the range over which the intended model, bias, precision, and uncertainty satisfy requirements. A result outside that range cannot be represented as validated routine work. Resolve any proposed extension through the appropriate verification or validation and agreed scope before making that claim.

Robustness and Ruggedness Testing

Evaluate whether performance remains adequate for intended use under small, deliberate changes. Robustness is not a promise of exactly unchanged readings. Choose safe perturbations within the applicable operating limits and examine resulting bias and uncertainty.

• Ambient temperature (e.g., 21 ∘ C 21^\circ\text{C} 2 1 ∘ C vs 25 ∘ C 25^\circ\text{C} 2 5 ∘ C )
• Relative humidity (e.g., 30 % 30\% 30% vs 65 % 65\% 65% )
• AC mains supply voltage (e.g., 110 V 110\text{ V} 110 V vs 125 V 125\text{ V} 125 V )
• Test lead cable length (e.g., 1 m 1\text{ m} 1 m vs 2 m 2\text{ m} 2 m )

If these variations induce statistically significant shifts in results, the method must define strict operational tolerance limits.

Selectivity and Cross-Sensitivity

Verify that the method measures only the intended measurand without confounding interference from secondary physical influences. Examples include evaluating magnetic field interference on current clamps, thermal EMF interference on microvolt measurements, or barometric pressure sensitivity on quartz balances.