Study guide
Proficiency Comparisons and Gage R&R
ASQ Certified Calibration Technician CCT
Track your progress as you read
Finished sections get a check mark.
1 SI Definitions and Realizations
The Seven SI Base Units and the 2019 Revision Realizing SI Units in the Laboratory
2 Derived Units, Prefixes, and Constants
Derived Units and Physical Calculations SI Prefixes and Compound-Unit Conversions Physical Constants and Their Applications
3 Measurement Standards and Selection
Types and Roles of Measurement Standards Selecting Standards for an Operational Hierarchy
4 Traceability and Standard Substitution
Traceability Evidence and Impact Review Evaluating and Authorizing Standard Substitution
5 Dimensional and Mechanical Metrology
Linear Displacement and Dimensional Instruments Geometry, Thermal Expansion, and Mass Force, Torque, Pressure, Density, and Viscosity
6 Temperature, Humidity, Volume, and Flow
Temperature Sensors and Thermometer Corrections Humidity, Volume, and Flow
7 Electrical, Optical, and Time Measurements
Voltage, Current, Resistance, and AC Measurement Time, Frequency, Light, Power, and Energy
8 Measurement Methods
Direct, Indirect, and Ratio Methods Transfer, Differential, and UUT Substitution Methods
9 Instrument Characteristics and Measurement Data
Sensitivity, Variability, and Precision Bias, Linearity, Stability, and Hysteresis Data Formats, Readability, and Suitability Resolution, Confidentiality, and Data Integrity
10 Specifications and Error Sources
Interpreting IM&TE Specification Terms Specification Calculations and Operating Qualifiers Instrument, Operator, and Circuit Errors Environmental, Geometric, and Interference Errors
11 Measurement Assurance
Check Standards and Statistical Process Control Proficiency Comparisons and Gage R&R
12 Procedures and Governing Requirements
Procedure Structure and Published Practice Sources Method Development, Deviations, and Handling Regulations, Contracts, and Requirement Precedence
13 Instrument Adjustment and Standardization
Calibration, Zero, and Span Adjustment Linearization, Nulling, and Digital Adjustment
14 Calibration Environment
Temperature and Humidity Control ESD, Dust, Vibration, and Pressure
15 Operations, Roles, and Scheduling
Receiving, As-Found Testing, and Calibration Flow Asset Identification, Tracking, and Release Laboratory Roles and Initial Scheduling Interval Review, Overdue Control, and Workloads
16 Method and Software Validation
Method Verification and Validation Studies Software, Firmware, and Spreadsheet Validation
17 Records and Formal Reporting
Controlled Records and Calibration Certificates Status Labels and Out-of-Tolerance Reporting
18 Uncertainty Concepts and Decision Risk
Error, Uncertainty, and Measurand Definition TAR, TUR, Tolerance Consumption, and Capability Conformity Decisions and False-Accept Risk Guard Bands and Conformity Reporting
19 Uncertainty Models and Budgets
Measurement Models and Uncertainty Contributions Distribution Selection and Budget Assembly
20 Type A and Type B Evaluation
Type A Statistics and Repeatability Outlier Review and Worked Type A Analysis Type B Distribution Models
21 Uncertainty Reporting and Applied Mathematics
Propagation, Covariance, and Effective Degrees of Freedom Coverage Factors and Expanded-Uncertainty Reporting Notation, Unit Conversions, Ratios, and Decibels Rounding, Algebra, Graphs, and Angular Conversions
22 Quality Systems and Tools
Quality-System Components, Planning, and Improvement The Seven Basic Quality Tools
23 Audits and Corrective Action
Audit Types, Planning, and Nonconformance Control Impact Assessment, Root Cause, and Effectiveness
24 Safety, Standards, and Professional Conduct
Electrical, Pressure, Chemical, and Laboratory Hazards PPE, Safety Data Sheets, 6S, and Safe Restoration Quality Standards, GUM, and VIM Accreditation Scope and Professional Ethics
Proficiency Comparisons and Gage R&R
Key Takeaways Explain This Topic AI
Normalized error compares a result difference with uncertainties under the stated correlation and coverage assumptions.
A satisfactory comparison score is evidence for that comparison, not automatic validation of every laboratory capability.
Gage R&R acceptance bands and distinct-category goals must be interpreted for the study and intended use.
Last updated: October 2026
Interlaboratory Comparisons (ILC) and Proficiency Testing (PT)
ISO/IEC 17025 clause 7.7.2 calls for comparison with other laboratories when available and appropriate, through proficiency testing and/or interlaboratory comparisons. Select suitable activities and interpret the results with their scope and uncertainty; one successful comparison does not validate every CMC or method.
In a typical PT scheme, a stable artifact (the transfer standard) is circulated among participating laboratories. Each laboratory measures the artifact and reports its measured value along with its expanded measurement uncertainty ( k = 2 k=2 k = 2 ).
The Normalized Error ( E n E_n E n ) Ratio
Performance is evaluated using the internationally standardized Normalized Error ( E n E_n E n ) ratio (ISO/IEC 17043): E n = x lab − x ref U lab 2 + U ref 2 E_n = \frac{x_{\text{lab}} - x_{\text{ref}}}{\sqrt{U_{\text{lab}}^2 + U_{\text{ref}}^2}} E n = U lab 2 + U ref 2 x lab − x ref
where:
x lab x_{\text{lab}} x lab = The measured value reported by the participant laboratory.
x ref x_{\text{ref}} x ref = The assigned reference value established by the organizing reference laboratory (typically an NMI or accredited primary reference provider).
U lab U_{\text{lab}} U lab = The expanded measurement uncertainty ( k = 2 k=2 k = 2 , approximately 95 % 95\% 95% confidence) declared by the participant laboratory.
U ref U_{\text{ref}} U ref = The expanded measurement uncertainty ( k = 2 k=2 k = 2 ) associated with the assigned reference value.
Interpretation and Decision Criteria { ∣ E n ∣ ≤ 1.0 ⟹ Satisfactory Performance (Pass) ∣ E n ∣ > 1.0 ⟹ Unsatisfactory Performance (Fail / Action Required) \begin{cases} |E_n| \le 1.0 & \implies \textbf{Satisfactory Performance (Pass)} \\ |E_n| > 1.0 & \implies \textbf{Unsatisfactory Performance (Fail / Action Required)} \end{cases} { ∣ E n ∣ ≤ 1.0 ∣ E n ∣ > 1.0 ⟹ Satisfactory Performance (Pass) ⟹ Unsatisfactory Performance (Fail / Action Required)
For independent laboratory and reference values with comparable expanded-uncertainty coverage, E n = ( x l a b − x r e f ) / U l a b 2 + U r e f 2 E_n=(x_{lab}-x_{ref})/\sqrt{U_{lab}^2+U_{ref}^2} E n = ( x l ab − x re f ) / U l ab 2 + U re f 2 . Correlated results require the applicable covariance treatment. An absolute score at most one supports agreement for that comparison; it does not validate every uncertainty budget or the entire accredited scope. An unfavorable score requires investigation and risk-based action, not an automatic scope-wide suspension.
Measurement Systems Analysis (MSA) and Gage R&R Studies
While MAP monitors calibration laboratory standards, Measurement Systems Analysis (MSA) evaluates the capability of inspection equipment deployed on the production floor. Governed by the Automotive Industry Action Group (AIAG) guidelines, Gage Repeatability and Reproducibility (Gage R&R) studies evaluate total measurement system variation.
Partitioning Variance: Repeatability vs. Reproducibility
Total observed variation in an inspection process is decomposed into distinct variances: σ Total 2 = σ Part 2 + σ GRR 2 \sigma_{\text{Total}}^2 = \sigma_{\text{Part}}^2 + \sigma_{\text{GRR}}^2 σ Total 2 = σ Part 2 + σ GRR 2 σ GRR 2 = σ Repeatability 2 + σ Reproducibility 2 = EV 2 + AV 2 \sigma_{\text{GRR}}^2 = \sigma_{\text{Repeatability}}^2 + \sigma_{\text{Reproducibility}}^2 = \text{EV}^2 + \text{AV}^2 σ GRR 2 = σ Repeatability 2 + σ Reproducibility 2 = EV 2 + AV 2
Repeatability (Equipment Variation / EV): The variation in measurements obtained with one measurement instrument when used several times by one appraiser while measuring the identical characteristic on the same parts. Reflects the inherent mechanical, electrical, and sensor repeatability of the tool.
Reproducibility (Appraiser Variation / AV): The variation in the average of measurements made by different appraisers using the same instrument when measuring the identical characteristic on the same parts. Reflects human technique, clamping pressure, visual alignment, and ergonomic differences between operators.
AIAG Acceptance Criteria for %GRR
Gage capability is evaluated as a percentage of Total Variation (%TV) or as a percentage of product tolerance span (%Tolerance): % GRR = ( σ GRR σ Total ) × 100 % or % GRR Tol = ( 6 σ GRR USL − LSL ) × 100 % \%\text{GRR} = \left(\frac{\sigma_{\text{GRR}}}{\sigma_{\text{Total}}}\right) \times 100\% \quad \text{or} \quad \%\text{GRR}_{\text{Tol}} = \left(\frac{6\,\sigma_{\text{GRR}}}{\text{USL} - \text{LSL}}\right) \times 100\% % GRR = ( σ Total σ GRR ) × 100% or % GRR Tol = ( USL − LSL 6 σ GRR ) × 100%
Common guideline Interpretation Qualification
Below 10% Often considered acceptable Confirm the task and other performance requirements.
10–30% May be conditionally acceptable Consider application, consequences, and policy.
Above 30% Usually calls for improvement Follow the agreed study and acceptance policy.
These bands do not universally authorize or prohibit every use. State whether the denominator is tolerance or study variation, and use the agreed multiplier (for example six standard deviations).
Number of distinct categories
The usual study estimate is n d c = 1.41 σ P a r t / σ G R R ndc=1.41\sigma_{Part}/\sigma_{GRR} n d c = 1.41 σ P a r t / σ GRR , with the result truncated to an integer under the relevant convention. It compares part variation with measurement variation. Values of five or more are a commonly used study goal, but suitability still depends on the intended task. A low value warns that the instrument may not resolve the part-to-part differences being studied. Do not treat the number as a universal guarantee for every control-chart application.
Control-chart signal rules belong to the check-standard lesson. Distinguish a time-sequence signal from a proficiency-comparison score or a gage-study acceptance criterion; they test different aspects of measurement performance.
Worked study interpretation
Assume the agreed study uses six standard deviations divided by tolerance. If measurement-system standard deviation is 0.004 mm and total tolerance is 0.200 mm, %GRR is 6 × 0.004 / 0.200 × 100 = 12%. Under a policy using the common bands, this calls for conditional assessment rather than automatic approval. The decision also considers bias, stability, linearity, consequences, and the intended inspection. If part standard deviation is 0.020 mm, ndc is 1.41 × 0.020 / 0.004 = 7.05, truncated to 7. A study denominator based on observed process variation can yield a different percentage than the tolerance denominator; state the basis so the interpretation is reproducible.
Designing an interpretable gage study
Select parts representing the intended process variation and operators representing actual use. Randomize or otherwise control the order so memory, drift, and fatigue do not masquerade as repeatability or operator differences. Repeatedly measuring one nearly identical master can evaluate a restricted repeatability condition, but cannot establish the full part-to-part variation needed for a representative distinct-category estimate.
Review operator-by-part interaction when the study design supports it. An operator may be consistent on smooth parts yet inconsistent on rough or awkward features. Such an interaction should not be hidden by averaging all observations into one number. If the study prompts a change to the fixture or procedure, repeat suitable measurements under the changed conditions and record the change. Compare like denominators when tracking improvement.