Study guide

Proficiency Comparisons and Gage R&R

ASQ Certified Calibration Technician CCT

Track your progress as you read

Finished sections get a check mark.

1 SI Definitions and Realizations

The Seven SI Base Units and the 2019 Revision Realizing SI Units in the Laboratory

2 Derived Units, Prefixes, and Constants

Derived Units and Physical Calculations SI Prefixes and Compound-Unit Conversions Physical Constants and Their Applications

3 Measurement Standards and Selection

Types and Roles of Measurement Standards Selecting Standards for an Operational Hierarchy

4 Traceability and Standard Substitution

Traceability Evidence and Impact Review Evaluating and Authorizing Standard Substitution

5 Dimensional and Mechanical Metrology

Linear Displacement and Dimensional Instruments Geometry, Thermal Expansion, and Mass Force, Torque, Pressure, Density, and Viscosity

6 Temperature, Humidity, Volume, and Flow

Temperature Sensors and Thermometer Corrections Humidity, Volume, and Flow

7 Electrical, Optical, and Time Measurements

Voltage, Current, Resistance, and AC Measurement Time, Frequency, Light, Power, and Energy

8 Measurement Methods

Direct, Indirect, and Ratio Methods Transfer, Differential, and UUT Substitution Methods

9 Instrument Characteristics and Measurement Data

Sensitivity, Variability, and Precision Bias, Linearity, Stability, and Hysteresis Data Formats, Readability, and Suitability Resolution, Confidentiality, and Data Integrity

10 Specifications and Error Sources

Interpreting IM&TE Specification Terms Specification Calculations and Operating Qualifiers Instrument, Operator, and Circuit Errors Environmental, Geometric, and Interference Errors

11 Measurement Assurance

Check Standards and Statistical Process Control Proficiency Comparisons and Gage R&R

12 Procedures and Governing Requirements

Procedure Structure and Published Practice Sources Method Development, Deviations, and Handling Regulations, Contracts, and Requirement Precedence

13 Instrument Adjustment and Standardization

Calibration, Zero, and Span Adjustment Linearization, Nulling, and Digital Adjustment

14 Calibration Environment

Temperature and Humidity Control ESD, Dust, Vibration, and Pressure

15 Operations, Roles, and Scheduling

Receiving, As-Found Testing, and Calibration Flow Asset Identification, Tracking, and Release Laboratory Roles and Initial Scheduling Interval Review, Overdue Control, and Workloads

16 Method and Software Validation

Method Verification and Validation Studies Software, Firmware, and Spreadsheet Validation

17 Records and Formal Reporting

Controlled Records and Calibration Certificates Status Labels and Out-of-Tolerance Reporting

18 Uncertainty Concepts and Decision Risk

Error, Uncertainty, and Measurand Definition TAR, TUR, Tolerance Consumption, and Capability Conformity Decisions and False-Accept Risk Guard Bands and Conformity Reporting

19 Uncertainty Models and Budgets

Measurement Models and Uncertainty Contributions Distribution Selection and Budget Assembly

20 Type A and Type B Evaluation

Type A Statistics and Repeatability Outlier Review and Worked Type A Analysis Type B Distribution Models

21 Uncertainty Reporting and Applied Mathematics

Propagation, Covariance, and Effective Degrees of Freedom Coverage Factors and Expanded-Uncertainty Reporting Notation, Unit Conversions, Ratios, and Decibels Rounding, Algebra, Graphs, and Angular Conversions

22 Quality Systems and Tools

Quality-System Components, Planning, and Improvement The Seven Basic Quality Tools

23 Audits and Corrective Action

Audit Types, Planning, and Nonconformance Control Impact Assessment, Root Cause, and Effectiveness

24 Safety, Standards, and Professional Conduct

Electrical, Pressure, Chemical, and Laboratory Hazards PPE, Safety Data Sheets, 6S, and Safe Restoration Quality Standards, GUM, and VIM Accreditation Scope and Professional Ethics

Proficiency Comparisons and Gage R&R

Key Takeaways Explain This Topic AI

Normalized error compares a result difference with uncertainties under the stated correlation and coverage assumptions.

A satisfactory comparison score is evidence for that comparison, not automatic validation of every laboratory capability.

Gage R&R acceptance bands and distinct-category goals must be interpreted for the study and intended use.

Last updated: October 2026

Interlaboratory Comparisons (ILC) and Proficiency Testing (PT)

ISO/IEC 17025 clause 7.7.2 calls for comparison with other laboratories when available and appropriate, through proficiency testing and/or interlaboratory comparisons. Select suitable activities and interpret the results with their scope and uncertainty; one successful comparison does not validate every CMC or method.

In a typical PT scheme, a stable artifact (the transfer standard) is circulated among participating laboratories. Each laboratory measures the artifact and reports its measured value along with its expanded measurement uncertainty ( k = 2 k=2 k = 2 ).

The Normalized Error ( E n E_n E n ​ ) Ratio

Performance is evaluated using the internationally standardized Normalized Error ( E n E_n E n ​ ) ratio (ISO/IEC 17043): E n = x lab − x ref U lab 2 + U ref 2 E_n = \frac{x_{\text{lab}} - x_{\text{ref}}}{\sqrt{U_{\text{lab}}^2 + U_{\text{ref}}^2}} E n ​ = U lab 2 ​ + U ref 2 ​ ​ x lab ​ − x ref ​ ​

where:

x lab x_{\text{lab}} x lab ​ = The measured value reported by the participant laboratory.

x ref x_{\text{ref}} x ref ​ = The assigned reference value established by the organizing reference laboratory (typically an NMI or accredited primary reference provider).

U lab U_{\text{lab}} U lab ​ = The expanded measurement uncertainty ( k = 2 k=2 k = 2 , approximately 95 % 95\% 95% confidence) declared by the participant laboratory.

U ref U_{\text{ref}} U ref ​ = The expanded measurement uncertainty ( k = 2 k=2 k = 2 ) associated with the assigned reference value.

Interpretation and Decision Criteria { ∣ E n ∣ ≤ 1.0 ⟹ Satisfactory Performance (Pass) ∣ E n ∣ > 1.0 ⟹ Unsatisfactory Performance (Fail / Action Required) \begin{cases} |E_n| \le 1.0 & \implies \textbf{Satisfactory Performance (Pass)} \\ |E_n| > 1.0 & \implies \textbf{Unsatisfactory Performance (Fail / Action Required)} \end{cases} { ∣ E n ​ ∣ ≤ 1.0 ∣ E n ​ ∣ > 1.0 ​ ⟹ Satisfactory Performance (Pass) ⟹ Unsatisfactory Performance (Fail / Action Required) ​

For independent laboratory and reference values with comparable expanded-uncertainty coverage, E n = ( x l a b − x r e f ) / U l a b 2 + U r e f 2 E_n=(x_{lab}-x_{ref})/\sqrt{U_{lab}^2+U_{ref}^2} E n ​ = ( x l ab ​ − x re f ​ ) / U l ab 2 ​ + U re f 2 ​ ​ . Correlated results require the applicable covariance treatment. An absolute score at most one supports agreement for that comparison; it does not validate every uncertainty budget or the entire accredited scope. An unfavorable score requires investigation and risk-based action, not an automatic scope-wide suspension.

Measurement Systems Analysis (MSA) and Gage R&R Studies

While MAP monitors calibration laboratory standards, Measurement Systems Analysis (MSA) evaluates the capability of inspection equipment deployed on the production floor. Governed by the Automotive Industry Action Group (AIAG) guidelines, Gage Repeatability and Reproducibility (Gage R&R) studies evaluate total measurement system variation.

Partitioning Variance: Repeatability vs. Reproducibility

Total observed variation in an inspection process is decomposed into distinct variances: σ Total 2 = σ Part 2 + σ GRR 2 \sigma_{\text{Total}}^2 = \sigma_{\text{Part}}^2 + \sigma_{\text{GRR}}^2 σ Total 2 ​ = σ Part 2 ​ + σ GRR 2 ​ σ GRR 2 = σ Repeatability 2 + σ Reproducibility 2 = EV 2 + AV 2 \sigma_{\text{GRR}}^2 = \sigma_{\text{Repeatability}}^2 + \sigma_{\text{Reproducibility}}^2 = \text{EV}^2 + \text{AV}^2 σ GRR 2 ​ = σ Repeatability 2 ​ + σ Reproducibility 2 ​ = EV 2 + AV 2

Repeatability (Equipment Variation / EV): The variation in measurements obtained with one measurement instrument when used several times by one appraiser while measuring the identical characteristic on the same parts. Reflects the inherent mechanical, electrical, and sensor repeatability of the tool.

Reproducibility (Appraiser Variation / AV): The variation in the average of measurements made by different appraisers using the same instrument when measuring the identical characteristic on the same parts. Reflects human technique, clamping pressure, visual alignment, and ergonomic differences between operators.

AIAG Acceptance Criteria for %GRR

Gage capability is evaluated as a percentage of Total Variation (%TV) or as a percentage of product tolerance span (%Tolerance): % GRR = ( σ GRR σ Total ) × 100 % or % GRR Tol = ( 6 σ GRR USL − LSL ) × 100 % \%\text{GRR} = \left(\frac{\sigma_{\text{GRR}}}{\sigma_{\text{Total}}}\right) \times 100\% \quad \text{or} \quad \%\text{GRR}_{\text{Tol}} = \left(\frac{6\,\sigma_{\text{GRR}}}{\text{USL} - \text{LSL}}\right) \times 100\% % GRR = ( σ Total ​ σ GRR ​ ​ ) × 100% or % GRR Tol ​ = ( USL − LSL 6 σ GRR ​ ​ ) × 100%

Common guideline Interpretation Qualification

Below 10% Often considered acceptable Confirm the task and other performance requirements.

10–30% May be conditionally acceptable Consider application, consequences, and policy.

Above 30% Usually calls for improvement Follow the agreed study and acceptance policy.

These bands do not universally authorize or prohibit every use. State whether the denominator is tolerance or study variation, and use the agreed multiplier (for example six standard deviations).

Number of distinct categories

The usual study estimate is n d c = 1.41 σ P a r t / σ G R R ndc=1.41\sigma_{Part}/\sigma_{GRR} n d c = 1.41 σ P a r t ​ / σ GRR ​ , with the result truncated to an integer under the relevant convention. It compares part variation with measurement variation. Values of five or more are a commonly used study goal, but suitability still depends on the intended task. A low value warns that the instrument may not resolve the part-to-part differences being studied. Do not treat the number as a universal guarantee for every control-chart application.

Control-chart signal rules belong to the check-standard lesson. Distinguish a time-sequence signal from a proficiency-comparison score or a gage-study acceptance criterion; they test different aspects of measurement performance.

Worked study interpretation

Assume the agreed study uses six standard deviations divided by tolerance. If measurement-system standard deviation is 0.004 mm and total tolerance is 0.200 mm, %GRR is 6 × 0.004 / 0.200 × 100 = 12%. Under a policy using the common bands, this calls for conditional assessment rather than automatic approval. The decision also considers bias, stability, linearity, consequences, and the intended inspection. If part standard deviation is 0.020 mm, ndc is 1.41 × 0.020 / 0.004 = 7.05, truncated to 7. A study denominator based on observed process variation can yield a different percentage than the tolerance denominator; state the basis so the interpretation is reproducible.

Designing an interpretable gage study

Select parts representing the intended process variation and operators representing actual use. Randomize or otherwise control the order so memory, drift, and fatigue do not masquerade as repeatability or operator differences. Repeatedly measuring one nearly identical master can evaluate a restricted repeatability condition, but cannot establish the full part-to-part variation needed for a representative distinct-category estimate.

Review operator-by-part interaction when the study design supports it. An operator may be consistent on smooth parts yet inconsistent on rough or awkward features. Such an interaction should not be hidden by averaging all observations into one number. If the study prompts a change to the fixture or procedure, repeat suitable measurements under the changed conditions and record the change. Compare like denominators when tracking improvement.