Study guide
6.4 Variable & Attribute Gage R&R Studies
CSSC Certified Six Sigma Green Belt Exam
Track your progress as you read
Finished sections get a check mark.
1 Chapter 1: Six Sigma Overview & Exam Fundamentals
1.1 CSSC Certification Overview, Exam Structure & Body of Knowledge 1.2 History & Evolution of Six Sigma 1.3 Six Sigma Organizational Roles & Belts Hierarchy 1.4 The DMAIC Methodology Architecture vs. DMADV / DFSS 1.5 Other Process Improvement & Quality Methods, and When to Choose Six Sigma
2 Chapter 2: Quality Fundamentals & Defect Metrics
2.1 Critical to Quality (CTQ) Characteristics & VOC Translation 2.2 Defect Metrics: DPU, DPO, DPMO, & the 1.5-Sigma Shift 2.3 First Time Yield (FTY) & Rolled Throughput Yield (RTY) 2.4 Cost of Quality (COQ) & Cost of Poor Quality (COPQ)
3 Chapter 3: Lean Principles & Waste Elimination
3.1 Foundations of Lean & The Toyota Production System (TPS) 3.2 The Eight Wastes: CSSC's Seven Muda, TIMWOODS, and Muri/Mura 3.3 The 5S Visual Workplace Methodology 3.4 Value Stream Mapping (VSM), Cycle Time & Takt Time
4 Chapter 4: Project Selection & Team Management
4.1 Six Sigma Project Selection & Business Case Development 4.2 Project Charter Architecture 4.3 Stakeholder Management & Communication Planning 4.4 Team Dynamics & Tuckman's Team Development Stages 4.5 The 15-Point Project Viability Model & Process-Level Selection
5 Chapter 5: Define Phase & Process Mapping
5.1 High-Level Process Mapping with SIPOC 5.2 Flowcharts, Swimlane Diagrams & Process Value Analysis 5.3 Quality Function Deployment (QFD) & The House of Quality 5.4 Critical to Quality (CTQ) Flowdown & Operational Definitions 5.5 The CSSC Define Toolset: Ground Rules, In/Out of the Box, Is–Is Not & Tollgate Checklists
6 Chapter 6: Measure Phase & Measurement Systems
6.1 Data Types: Continuous (Variable) vs. Discrete (Attribute) Data 6.2 Data Collection Planning & Sampling Strategies 6.3 Measurement System Analysis (MSA) Foundations & Calibration 6.4 Variable & Attribute Gage R&R Studies
7 Chapter 7: Analyze Phase & Root Cause Analysis
7.1 Qualitative Root Cause Tools: 5 Whys & Cause-and-Effect (Fishbone) Diagrams 7.2 Failure Mode and Effects Analysis (FMEA) & RPN Calculation 7.3 Pareto Analysis & The 80/20 Rule 7.4 Graphical Data Exploration: Histograms, Box Plots, & Multi-Vari Charts 7.5 The Root Cause Verification Matrix
8 Chapter 8: Descriptive Statistics & Distributions
8.1 Measures of Central Tendency & Dispersion 8.2 The Normal Distribution & The Empirical Rule (68-95-99.7) 8.3 Standard Normal Distribution, Z-Scores & Probability Calculations 8.4 Common Non-Normal Distributions: Binomial, Poisson & Chi-Square
9 Chapter 9: Inferential Statistics & Hypothesis Testing
9.1 Fundamentals of Hypothesis Testing: Null vs. Alternative, Alpha & Beta Risks 9.2 One-Sample and Two-Sample t-Tests for Means 9.3 Paired t-Tests & Non-Parametric Alternatives 9.4 Analysis of Variance (One-Way & Two-Way ANOVA) & Chi-Square Contingency Tests 9.5 Sample Size Determination for Hypothesis Tests
10 Chapter 10: Correlation, Regression, & Experimentation
10.1 Linear Correlation & Pearson's Correlation Coefficient (r) 10.2 Simple Linear Regression & Coefficient of Determination (R^2) 10.3 Introduction to Design of Experiments (DOE) & Factorial Designs 10.4 Analyzing Experimental Results: Main Effects & Interaction Plots
11 Chapter 11: Improve Phase & Solution Implementation
11.1 Brainstorming, Creative Thinking & Solution Selection Matrices 11.2 Piloting Solutions & Conducting Risk Assessments 11.3 Implementation Planning & Change Management (ADKAR) 11.4 Mistake-Proofing (Poka-Yoke) & Standard Work
12 Chapter 12: Control Phase, SPC, & Process Capability
12.1 Statistical Process Control (SPC) & Shewhart Control Rules 12.2 Variable Control Charts: I-MR, X-bar & R, X-bar & S 12.3 Attribute Control Charts: p, np, c, and u Charts 12.4 Process Capability & Performance Indices: Cp, Cpk, Pp, Ppk 12.5 Communicating Statistical Results to Business Audiences
6.4 Variable & Attribute Gage R&R Studies
Key Takeaways Explain This Topic AI
Precision is decomposed into Repeatability (Equipment Variation - EV: within-operator spread on identical parts) and Reproducibility (Appraiser Variation - AV: between-operator spread).
A standard Variable Gage R&R study evaluates 10 representative parts, measured by 2 to 3 appraisers across 2 to 3 randomized blind trials, analyzed via either the Range method or the Two-Way ANOVA method.
Acceptance criteria for Variable Gage R&R dictate that %GRR < 10% is acceptable, 10% to 30% is conditionally acceptable based on criticality, and > 30% is unacceptable; the Number of Distinct Categories (ndc) must be at least 5.
The Number of Distinct Categories (ndc = 1.41 × σ_PV / σ_GRR) represents the number of non-overlapping confidence intervals the gage can distinguish; an ndc < 5 invalidates process capability studies regardless of %GRR.
Attribute Agreement Analysis evaluates categorical inspection using within-appraiser repeatability, between-appraiser reproducibility, and accuracy against a master standard, assessed via Cohen's or Fleiss' Kappa (κ ≥ 0.75).
Last updated: September 2026
6.4 Variable & Attribute Gage R&R Studies
Quick Summary: While calibration addresses measurement accuracy (centering), Gage Repeatability and Reproducibility (Gage R&R) quantifies measurement precision (spread). In continuous systems, a Variable Gage R&R decomposes measurement error into Repeatability (Equipment Variation - EV) and Reproducibility (Appraiser Variation - AV). Under standard AIAG and CSSC guidelines, a measurement system is acceptable if %GRR is under 10% (or conditionally under 30%) and the Number of Distinct Categories ( n d c ndc n d c ) is 5 or greater . For discrete and visual inspections, an Attribute Agreement Analysis evaluates within-appraiser consistency, between-appraiser reproducibility, and accuracy against a master standard using Cohen's or Fleiss' Kappa ( κ ≥ 0.75 \kappa \ge 0.75 κ ≥ 0.75 ) .
Precision Decomposed: Repeatability vs. Reproducibility
Precision refers to the dispersion of repeated measurements taken on identical parts under specified operating conditions. Total measurement system variance ( σ GRR 2 \sigma^2_{\text{GRR}} σ GRR 2 ) is the sum of two distinct variance components: σ GRR 2 = σ Repeatability 2 + σ Reproducibility 2 = σ EV 2 + σ AV 2 \sigma^2_{\text{GRR}} = \sigma^2_{\text{Repeatability}} + \sigma^2_{\text{Reproducibility}} = \sigma^2_{\text{EV}} + \sigma^2_{\text{AV}} σ GRR 2 = σ Repeatability 2 + σ Reproducibility 2 = σ EV 2 + σ AV 2 Dissecting Gage R&R Precision
- Gage R&R Variance (σ²_GRR)
- │
- ┌─────────────────────┴─────────────────────┐
- ▼ ▼
- Repeatability Reproducibility
- (Equipment Variation - EV) (Appraiser Variation - AV)
- Same appraiser • Different appraisers
- Same gage • Same gage
- Same parts measured multiple times • Same parts measured multiple times
- Reflects gage mechanics, stiffness, • Reflects clamping pressure, angle,
- bearing play, or electrical noise parallax, or procedural habits
- 1. Repeatability (Equipment Variation - EV)
Repeatability is the variation observed when one appraiser measures the same characteristic on the same parts multiple times using the same gage in the same physical environment.
Root Causes of High Repeatability Error: Mechanical play in gage slides or bearings, loose fixtures, sensor noise, electrical interference, poor gage resolution, thermal contraction, or lack of instrument rigidity.
Operational Fix: Repair, refurbish, or replace the physical measuring instrument, or stiffen the part clamping fixture.
2. Reproducibility (Appraiser Variation - AV)
Reproducibility is the variation observed in the average measurements made by different appraisers evaluating the same parts using the same gage .
Root Causes of High Reproducibility Error: Differences in operator technique, variations in manual clamping torque, sightline parallax errors on analog scales, inconsistent gage positioning, or ambiguous procedural instructions in standard work.
Operational Fix: Standardize operator work instructions, conduct training on gage seating, introduce mechanical torque-limiters (e.g., ratcheting thimbles), or automate the inspection station.
3. Operator-by-Part Interaction ( σ Operator × Part 2 \sigma^2_{\text{Operator} \times \text{Part}} σ Operator × Part 2 )
In advanced studies, an interaction effect occurs when an appraiser measures certain parts differently than other parts (e.g., Appraiser A measures large parts with excessive clamping pressure, causing elastic deformation, but measures small parts normally). Interaction effects can only be isolated using the ANOVA method .
Variable Gage R&R Study Architecture
A Variable Gage R&R study evaluates continuous measurement systems. To generate statistically valid variance estimates, the study must follow a rigorous experimental protocol: Standard Variable Gage R&R Matrix
- 10 Representative Parts (Spanning Full Process Variation Envelope)
- ┌───┬───┬───┬───┬───┬───┬───┬───┬───┬───┐
- │ 1 │ 2 │ 3 │ 4 │ 5 │ 6 │ 7 │ 8 │ 9 │ 10│
- └───┴───┴───┴───┴───┴───┴───┴───┴───┴───┘
- │
- ┌────────────┼────────────┐
- ▼ ▼ ▼
- Appraiser A Appraiser B Appraiser C (2 to 3 Frontline Operators)
- │ │ │
- ┌────┴────┐ ┌────┴────┐ ┌────┴────┐
- │ Trial 1 │ │ Trial 1 │ │ Trial 1 │ (2 to 3 Randomized, Blind Trials)
- │ Trial 2 │ │ Trial 2 │ │ Trial 2 │
- │ Trial 3 │ │ Trial 3 │ │ Trial 3 │
- └─────────┘ └─────────┘ └─────────┘
- Total Data Points = 10 Parts × 3 Appraisers × 3 Trials = 90 Observations
- Experimental Protocol Rules
Part Selection (10 Parts): Parts must be sampled to represent the entire natural range of process variation (including units from the low end, center, and high end of the distribution). Crucial Warning: Do not cherry-pick only nominal parts; doing so artificially suppresses Part-to-Part variation ( σ PV \sigma_{\text{PV}} σ PV ), causing the gage to appear artificially incapable!
Appraiser Selection (2 to 3 Appraisers): Appraisers must be actual frontline operators or quality technicians who routinely perform the inspection, not metrology PhDs or laboratory supervisors.
Randomized Blind Trials (2 to 3 Trials): The 10 parts must be re-coded (e.g., marked with hidden numbers on the reverse side) so appraisers cannot identify which part they are measuring. All parts must be measured in completely randomized order across trials to prevent recall bias.
Calculation Methods: Average & Range ( X X X -bar & R R R ) vs. ANOVA
Two mathematical approaches are used to analyze Variable Gage R&R data:
Dimension Average & Range ( X X X -bar & R R R ) Method Two-Way ANOVA Method (Recommended)
Computational Basis Uses range averages ( R ˉ ˉ \bar{\bar{R}} R ˉ ˉ ) and tabular constants ( K 1 , K 2 , K 3 K_1, K_2, K_3 K 1 , K 2 , K 3 ) Uses Sum of Squares ( S S SS SS ), Mean Squares ( M S MS MS ), and F F F -tests
Interaction Isolation Cannot isolate Operator-by-Part interaction Isolates and quantifies Operator × \times × Part interaction
Unbalanced Data Fails if trials or parts are missing Readily handles unbalanced experimental designs
Variance Estimation Biased for small sample sizes; less accurate Unbiased variance component estimates; exact confidence intervals
Industry Status Traditional manual calculation method Standard method in all modern statistical software (Minitab, JMP)
The Average and Range Method Formulas
Under the Range method, standard deviations are derived from range averages using standard AIAG/CSSC constants:
Equipment Variation (Repeatability): E V = R ˉ ˉ × K 1 EV = \bar{\bar{R}} \times K_1 E V = R ˉ ˉ × K 1
(Where R ˉ ˉ \bar{\bar{R}} R ˉ ˉ is the average of all appraiser ranges, and K 1 = 1 / d 2 ∗ K_1 = 1/d_2^* K 1 = 1/ d 2 ∗ for trials r r r .)
Appraiser Variation (Reproducibility): A V = ( X ˉ diff × K 2 ) 2 − E V 2 n × r AV = \sqrt{(\bar{X}_{\text{diff}} \times K_2)^2 - \frac{EV^2}{n \times r}} A V = ( X ˉ diff × K 2 ) 2 − n × r E V 2
(Where X ˉ diff \bar{X}_{\text{diff}} X ˉ diff is the difference between the highest and lowest appraiser means, n = parts n = \text{parts} n = parts , and r = trials r = \text{trials} r = trials .)
Gage R&R Standard Deviation: G R R = E V 2 + A V 2 GRR = \sqrt{EV^2 + AV^2} GRR = E V 2 + A V 2
- Part-to-Part Variation: P V = R p × K 3 PV = R_p \times K_3 P V = R p × K 3
- (Where R p R_p R p is the range of part averages across all appraisers.)
- Total Variation: T V = G R R 2 + P V 2 TV = \sqrt{GRR^2 + PV^2} T V = GR R 2 + P V 2
- Variable Gage R&R Acceptance Criteria
A measurement system is evaluated across three primary benchmarks: %GRR of Total Variation (%TV) , Precision-to-Tolerance Ratio (P/T Ratio) , and the Number of Distinct Categories ( n d c ndc n d c ) .
1. Percent of Total Variation (%TV / %GRR)
Evaluates measurement system variation relative to the total observed process variation: % GRR = ( σ GRR σ Total ) × 100 % \%\text{GRR} = \left( \frac{\sigma_{\text{GRR}}}{\sigma_{\text{Total}}} \right) \times 100\% % GRR = ( σ Total σ GRR ) × 100%
%GRR Range Measurement System Capability Practical Operational Action
< 10% Acceptable Measurement system is fully capable. Reliable for process control and capability analysis.
10% to 30% Conditionally Acceptable May be acceptable based on application importance, gage replacement cost, or customer risk.
> 30% Unacceptable System cannot be trusted. Must be repaired, replaced, or recalibrated before proceeding.
2. Precision-to-Tolerance Ratio (P/T Ratio / %Tolerance)
Evaluates measurement system variation relative to the customer's engineering tolerance band: P / T = ( 6 × σ GRR USL − LSL ) × 100 % P/T = \left( \frac{6 \times \sigma_{\text{GRR}}}{\text{USL} - \text{LSL}} \right) \times 100\% P / T = ( USL − LSL 6 × σ GRR ) × 100%
(Note: Historically, some automotive standards used 5.15 σ 5.15\sigma 5.15 σ representing a 99% interval; the modern CSSC and AIAG standard uses 6.0 σ 6.0\sigma 6.0 σ representing a 99.73% interval).
The identical threshold criteria apply: < 10 % < 10\% < 10% is acceptable, 10 % to 30 % 10\% \text{ to } 30\% 10% to 30% is conditionally acceptable, and > 30 % > 30\% > 30% is unacceptable.
3. Number of Distinct Categories ( n d c ndc n d c )
Even if a gage exhibits an acceptable %GRR, it must possess sufficient resolution to divide process variation into distinct groups. The Number of Distinct Categories ( n d c ndc n d c ) represents the number of non-overlapping 97% confidence intervals across process spread: n d c = 1.41 × ( σ PV σ GRR ) = 2 × ( σ PV σ GRR ) ndc = 1.41 \times \left( \frac{\sigma_{\text{PV}}}{\sigma_{\text{GRR}}} \right) = \sqrt{2} \times \left( \frac{\sigma_{\text{PV}}}{\sigma_{\text{GRR}}} \right) n d c = 1.41 × ( σ GRR σ PV ) = 2 × ( σ GRR σ PV )
Important
The Truncation Rule: The calculated n d c ndc n d c value is truncated (rounded down) to the nearest whole integer . For example, n d c = 4.98 ndc = 4.98 n d c = 4.98 truncates to 4 .
n d c ndc n d c Acceptance Benchmarks
n d c ≥ 5 ndc \ge 5 n d c ≥ 5 (Acceptable): The measurement system can divide the process distribution into 5 or more distinct categories (e.g., low, medium-low, center, medium-high, high). Required for statistical process control (SPC) and capability analysis ( C p / C p k C_p / C_{pk} C p / C p k ).
n d c = 2 ndc = 2 n d c = 2 to 4 4 4 (Marginal / Coarse Screening Only): The gage can only classify parts into broad groups (e.g., high/low). Unacceptable for continuous SPC or capability estimation.
n d c = 1 ndc = 1 n d c = 1 (Completely Unacceptable): The gage cannot distinguish part variation; all parts look identical to the measurement system.
Complete Worked Calculation: Variable Gage R&R Study
A medical implant manufacturer conducts a Variable Gage R&R study on an automated laser micrometer measuring knee joint femoral component thickness. The study design utilizes n = 10 n = 10 n = 10 parts , k = 3 k = 3 k = 3 appraisers , and r = 2 r = 2 r = 2 trials per appraiser.
Engineering specifications dictate: LSL = 15.000 mm \text{LSL} = 15.000\text{ mm} LSL = 15.000 mm , USL = 16.000 mm \text{USL} = 16.000\text{ mm} USL = 16.000 mm (Tolerance Band = 1.000 mm = 1.000\text{ mm} = 1.000 mm ).
From the two-way ANOVA analysis, the software extracts the following variance components:
Repeatability Variance: σ EV 2 = 0.000400 mm 2 \sigma^2_{\text{EV}} = 0.000400\text{ mm}^2 σ EV 2 = 0.000400 mm 2
Reproducibility Variance: σ AV 2 = 0.000225 mm 2 \sigma^2_{\text{AV}} = 0.000225\text{ mm}^2 σ AV 2 = 0.000225 mm 2
Part-to-Part Variance: σ PV 2 = 0.005625 mm 2 \sigma^2_{\text{PV}} = 0.005625\text{ mm}^2 σ PV 2 = 0.005625 mm 2
Step 1: Compute Component Standard Deviations σ EV = 0.000400 = 0.0200 mm \sigma_{\text{EV}} = \sqrt{0.000400} = 0.0200\text{ mm} σ EV = 0.000400 = 0.0200 mm σ AV = 0.000225 = 0.0150 mm \sigma_{\text{AV}} = \sqrt{0.000225} = 0.0150\text{ mm} σ AV = 0.000225 = 0.0150 mm σ PV = 0.005625 = 0.0750 mm \sigma_{\text{PV}} = \sqrt{0.005625} = 0.0750\text{ mm} σ PV = 0.005625 = 0.0750 mm
Step 2: Calculate Gage R&R Variance and Standard Deviation σ GRR 2 = σ EV 2 + σ AV 2 = 0.000400 + 0.000225 = 0.000625 mm 2 \sigma^2_{\text{GRR}} = \sigma^2_{\text{EV}} + \sigma^2_{\text{AV}} = 0.000400 + 0.000225 = 0.000625\text{ mm}^2 σ GRR 2 = σ EV 2 + σ AV 2 = 0.000400 + 0.000225 = 0.000625 mm 2 σ GRR = 0.000625 = 0.0250 mm \sigma_{\text{GRR}} = \sqrt{0.000625} = 0.0250\text{ mm} σ GRR = 0.000625 = 0.0250 mm
Step 3: Calculate Total Observed Variance and Standard Deviation σ TV 2 = σ GRR 2 + σ PV 2 = 0.000625 + 0.005625 = 0.006250 mm 2 \sigma^2_{\text{TV}} = \sigma^2_{\text{GRR}} + \sigma^2_{\text{PV}} = 0.000625 + 0.005625 = 0.006250\text{ mm}^2 σ TV 2 = σ GRR 2 + σ PV 2 = 0.000625 + 0.005625 = 0.006250 mm 2 σ TV = 0.006250 ≈ 0.079057 mm \sigma_{\text{TV}} = \sqrt{0.006250} \approx 0.079057\text{ mm} σ TV = 0.006250 ≈ 0.079057 mm
Step 4: Calculate %GRR (Percent of Total Variation) % GRR = ( σ GRR σ TV ) × 100 % = ( 0.0250 0.079057 ) × 100 % = 31.62 % \%\text{GRR} = \left( \frac{\sigma_{\text{GRR}}}{\sigma_{\text{TV}}} \right) \times 100\% = \left( \frac{0.0250}{0.079057} \right) \times 100\% = 31.62\% % GRR = ( σ TV σ GRR ) × 100% = ( 0.079057 0.0250 ) × 100% = 31.62%
Status: Unacceptable ( 31.62 % > 30 % 31.62\% > 30\% 31.62% > 30% by total variation criteria).
Step 5: Calculate Precision-to-Tolerance (P/T Ratio) P / T = ( 6 × σ GRR USL − LSL ) × 100 % = ( 6 × 0.0250 1.000 ) × 100 % = ( 0.150 1.000 ) × 100 % = 15.0 % P/T = \left( \frac{6 \times \sigma_{\text{GRR}}}{\text{USL} - \text{LSL}} \right) \times 100\% = \left( \frac{6 \times 0.0250}{1.000} \right) \times 100\% = \left( \frac{0.150}{1.000} \right) \times 100\% = 15.0\% P / T = ( USL − LSL 6 × σ GRR ) × 100% = ( 1.000 6 × 0.0250 ) × 100% = ( 1.000 0.150 ) × 100% = 15.0%
Status: Conditionally Acceptable ( 15.0 % 15.0\% 15.0% falls between 10 % 10\% 10% and 30 % 30\% 30% against tolerance).
Step 6: Calculate Number of Distinct Categories ( n d c ndc n d c ) n d c = 1.41 × ( σ PV σ GRR ) = 1.4142 × ( 0.0750 0.0250 ) = 1.4142 × 3.0 = 4.24 ndc = 1.41 \times \left( \frac{\sigma_{\text{PV}}}{\sigma_{\text{GRR}}} \right) = 1.4142 \times \left( \frac{0.0750}{0.0250} \right) = 1.4142 \times 3.0 = 4.24 n d c = 1.41 × ( σ GRR σ PV ) = 1.4142 × ( 0.0250 0.0750 ) = 1.4142 × 3.0 = 4.24
Truncating to the nearest integer yields: n d c = 4 ndc = 4 n d c = 4
Status: Unacceptable ( n d c = 4 < 5 ndc = 4 < 5 n d c = 4 < 5 ).
Step 7: Practical Continuous Improvement Recommendation
Although the measurement system consumes only 15.0% of the customer's tolerance band, its %GRR of 31.62% and n d c ndc n d c of 4 make it unacceptable for process control and capability analysis . The gage cannot divide the natural process spread into the minimum required 5 categories.
Looking at the variance contribution: % EV Variance = 0.000400 0.000625 × 100 % = 64.0 % \%\text{EV Variance} = \frac{0.000400}{0.000625} \times 100\% = 64.0\% % EV Variance = 0.000625 0.000400 × 100% = 64.0% % AV Variance = 0.000225 0.000625 × 100 % = 36.0 % \%\text{AV Variance} = \frac{0.000225}{0.000625} \times 100\% = 36.0\% % AV Variance = 0.000625 0.000225 × 100% = 36.0%
Because Repeatability (EV) accounts for 64% of total measurement noise, engineering should prioritize mechanical fixture rigidity and laser sensor cleaning before retraining appraisers.
Attribute Agreement Analysis (Attribute MSA)
When inspection data is discrete, binary, or qualitative (such as visual inspection of paint blemishes, document completeness audits, or customer service call compliance), continuous Gage R&R cannot be applied. Instead, the team executes an Attribute Agreement Analysis . Four Dimensions of Attribute Agreement
1. Within-Appraiser (Repeatability) ▶ Does Inspector A agree with Inspector A
across Trial 1 and Trial 2?
2. Between-Appraiser (Reproducibility)▶ Does Inspector A agree with Inspector B
on identical samples?
3. Appraiser vs. Standard (Accuracy) ▶ Does Inspector A agree with the verified
Master Reference Standard?
4. Overall System vs. Standard ▶ Do ALL inspectors agree with each other
AND the Master Standard on ALL trials?
Study Architecture
Sample Size: 30 to 50 samples selected from the process.
Master Standard: Each sample must have a verified, pre-established master classification by an expert or committee.
Crucial Part Mix: The sample set must include conforming parts, defective parts, and critically, borderline / marginal parts that challenge the visual defect threshold.
Appraisers & Trials: 2 to 3 operational inspectors evaluate all parts in 2 independent, randomized, blind trials.
Statistical Evaluation: Fleiss' and Cohen's Kappa ( κ \kappa κ )
Raw percentage agreement is a deceptive metric because appraisers can achieve high apparent agreement purely by chance (especially when the defect rate is low). Attribute MSA utilizes Kappa statistics (Cohen's Kappa for 2 appraisers; Fleiss' Kappa for multiple appraisers) to correct for chance agreement: κ = P observed − P chance 1 − P chance \kappa = \frac{P_{\text{observed}} - P_{\text{chance}}}{1 - P_{\text{chance}}} κ = 1 − P chance P observed − P chance
Where:
P observed P_{\text{observed}} P observed = Proportion of units where appraisers actually agree.
P chance P_{\text{chance}} P chance = Proportion of agreement expected purely due to chance.
Interpreting Kappa ( κ \kappa κ )
κ > 0.75 \kappa > 0.75 κ > 0.75 to 0.80 0.80 0.80 : Good to Excellent Agreement . The measurement system is acceptable for production inspection.
0.40 ≤ κ ≤ 0.75 0.40 \le \kappa \le 0.75 0.40 ≤ κ ≤ 0.75 : Moderate / Marginal Agreement . Measurement system needs improvement; requires clear boundary visual aids, refined operational definitions, and inspector retraining.
κ < 0.40 \kappa < 0.40 κ < 0.40 : Poor Agreement . The measurement system is unacceptable and statistically indistinguishable from coin flipping.
Misclassification Analysis: False Alarm vs. Miss Rate
In addition to Kappa, Attribute MSA evaluates two operational error rates:
False Alarm Rate ( α \alpha α Risk / Type I Error): Proportion of true conforming parts rejected by appraisers (drives scrap and rework costs).
Miss Rate ( β \beta β Risk / Type II Error): Proportion of true defective parts accepted by appraisers (drives customer defect escapes).
Critical Exam Traps to Avoid
Trap 1: Directly Adding Standard Deviations Instead of Variances — Adding E V EV E V and A V AV A V directly to get G R R GRR GRR . Standard deviations never add directly: σ GRR 2 = σ EV 2 + σ AV 2 \sigma^2_{\text{GRR}} = \sigma^2_{\text{EV}} + \sigma^2_{\text{AV}} σ GRR 2 = σ EV 2 + σ AV 2 , so G R R = E V 2 + A V 2 GRR = \sqrt{EV^2 + AV^2} GRR = E V 2 + A V 2 .
Trap 2: Confusing Repeatability with Reproducibility — Repeatability is equipment variation (same operator, same gage, same part). Reproducibility is appraiser variation (different operators, same gage, same part).
Trap 3: Overlooking the Number of Distinct Categories ( n d c < 5 ndc < 5 n d c < 5 ) — Approving a measurement system because %GRR is 22% (conditionally acceptable) while ignoring an n d c ndc n d c of 3. If n d c < 5 ndc < 5 n d c < 5 , the gage lacks sufficient resolution for SPC and capability studies.
Trap 4: Assuming High Repeatability Proves an Attribute System is Capable — An appraiser can be 100% repeatable with themselves while being completely inaccurate against the master standard (e.g., consistently rejecting conforming parts). Appraiser vs. Standard agreement is mandatory.