Study guide
11.2 Supplier Selection, Evaluation & Rating Systems
Certified Quality Improvement Associate CQIA
Track your progress as you read
Finished sections get a check mark.
1 Chapter 1: Introduction to CQIA & Exam Overview
1.1 About the ASQ CQIA Exam 1.2 How to Use This Study Guide & CQIA Exam Strategy 1.3 Quality Fundamentals & Historical Evolution
2 Chapter 2: Quality Basics & Management Philosophies
2.1 Core Quality Concepts, Terminology & Definitions 2.2 Quality Pioneers: Deming, Juran & Crosby 2.3 Additional Quality Pioneers: Ishikawa, Shewhart, Feigenbaum & Taguchi 2.4 Benefits of Quality & Organizational Impact 2.5 Employee Involvement, Empowerment & Organizational Culture
3 Chapter 3: Quality Systems, Standards & Cost of Quality
3.1 Quality Management Systems & ISO Standards 3.2 Baldrige Award & Quality Excellence Frameworks 3.3 Cost of Quality (COQ) & The PAF Model 3.4 The Quality Plan: Purpose, Content & Ownership 3.5 Internal Audits as an Improvement Technique
4 Chapter 4: Teams, Roles & Formation
4.1 Team Types, Purpose & Team Charters 4.2 Team Roles, Member Responsibilities & Sponsorship 4.3 Bruce Tuckman's Stages of Team Development 4.4 Initiating Teams & Selecting Team Members
5 Chapter 5: Team Dynamics, Facilitation & Decision-Making
5.1 Meeting Management, Facilitation & Communication 5.2 Decision-Making & Consensus Tools 5.3 Conflict Resolution & Overcoming Team Roadblocks
6 Chapter 6: Continuous Improvement Frameworks & Lean Six Sigma
6.1 Continuous Improvement Cycles: PDCA, PDSA & DMAIC 6.2 Lean Principles, Kaizen & The 8 Wastes (Muda) 6.3 Problem-Solving Methodologies & Root Cause Analysis 6.4 Pull Systems, Kanban, JIT & Setup/Cycle-Time Reduction 6.5 Benchmarking
7 Chapter 7: The 7 Basic Quality Tools
7.1 Process Flowcharts & SIPOC Diagrams 7.2 Check Sheets, Histograms & Pareto Analysis 7.3 Cause-and-Effect (Ishikawa) Diagrams & Scatter Plots 7.4 Statistical Process Control (SPC) & Run Charts
8 Chapter 8: Additional Process Improvement Tools
8.1 Affinity, Tree, Matrix & Process Decision Program Charts 8.2 Error-Proofing (Poka-Yoke), 5S & Standard Work 8.3 Process Capability Basics (Cp & Cpk) 8.4 Decision Trees & Expected Value Analysis 8.5 Risk Management: FMEA, SWOT & Risk-Based Prioritization
9 Chapter 9: Data Collection, Measurement & Basic Statistics
9.1 Data Types, Measurement Scales & Sampling Techniques 9.2 Descriptive Statistics & Measures of Variation 9.3 Data Integrity, Verification & Visual Presentation
10 Chapter 10: Customer Relations & Voice of the Customer
10.1 Customer Identification: Internal vs. External Stakeholders 10.2 Voice of the Customer (VOC) & The Kano Model 10.3 Customer Satisfaction, Feedback & Retention 10.4 Quality Function Deployment & the House of Quality
11 Chapter 11: Supplier Relations & Supply Chain Quality
11.1 Supplier Identification & Strategic Partnerships 11.2 Supplier Selection, Evaluation & Rating Systems 11.3 Incoming Quality Control, Audits & Supplier Continuous Improvement
11.2 Supplier Selection, Evaluation & Rating Systems
Key Takeaways Explain This Topic AI
Supplier selection requires a rigorous, multidimensional framework balancing Quality capability, Delivery reliability, Cost/TCO, Technical/R&D competence, Responsiveness, and Financial stability.
Supplier quality audits are structured into System Audits (verifying QMS standard compliance), Process Audits (verifying adherence to manufacturing controls, standard work, and SPC), and Product Audits (verifying physical product conformance and First Article Inspection).
First Article Inspection (FAI, AS9102) verifies 100% of dimensional, material, and performance specifications on parts produced under normal production tooling and operational conditions.
ISO 9001:2015 Clause 8.4 mandates that organizations apply risk-based controls to externally provided processes, products, and services, establishing explicit criteria for supplier evaluation, selection, performance monitoring, and re-evaluation.
Supplier scorecards track empirical KPIs including PPM defect rates, Lot Acceptance Rates (LAR), and On-Time In-Full (OTIF) percentages, feeding into weighted-point rating systems ( ∑ W i × S i \sum W_i \times S_i ∑ W i × S i ) to govern supplier tiering.
Last updated: September 2026
11.2 Supplier Selection, Evaluation & Rating Systems
Supplier selection and ongoing performance governance are critical to protecting an enterprise from operational disruptions, quality escapes, and warranty liabilities. Sourcing decisions cannot rely on subjective intuition or surface-level marketing claims. The ASQ CQIA Body of Knowledge outlines a rigorous, data-driven framework: defining multidimensional selection criteria, executing comprehensive quality audits, enforcing ISO 9001:2015 Clause 8.4 compliance, and maintaining quantitative scorecards and weighted-point rating systems.
1. Multidimensional Supplier Selection Criteria
World-class quality organizations evaluate prospective vendors across six strategic pillars before awarding production business: +-----------------------------------------------------------------------------------------+
- | THE SIX SOURCING SELECTION PILLARS |
- +-----------------------------------------------------------------------------------------+
- | |
- | 1. QUALITY CAPABILITY : Certified QMS, SPC controls, Cpk >= 1.33, GR&R < 10% |
- | 2. DELIVERY RELIABILITY : Demonstrated OTIF %, lead times, flexible buffer capacity|
- | 3. TOTAL COST / COMMERCIAL : TCO modeling, open-book cost breakdown, fair pricing |
- | 4. TECHNICAL & INNOVATION : R&D engineering depth, CAD/CAM compatibility, test labs |
- | 5. SERVICE & RESPONSIVENESS: Rapid SCAR containment (<24-48h), 8D closure, tech support|
- | 6. FINANCIAL & COMPLIANCE : Altman Z-score, healthy liquidity, RoHS/REACH/ITAR certs |
- | |
- +-----------------------------------------------------------------------------------------+
- Detailed Breakdown of Selection Dimensions
Evaluation Dimension Core Evaluation Criteria & Verification Evidence
1. Quality Capability Certified Quality Management System (ISO 9001, AS9100, IATF 16949, or ISO 13485); demonstrated process capability ( C p , C p k ≥ 1.33 C_p, C_{pk} \ge 1.33 C p , C p k ≥ 1.33 on Critical-to-Quality features); Gauge Repeatability & Reproducibility (GR&R < 10 % < 10\% < 10% ); ISO/IEC 17025 calibration traceability; robust nonconforming material quarantine controls.
2. Delivery Reliability Historical On-Time In-Full (OTIF) percentage ( ≥ 98 % \ge 98\% ≥ 98% ); production lead times; capacity utilization rates ( < 80 % < 80\% < 80% to absorb volume spikes); Electronic Data Interchange (EDI) and Advanced Shipping Notice (ASN) logistics systems.
3. Total Cost & Commercial Total Cost of Ownership (TCO) transparency; willingness to participate in open-book target costing; stable long-term pricing commitments; favorable payment terms without punitive surcharges.
4. Technical & Engineering In-house design engineering and R&D talent; compatibility with buyer CAD/CAM file formats (e.g., STEP, CATIA, SolidWorks); rapid prototyping capability; dedicated metallurgical and environmental testing laboratories.
5. Service & Responsiveness Proven speed of response to Supplier Corrective Action Requests (SCARs); dedicated Supplier Quality Engineer (SQE) liaison; executive accessibility; proactive communication regarding production bottlenecks.
6. Financial Stability & Risk Healthy credit rating (Dun & Bradstreet Comprehensive Report); strong current and quick liquidity ratios; Altman Z-score indicating low insolvency risk; regulatory compliance (RoHS, REACH, Dodd-Frank conflict minerals, FDA GMP).
2. Supplier Audits: System, Process & Product Audits
A supplier audit is an independent, systematic, and documented examination conducted by the buyer (a second-party audit ) to evaluate a supplier's quality systems, manufacturing operations, and finished product integrity. +-----------------------------------------------------------------------------------------+
- | SUPPLIER AUDIT TAXONOMY |
- +-----------------------------------------------------------------------------------------+
- | |
- | [ SYSTEM AUDIT ] ──► Audits entire QMS against standards (ISO 9001, AS9100) |
- | Scope: Quality manual, document control, training, CAPA |
- | |
- | [ PROCESS AUDIT ] ──► Audits a specific manufacturing line or operation (VDA 6.3) |
- | Scope: Machine parameters, SOP adherence, SPC, poka-yoke |
- | |
- | [ PRODUCT AUDIT / FAI]──► Audits physical hardware against drawings (AS9102) |
- | Scope: 100% dimensional ballooning, material assays, NDT |
- | |
- +-----------------------------------------------------------------------------------------+
- 1. System Audits (Second-Party QMS Audits)
Focus: High-level organizational governance and compliance of the complete Quality Management System.
Audit Scope: Management review records, internal audit schedules, document and record control, corrective and preventive action (CAPA) systems, employee training matrices, and calibration control systems.
Objective: Verifies that the supplier possesses a mature, self-sustaining systemic framework capable of maintaining quality over time.
2. Process Audits (Manufacturing Line Audits)
Focus: A specific manufacturing process, machine center, or assembly line (e.g., surface mount technology PCB soldering, aluminum die-casting, heat-treating).
Audit Scope: Operator adherence to Standard Operating Procedures (SOPs), machine setup and parameter verification (temperature, pressure, speed), calibration status of in-line sensors, execution of in-process statistical process control (SPC) charts, and functional testing of poka-yoke (mistake-proofing) sensors.
Objective: Confirms that the specific manufacturing process is stable, capable, and controlled to prevent defect generation.
3. Product Audits & First Article Inspection (FAI)
Focus: The physical finished item or component.
First Article Inspection (FAI / AS9102): A comprehensive, independent verification that a supplier's production tooling, processes, and documentation yield parts conforming 100% to all engineering drawing requirements under standard production run conditions.
100% Drawing Ballooning: Every dimension, geometric tolerance (GD&T), surface finish requirement, chemical composition assay, and hardness callout is assigned a unique sequential number and measured.
Standard Production Conditions: FAI parts must be produced using permanent production tooling, at full production line speed, by regular line operators (never hand-made prototypes).
Triggers for Re-FAI: Introduction of new tooling, major drawing revisions (form, fit, or function changes), relocation of machinery to a new plant, changes in sub-tier raw material suppliers, or a production hiatus exceeding 12–24 months. +-----------------------------------------------------------------------------------------+
- | SUPPLIER QUALIFICATION PROGRESSION |
- +-----------------------------------------------------------------------------------------+
- | |
- | [ 1. Pre-Award Desk Survey ] ──► Questionnaire: QMS certs, machinery lists, financials |
- | │ |
- | ▼ |
- | [ 2. On-Site System Audit ] ──► 2nd-party audit of facility QMS & quality procedures |
- | │ |
- | ▼ |
- | [ 3. On-Site Process Audit ] ──► Deep-dive audit of specific manufacturing line / SPC |
- | │ |
- | ▼ |
- | [ 4. First Article (FAI) ] ──► 100% dimensional ballooning & metallurgical testing |
- | │ |
- | ▼ |
- | [ 5. Approved Supplier List] ──► Placement on ASL; initial production order release |
- | |
- +-----------------------------------------------------------------------------------------+
- 3. ISO 9001:2015 Clause 8.4: Control of Externally Provided Processes, Products & Services
ISO 9001:2015 Clause 8.4 establishes mandatory requirements for managing external providers (suppliers, subcontractors, and outsourced processes):
Core Mandates of Clause 8.4
Clause 8.4.1 (General Requirements): The organization must ensure that externally provided processes, products, and services conform to specified requirements. The organization is required to:
Establish and apply explicit criteria for the evaluation, selection, performance monitoring, and re-evaluation of external providers.
Retain documented information (records) of these evaluations and any necessary actions arising from them.
Clause 8.4.2 (Type and Extent of Control): The organization must take a risk-based approach to supplier oversight. Controls must consider:
The potential impact of the externally provided item on the organization's ability to consistently meet customer and regulatory requirements.
The perceived effectiveness of controls applied by the external provider.
Verification activities necessary to ensure requirements are met (e.g., receiving inspection, certificates of analysis, source inspection).
Clause 8.4.3 (Information for External Providers): Sourcing requirements must be clearly communicated to vendors before contract issuance, specifying:
The exact products, processes, or services to be provided, including technical drawings and revisions.
Approval requirements for products, methods, processes, and equipment release.
Competence and qualification requirements for supplier personnel.
The supplier's interactions with the buyer's quality management system.
Verification or validation activities that the buyer or its customer intends to perform at the supplier's premises.
4. Supplier Scorecards & Key Performance Indicators (KPIs)
Ongoing supplier performance is monitored quantitatively through Supplier Scorecards , replacing subjective perceptions with empirical metrics.
The Three Performance Measures the Body of Knowledge Names
Entry IV.C names three supplier performance measures explicitly. Know all three, because the third is the one candidates forget:
Measure What it captures Representative metric
Quality performance Conformity of what was delivered Defective parts per million (PPM); lot acceptance rate; number of supplier corrective action requests
On-time delivery Whether it arrived when promised On-time delivery percentage; on-time in-full (OTIF); schedule adherence
Level of service How the supplier behaves as a business partner, beyond the shipment itself Responsiveness to inquiries and quotations; technical support provided; corrective action response time; flexibility on schedule and volume changes; accuracy of documentation and invoicing; ease of doing business
Level of service is the qualitative dimension. It is the reason a supplier with excellent PPM and delivery numbers can still be rated poorly: if they take three weeks to answer an engineering question, refuse volume changes, submit incorrect certificates, or fight every corrective action request, they impose real cost that neither the quality nor the delivery metric captures. Because it resists direct measurement, level of service is typically scored on a defined rating scale by the buyer, quality engineer, and receiving personnel who interact with the supplier, then weighted into the composite scorecard alongside the two objective measures.
- Key Performance Indicators (KPIs)
- 1. Parts Per Million (PPM) Defect Rate
The universally recognized metric for supplier quality performance, quantifying the number of defective parts observed per one million units delivered: PPM = ( Total Defective Parts Found Total Parts Delivered ) × 1,000,000 \text{PPM} = \left( \frac{\text{Total Defective Parts Found}}{\text{Total Parts Delivered}} \right) \times 1{,}000{,}000 PPM = ( Total Parts Delivered Total Defective Parts Found ) × 1 , 000 , 000
Example Calculation: If a supplier delivers 150,000 150{,}000 150 , 000 precision stamping parts during a quarter and quality inspectors identify 12 12 12 nonconforming parts: PPM = ( 12 150,000 ) × 1,000,000 = 0.00008 × 1,000,000 = 80 PPM \text{PPM} = \left( \frac{12}{150{,}000} \right) \times 1{,}000{,}000 = 0.00008 \times 1{,}000{,}000 = \mathbf{80\text{ PPM}} PPM = ( 150 , 000 12 ) × 1 , 000 , 000 = 0.00008 × 1 , 000 , 000 = 80 PPM
2. Lot Acceptance Rate (LAR)
The percentage of delivered shipment lots accepted without rejection or return to vendor: LAR (%) = ( Number of Lots Accepted Total Number of Lots Received ) × 100 \text{LAR (\%)} = \left( \frac{\text{Number of Lots Accepted}}{\text{Total Number of Lots Received}} \right) \times 100 LAR (%) = ( Total Number of Lots Received Number of Lots Accepted ) × 100
3. On-Time In-Full (OTIF) Percentage
The percentage of purchase orders delivered within the specified delivery window (e.g., 0 days late, no more than 2 days early) AND containing 100% of the ordered quantity (no partial or incomplete shipments): OTIF (%) = ( Number of Orders Delivered On-Time and Complete Total Number of Purchase Orders Scheduled ) × 100 \text{OTIF (\%)} = \left( \frac{\text{Number of Orders Delivered On-Time and Complete}}{\text{Total Number of Purchase Orders Scheduled}} \right) \times 100 OTIF (%) = ( Total Number of Purchase Orders Scheduled Number of Orders Delivered On-Time and Complete ) × 100
4. SCAR Responsiveness & Closure Speed
Tracks the timeliness of supplier responses to nonconformance investigations: containment action submission within 24 to 48 hours 24\text{ to }48\text{ hours} 24 to 48 hours , and full root cause 8D closure within 30 calendar days 30\text{ calendar days} 30 calendar days .
5. Weighted-Point Rating Systems: Mathematical Worked Example
A weighted-point rating system aggregates diverse performance categories into a single composite score, allowing objective, mathematically sound supplier comparisons.
Mathematical Formulation Composite Supplier Score = ∑ i = 1 k ( W i × S i ) \text{Composite Supplier Score} = \sum_{i=1}^{k} \left( W_i \times S_i \right) Composite Supplier Score = i = 1 ∑ k ( W i × S i )
Where:
W i = Weight assigned to category i ( ∑ W i = 1.00 or 100 % ) W_i = \text{Weight assigned to category } i \quad \left(\sum W_i = 1.00 \text{ or } 100\%\right) W i = Weight assigned to category i ( ∑ W i = 1.00 or 100% )
S i = Normalized category performance score (0 to 100 points) S_i = \text{Normalized category performance score (0 to 100 points)} S i = Normalized category performance score (0 to 100 points)
Comprehensive Worked Sourcing Example
A medical device manufacturer evaluates two competing precision CNC machining suppliers— Supplier Alpha and Supplier Beta —for a critical titanium implant contract. The evaluation team assigns the following category weights based on risk:
Quality Performance (40% Weight, W 1 = 0.40 W_1 = 0.40 W 1 = 0.40 ): Target ≤ 20 PPM \le 20\text{ PPM} ≤ 20 PPM
Delivery Reliability (25% Weight, W 2 = 0.25 W_2 = 0.25 W 2 = 0.25 ): Target ≥ 98 % OTIF \ge 98\%\text{ OTIF} ≥ 98% OTIF
Cost Competitiveness (20% Weight, W 3 = 0.20 W_3 = 0.20 W 3 = 0.20 ): Target = Favorable Purchase Price Variance
Technical Capability (15% Weight, W 4 = 0.15 W_4 = 0.15 W 4 = 0.15 ): Target = 5-Axis CNC & CMM capabilities +-----------------------------------------------------------------------------------------+
- | SUPPLIER EVALUATION PERFORMANCE DATA |
- +-------------------------+--------+----------------------------+-------------------------+
- | Performance Category | Weight | Supplier Alpha Performance | Supplier Beta Performance|
- +-------------------------+--------+----------------------------+-------------------------+
- | Quality (PPM & QMS) | 40% | 95 pts (8 PPM, ISO 13485) | 70 pts (180 PPM, ISO 9001|
- | Delivery (OTIF %) | 25% | 90 pts (97.5% OTIF) | 98 pts (99.8% OTIF) |
- | Cost Competitiveness | 20% | 75 pts (Higher unit price) | 95 pts (Lowest initial) |
- | Technical & Engineering | 15% | 95 pts (In-house 5-axis CMM| 80 pts (Standard 3-axis)|
- +-------------------------+--------+----------------------------+-------------------------+
- Step-by-Step Composite Score Calculations
Calculation for Supplier Alpha: Score Alpha = ( 0.40 × 95 ) + ( 0.25 × 90 ) + ( 0.20 × 75 ) + ( 0.15 × 95 ) \text{Score}_{\text{Alpha}} = (0.40 \times 95) + (0.25 \times 90) + (0.20 \times 75) + (0.15 \times 95) Score Alpha = ( 0.40 × 95 ) + ( 0.25 × 90 ) + ( 0.20 × 75 ) + ( 0.15 × 95 ) Score Alpha = 38.0 + 22.5 + 15.0 + 14.25 = 89.75 points \text{Score}_{\text{Alpha}} = 38.0 + 22.5 + 15.0 + 14.25 = \mathbf{89.75\text{ points}} Score Alpha = 38.0 + 22.5 + 15.0 + 14.25 = 89.75 points
Calculation for Supplier Beta: Score Beta = ( 0.40 × 70 ) + ( 0.25 × 98 ) + ( 0.20 × 95 ) + ( 0.15 × 80 ) \text{Score}_{\text{Beta}} = (0.40 \times 70) + (0.25 \times 98) + (0.20 \times 95) + (0.15 \times 80) Score Beta = ( 0.40 × 70 ) + ( 0.25 × 98 ) + ( 0.20 × 95 ) + ( 0.15 × 80 ) Score Beta = 28.0 + 24.5 + 19.0 + 12.0 = 83.50 points \text{Score}_{\text{Beta}} = 28.0 + 24.5 + 19.0 + 12.0 = \mathbf{83.50\text{ points}} Score Beta = 28.0 + 24.5 + 19.0 + 12.0 = 83.50 points
Strategic Sourcing Conclusion: Although Supplier Beta offered lower initial unit prices and slightly higher delivery numbers, Supplier Alpha wins the contract with a composite score of 89.75 89.75 89.75 vs. 83.50 83.50 83.50 . In high-reliability manufacturing, Supplier Alpha's superior quality and technical depth avoid severe downstream scrap and regulatory non-compliance costs.
6. Supplier Performance Tiers & Governance Levels +-----------------------------------------------------------------------------------------+
- | SUPPLIER GOVERNANCE HIERARCHY |
- +-----------------------------------------------------------------------------------------+
- | |
- | [ CERTIFIED / DOCK-TO-STOCK ] (95 - 100 pts) ──► Zero receiving inspection; JIT bypass|
- | |
- | [ PREFERRED SUPPLIER ] (85 - 94 pts) ──► Priority for new RFQs; multi-year pact|
- | |
- | [ APPROVED SUPPLIER ] (70 - 84 pts) ──► Baseline status; standard sampling |
- | |
- | [ CONDITIONAL / PROBATION ] (60 - 69 pts) ──► 100% sorting at vendor expense; SCAR |
- | |
- | [ DISQUALIFIED / DE-LISTED ] (< 60 pts) ──► Purged from ASL; no new purchase orders|
- | |
- +-----------------------------------------------------------------------------------------+
Certified / Dock-to-Stock (DTS): Top-tier suppliers with proven C p k ≥ 1.33 C_{pk} \ge 1.33 C p k ≥ 1.33 , zero defects over 12+ consecutive months, and robust QMS. Shipments bypass receiving inspection straight to the line.
Preferred Supplier: Consistently exceeds targets; receives early RFQ access, ESI invitations, and multi-year contract renewals.
Approved Supplier: Meets minimum operational thresholds; maintained on the Approved Supplier List (ASL) subject to routine lot sampling.
Conditional / Probationary: Underperforming vendor; placed on 100% receiving inspection paid by the vendor; executive escalation and formal corrective action plan required within 30 days.
Disqualified / De-Listed: Failed chronic remediation; removed from ASL; barred from future quoting.