Study guide

6.3 Measurement Systems & Key Performance Indicators

ASQ Certified Manager of Quality/Organizational Excellence CMQ/OE

Track your progress as you read

Finished sections get a check mark.

1 Chapter 0: Introduction & Exam Overview

0.1 Current CMQ/OE Exam Facts 0.2 Study Strategy by BoK Weight

2 Chapter 1: Leadership Principles & Organizational Structures

1.1 Leadership Theories & Styles 1.2 Organizational Structures & Matrix Management 1.3 Change Management Models & Strategies 1.4 Organizational Culture & Quality Governance

3 Chapter 2: Teams, Facilitation & Ethics

2.1 Team Formation & Development Stages 2.2 Facilitation Techniques & Team Empowerment 2.3 Conflict Resolution & Negotiation Strategies 2.4 ASQ Code of Ethics & Legal Compliance

4 Chapter 3: Strategic Planning & Environmental Analysis

3.1 Strategic Planning Models & Environmental Scans 3.2 Strategic Risk Management & Scenario Planning 3.3 Portfolio Management & Strategic Project Alignment

5 Chapter 4: Policy Deployment & Performance Alignment

4.1 Hoshin Kanri & Catchball Process 4.2 Benchmarking & Competitive Analysis 4.3 Knowledge Management & Best Practice Transfer

6 Chapter 5: Quality Management Systems & Cost of Quality

5.1 Quality Management System (QMS) Frameworks 5.2 Cost of Quality (COQ) Models 5.3 Process Management & Business Process Reengineering 5.4 Management Theories, Styles & Emotional Intelligence 5.5 Communication Skills for Quality Managers 5.6 Project Management for Quality Leaders

7 Chapter 6: Quality Improvement Frameworks & Auditing

6.1 Continuous Improvement Frameworks 6.2 Quality Auditing & Compliance Management 6.3 Measurement Systems & Key Performance Indicators

8 Chapter 7: Seven Basic & Management Quality Tools

7.1 The Seven Basic Quality Tools 7.2 The Seven Management & Planning Tools

9 Chapter 8: Advanced Problem Solving & Risk Analysis

8.1 Failure Mode and Effects Analysis (FMEA) 8.2 Quality Function Deployment (QFD) & House of Quality 8.3 Statistical Process Control & Process Capability 8.4 Lean Tools & Theory of Constraints 8.5 Sampling, MSA & Reliability Terminology

10 Chapter 9: Customer-Focused Organizations & VOC

9.1 Voice of the Customer & Kano Model 9.2 Customer Satisfaction, Loyalty & NPS Metrics 9.3 Customer Relationship Management & Complaint Resolution 9.4 Internal Customers, Segmentation & Multi-Customer Management

11 Chapter 10: Supply Chain Quality Management

10.1 Supplier Qualification, Selection & Evaluation 10.2 Supply Chain Risk Management & Logistics Alignment 10.3 Supplier Audits & Scorecard Systems 10.4 Supplier Risk Management & Communications

12 Chapter 11: Training and Workforce Development

11.1 Training Needs Analysis & Competency Modeling 11.2 Adult Learning Principles & Instructional Design 11.3 Training Program Evaluation & Effectiveness Tracking

6.3 Measurement Systems & Key Performance Indicators

Key Takeaways Explain This Topic AI

The Balanced Scorecard (BSC) framework translates strategic vision into action across four balanced perspectives: Financial, Customer, Internal Business Processes, and Learning & Growth.

Lagging indicators measure historical outcomes (e.g., revenue, annual scrap rate), while leading indicators measure upstream process drivers (e.g., preventive maintenance adherence, employee training completion) that predict future performance.

Effective Key Performance Indicators (KPIs) adhere to SMART criteria: Specific, Measurable, Achievable, Relevant, and Time-bound.

KPI cascading ensures executive strategic objectives are systematically aligned downward into departmental metrics and operational line-level performance indicators.

Goodhart's Law warns that when a performance metric becomes a target, it risks losing its validity due to metric gaming and unintended behavioral side-effects.

Last updated: July 2026

Measurement Systems & Key Performance Indicators

A foundational axiom of quality management, often attributed to Lord Kelvin and popularized by Peter Drucker, states: "What gets measured gets managed." However, modern quality managers recognize that measuring the wrong parameters—or measuring without strategic alignment—can actively misdirect organizational energy and degrade performance. To lead organizational excellence, CMQ/OE candidates must design measurement systems that balance financial outcomes with operational process health and employee capabilities.

The Balanced Scorecard (BSC) Framework

Developed by Dr. Robert Kaplan and Dr. David Norton in the early 1990s, the Balanced Scorecard (BSC) revolutionized performance measurement by complementing traditional financial metrics with non-financial operational drivers. The BSC prevents organizations from sacrificing long-term capabilities for short-term financial gains. ┌─────────────────────────────┐

  • │ STRATEGY & VISION │
  • └──────────────┬──────────────┘
  • │
  • ┌──────────────────┬───────────┴───────────┬──────────────────┐
  • ▼ ▼ ▼ ▼
  • ┌─────────────────┐┌─────────────────┐ ┌─────────────────┐┌─────────────────┐
  • │ FINANCIAL ││ CUSTOMER │ │INTERNAL PROCESS ││LEARNING & GROWTH│
  • │ How do we look ││ How do customers│ │ What processes ││ How can we │
  • │ to shareholders?││ view us? │ │ must excel? ││ improve & grow? │
  • └─────────────────┘└─────────────────┘ └─────────────────┘└─────────────────┘
  • The Four Perspectives of the Balanced Scorecard

Perspective Focus & Strategic Question Example Key Performance Indicators (KPIs)

Financial "To succeed financially, how should we appear to our shareholders?" Return on Investment (ROI), Profit Margins, Revenue Growth Rate, Economic Value Added (EVA), Cost of Poor Quality (COPQ).

Customer "To achieve our vision, how should we appear to our customers?" Customer Satisfaction Score (CSAT), Net Promoter Score (NPS), Customer Retention Rate, On-Time Delivery (OTD), Market Share.

Internal Business Processes "To satisfy our shareholders and customers, what business processes must we excel at?" First Pass Yield (FPY), Process Cycle Time, Defect Rate (DPMO), Scrap/Rework Percentage, Equipment Overall Effectiveness (OEE).

Learning & Growth "To achieve our vision, how will we sustain our ability to change and improve?" Employee Training Hours per FTE, Internal Audit Completion, Cross-Training Matrix Ratio, Employee Turnover Rate, Innovation Index.

Exam Tip: ASQ exam questions frequently ask candidates to classify metrics into the four BSC perspectives. Remember that employee training, safety culture, and organizational technology fall under Learning & Growth , while process cycle time and manufacturing scrap belong to Internal Business Processes .

Leading vs. Lagging Indicators

A robust measurement system must maintain a deliberate balance between lagging and leading indicators. Leading Indicators ──► Operational Driver ──► Lagging Indicators

  • (Input/Process) (Outcome/Result)
  • [e.g., PM Schedule Compliance] [e.g., Equipment Failure Rate]
  • Lagging Indicators (Outcome Metrics)

Definition: Measures of results after an event or operational period has concluded. They record historical performance outcomes.

Characteristics: Highly accurate, objective, easy to measure, but reactive. By the time a lagging metric changes, the underlying operational events have already occurred.

Examples: Quarter-end net profit, customer defect return rate, annual employee turnover count, total OSHA recordable injury rate.

Leading Indicators (Predictive Metrics)

Definition: Measures of operational inputs, process drivers, or precursor activities that predict future outcome performance.

Characteristics: Actionable, forward-looking, proactive, but often harder to measure or establish direct mathematical correlation with outcomes.

Examples: Preventive maintenance schedule compliance %, employee safety audit completion %, 5S audit scores, design review completion rate.

Predictive Relationship Example

  • Operational Domain Leading Indicator (Input Driver) Lagging Indicator (Outcome Result)
  • Workplace Safety Safety hazard observation submissions / week Total Recordable Incident Rate (TRIR)
  • Manufacturing Quality % of operators certified on standard work In-process rework and customer warranty claims
  • Equipment Reliability % of planned preventive maintenance completed on time Unplanned equipment downtime hours
  • KPI Selection and Strategic Cascade

Metrics must not exist in isolation; they must form an unbroken chain of alignment from executive leadership down to individual front-line operators.

SMART KPI Criteria

Every KPI established within an organization should satisfy the SMART criteria:

Specific: Clear, precise, and targeted to a single operational focus.

Measurable: Quantifiable using reliable objective data source streams.

Achievable: Realistic and attainable given current resources and capability.

Relevant: Directly aligned with high-level enterprise strategic goals.

Time-bound: Defined within a specific timeframe or reporting frequency.

  • The Metric Cascade Mechanism EXECUTIVE LEVEL
  • Strategic Goal: Reduce Cost of Poor Quality (COPQ) by 15% YoY
  • │
  • ▼
  • PLANT / DIVISION LEVEL
  • Operational KPI: Increase First Pass Yield (FPY) from 91% to 97%
  • │
  • ▼
  • DEPARTMENT / LINE LEVEL
  • Process Metric: Reduce Machining Scrap Rate to < 1.5%
  • │
  • ▼
  • OPERATOR / CELL LEVEL
  • Daily Control: Complete hourly tool wear inspection & SPC charting

Through this cascading structure, a operator conducting an hourly tool inspection understands exactly how their daily compliance directly supports the enterprise goal of reducing COPQ.

Measurement System Integrity and Pitfalls

Even well-designed metrics can produce unintended negative behaviors if not governed properly.

  • Goodhart's Law & Metric Gaming
  • Goodhart's Law states: "When a measure becomes a target, it ceases to be a good measure."

When management attaches high-stakes rewards or punishments exclusively to a single target metric without counterbalancing controls, employees may game the system:

Example: If a customer support center measures managers solely on Average Handle Time (AHT) , agents may rush customers off the phone or hang up on complex calls to lower their average time—drastically damaging Customer Satisfaction (CSAT) .

Countermeasure: Always pair speed/volume metrics with quality/accuracy balancing metrics (e.g., pair Call Handle Time with First Contact Resolution Rate).

Measurement System Analysis (MSA)

Before relying on any metric for decision making, the measurement system itself must be validated. A Gauge Repeatability & Reproducibility (Gauge R&R) study evaluates:

Repeatability (Equipment Variation): Variation obtained when one operator uses the same gauge to measure the same part multiple times.

Reproducibility (Appraiser Variation): Variation obtained when different operators measure the same part using the same gauge.

Balanced Scorecard Perspective Weightings in Enterprise Quality