Study guide
Resolution, Confidentiality, and Data Integrity
ASQ Certified Calibration Technician CCT
Track your progress as you read
Finished sections get a check mark.
1 SI Definitions and Realizations
The Seven SI Base Units and the 2019 Revision Realizing SI Units in the Laboratory
2 Derived Units, Prefixes, and Constants
Derived Units and Physical Calculations SI Prefixes and Compound-Unit Conversions Physical Constants and Their Applications
3 Measurement Standards and Selection
Types and Roles of Measurement Standards Selecting Standards for an Operational Hierarchy
4 Traceability and Standard Substitution
Traceability Evidence and Impact Review Evaluating and Authorizing Standard Substitution
5 Dimensional and Mechanical Metrology
Linear Displacement and Dimensional Instruments Geometry, Thermal Expansion, and Mass Force, Torque, Pressure, Density, and Viscosity
6 Temperature, Humidity, Volume, and Flow
Temperature Sensors and Thermometer Corrections Humidity, Volume, and Flow
7 Electrical, Optical, and Time Measurements
Voltage, Current, Resistance, and AC Measurement Time, Frequency, Light, Power, and Energy
8 Measurement Methods
Direct, Indirect, and Ratio Methods Transfer, Differential, and UUT Substitution Methods
9 Instrument Characteristics and Measurement Data
Sensitivity, Variability, and Precision Bias, Linearity, Stability, and Hysteresis Data Formats, Readability, and Suitability Resolution, Confidentiality, and Data Integrity
10 Specifications and Error Sources
Interpreting IM&TE Specification Terms Specification Calculations and Operating Qualifiers Instrument, Operator, and Circuit Errors Environmental, Geometric, and Interference Errors
11 Measurement Assurance
Check Standards and Statistical Process Control Proficiency Comparisons and Gage R&R
12 Procedures and Governing Requirements
Procedure Structure and Published Practice Sources Method Development, Deviations, and Handling Regulations, Contracts, and Requirement Precedence
13 Instrument Adjustment and Standardization
Calibration, Zero, and Span Adjustment Linearization, Nulling, and Digital Adjustment
14 Calibration Environment
Temperature and Humidity Control ESD, Dust, Vibration, and Pressure
15 Operations, Roles, and Scheduling
Receiving, As-Found Testing, and Calibration Flow Asset Identification, Tracking, and Release Laboratory Roles and Initial Scheduling Interval Review, Overdue Control, and Workloads
16 Method and Software Validation
Method Verification and Validation Studies Software, Firmware, and Spreadsheet Validation
17 Records and Formal Reporting
Controlled Records and Calibration Certificates Status Labels and Out-of-Tolerance Reporting
18 Uncertainty Concepts and Decision Risk
Error, Uncertainty, and Measurand Definition TAR, TUR, Tolerance Consumption, and Capability Conformity Decisions and False-Accept Risk Guard Bands and Conformity Reporting
19 Uncertainty Models and Budgets
Measurement Models and Uncertainty Contributions Distribution Selection and Budget Assembly
20 Type A and Type B Evaluation
Type A Statistics and Repeatability Outlier Review and Worked Type A Analysis Type B Distribution Models
21 Uncertainty Reporting and Applied Mathematics
Propagation, Covariance, and Effective Degrees of Freedom Coverage Factors and Expanded-Uncertainty Reporting Notation, Unit Conversions, Ratios, and Decibels Rounding, Algebra, Graphs, and Angular Conversions
22 Quality Systems and Tools
Quality-System Components, Planning, and Improvement The Seven Basic Quality Tools
23 Audits and Corrective Action
Audit Types, Planning, and Nonconformance Control Impact Assessment, Root Cause, and Effectiveness
24 Safety, Standards, and Professional Conduct
Electrical, Pressure, Chemical, and Laboratory Hazards PPE, Safety Data Sheets, 6S, and Safe Restoration Quality Standards, GUM, and VIM Accreditation Scope and Professional Ethics
Resolution, Confidentiality, and Data Integrity
Key Takeaways Explain This Topic AI
A uniform rounding-error model with display step q gives standard uncertainty q divided by √12.
Preserve original observations and identify amendments rather than reconstructing records from memory.
ISO/IEC 17025 requires effective information controls, while ALCOA+ and cryptographic implementations are not universal prescribed systems.
Last updated: October 2026
- Resolution, Quantization Error, and Digit Flicker
- Resolution (VIM 4.14)
Resolution is the smallest change in a quantity being measured that causes a perceptible change in the corresponding indication. In a digital device, display resolution commonly corresponds to one Least Significant Digit (LSD) .
Quantization Error and the GUM Formulation
Digital systems convert continuous analog signals into discrete digital counts via an analog-to-digital converter (ADC). Because the true input voltage can sit anywhere within an interval of width d = 1 LSD d = 1\text{ LSD} d = 1 LSD before toggling the display, digital conversion introduces an inescapable quantization error of ± 0.5 LSD \pm 0.5\text{ LSD} ± 0.5 LSD .
A rectangular model over [ − d / 2 , + d / 2 ] [-d/2,+d/2] [ − d /2 , + d /2 ] is a common justified model for rounding to step d d d when no position within a bin is favored. It is not a universal probability law for every ADC, noisy display, or threshold. Assess the indication process and avoid double-counting quantization already represented in observed repeatability.
The standard uncertainty associated with resolution is calculated as: u resolution = a 3 = d / 2 3 = d 2 3 ≈ 0.2887 ⋅ d u_{\text{resolution}} = \frac{a}{\sqrt{3}} = \frac{d / 2}{\sqrt{3}} = \frac{d}{2\sqrt{3}} \approx 0.2887 \cdot d u resolution = 3 a = 3 d /2 = 2 3 d ≈ 0.2887 ⋅ d
Practical Calculation
A digital pressure calibrator reads to 0.001 bar 0.001\text{ bar} 0.001 bar ( d = 0.001 bar d = 0.001\text{ bar} d = 0.001 bar ). The half-width is a = 0.0005 bar a = 0.0005\text{ bar} a = 0.0005 bar . The standard uncertainty contributed to the Type B budget is: u res = 0.001 bar 2 3 = 0.0005 bar 1.732 = 0.000289 bar u_{\text{res}} = \frac{0.001\text{ bar}}{2\sqrt{3}} = \frac{0.0005\text{ bar}}{1.732} = 0.000289\text{ bar} u res = 2 3 0.001 bar = 1.732 0.0005 bar = 0.000289 bar
Digit Flicker (Jitter)
When a measured input sits exactly on the transition boundary between two adjacent quantization codes, electronic thermal noise causes the ADC to toggle rapidly between the two values (e.g., bouncing between 10.004 V 10.004\text{ V} 10.004 V and 10.005 V 10.005\text{ V} 10.005 V ).
Technicians mitigate digit flicker by:
Increasing the ADC integration time to an integer number of power line cycles (e.g., 10 NPLC 10\text{ NPLC} 10 NPLC or 100 NPLC 100\text{ NPLC} 100 NPLC ).
Activating internal digital smoothing (moving-window averaging).
Selecting an instrument range where the reading utilizes the upper portion of the scale, moving the signal further above the ADC noise threshold.
Suitability for Use and Fitness for Purpose
An instrument can possess excellent calibration credentials yet remain completely unsuitable for use if its physical dynamics, operating envelope, or electrical loading characteristics do not match the target application.
Feature Check
Range Use a valid range whose absolute error and resolution suit the task.
Sampling Select adequate bandwidth, sampling rate, and anti-alias filtering.
Loading Evaluate interaction with the source and uncertainty model.
Environment Meet operating and specification conditions.
Operating range
A 20–80% rule can be a useful heuristic for some analog instruments, but it is not universal. Modern meters can specify valid performance near full scale and at low readings. Choose the range by its complete reading, range, count, floor, bandwidth, and overload terms. A 0.01 V absolute bound on a 100 V range is 1% of a 1 V reading, even though it is only 0.01% of range. Compare that bound with the task requirement.
Circuit Loading and Impedance Matching
Loading must be evaluated and limited or corrected to meet the measurement requirement:
Voltage Measurements: The voltmeter's input resistance ( R in R_{\text{in}} R in ) forms a voltage divider with the source resistance ( R s R_s R s ). To keep the loading error below 0.1 % 0.1\% 0.1% ( 1000 ppm 1000\text{ ppm} 1000 ppm ), the instrument's input impedance must satisfy: R in ≥ 1000 ⋅ R s R_{\text{in}} \ge 1000 \cdot R_s R in ≥ 1000 ⋅ R s
RF and Microwave Connections: Transmission lines require matched characteristic impedances ( Z 0 = 50 Ω Z_0 = 50\ \Omega Z 0 = 50 Ω or 75 Ω 75\ \Omega 75 Ω ). Mismatches cause standing-wave reflections governed by the voltage reflection coefficient: Γ = Z L − Z 0 Z L + Z 0 \Gamma = \frac{Z_L - Z_0}{Z_L + Z_0} Γ = Z L + Z 0 Z L − Z 0
Reflected power introduces severe ripple in frequency response calibrations.
- Confidentiality, Data Integrity, and Metrological Compliance
- ISO/IEC 17025:2017 Requirements
Data management is strictly regulated under international calibration laboratory standards:
Confidentiality: Protect customer information under enforceable commitments and law. Information already made public by the customer or agreed for release has specific treatment. Required or authorized disclosure can require notification unless prohibited by law; confidentiality is not subject only to a law exception.
Clause 7.11 (Control of data and information management): Laboratory Information Management Systems (LIMS), custom calibration software, and automated calculation spreadsheets (e.g., Excel workbooks) must be fully validated for functionality prior to use. Protect calculations and records from unauthorized changes and loss through validated, effective controls; cell locking is one implementation.
The ALCOA+ Framework in the Calibration Laboratory
Originally developed in regulated life sciences (FDA/cGMP), the ALCOA+ framework represents global best practice for data integrity in ISO/IEC 17025 accredited metrology:
The acronym means attributable, legible, contemporaneous, original, and accurate. Added principles are complete, consistent, enduring, and available. Legibility includes interpretable units and identifiers; completeness preserves required failing observations as well as passing ones. Consistency preserves chronological meaning, endurance protects records for the required period, and availability permits authorized retrieval.
Attributable: Link observations and approvals to the responsible person or automated system.
Contemporaneous: Record observations when made. Controlled paper notes can be valid original records if preserved and incorporated into the technical record. Transcription from memory or discarding the original is unacceptable.
Original: Preserve original observations and traceable amendments.
Accurate: Record available as-found and as-left information honestly and identify unavailable tests or unsafe conditions.
ALCOA+ is a useful data-integrity framework, especially in regulated environments; it is not a named mandatory ISO/IEC 17025 system. Cryptographic signatures and FDA Part 11 controls apply as required by the actual record scope and system, not automatically to every calibration.
Keep original observations and preserve an amendment history identifying the changed values, person, date, and reason where needed. Electronic controls must protect integrity, access, and recovery. An immutable database or UTC timestamp convention is one implementation choice, not a universal ISO prescription. FDA electronic-record requirements apply only when the relevant regulated records are in scope.
Hardcopy Error Correction Protocols
When recording calibration data on physical paper bench sheets, technicians must adhere to strict good documentation practices (GDP):
The technician draws a single horizontal strikethrough line through the erroneous reading, ensuring the original value remains completely legible.
The correct value is written immediately adjacent to the strikethrough.
The correction is immediately initialed, dated, and accompanied by a brief explanation code (e.g., "transcription error" or "scale typo" ).
The use of correction fluid (white-out), erasers, or obliteration scribbles is strictly prohibited in accredited calibration facilities.