Study guide
4.2 Data Sampling, Accuracy/Precision, and A/D Conversion
FE Other Disciplines Fundamentals of Engineering
Track your progress as you read
Finished sections get a check mark.
1 Introduction & Exam Strategy
About the FE Other Disciplines Exam How to Use This Study Guide
2 Chapter 1: Mathematics
1.1 Analytic Geometry, Trigonometry, and Vector Operations 1.2 Differential and Integral Calculus 1.3 Ordinary Differential Equations and Laplace Transforms 1.4 Linear Algebra, Matrices, and Systems of Equations 1.5 Numerical Methods, Root-Finding, and Numerical Integration
3 Chapter 2: Probability and Statistics
2.1 Probability Distributions, PMFs, and PDFs 2.2 Expected Value, Mean, Variance, and Descriptive Statistics 2.3 Estimation, Confidence Intervals, and Sample Sizes 2.4 Hypothesis Testing, Goodness of Fit, and Linear Regression
4 Chapter 3: Chemistry
3.1 Stoichiometry, Chemical Reactions, and Solutions 3.2 Chemical Equilibrium, Acids/Bases, and Ideal Gas Laws 3.3 Oxidation-Reduction, Electrochemistry, and Corrosion Basics
5 Chapter 4: Instrumentation and Controls
4.1 Sensors, Transducers, and Signal Conditioning 4.2 Data Sampling, Accuracy/Precision, and A/D Conversion 4.3 Logic Diagrams, Boolean Algebra, and Control Logic
6 Chapter 5: Engineering Ethics and Societal Impacts
5.1 NCEES Model Rules of Professional Conduct and Codes of Ethics 5.2 Public Protection, Licensure Boards, and Professional Liability 5.3 Societal Impacts: Sustainability, Life-Cycle Analysis, and Public Safety
7 Chapter 6: Safety, Health, and Environment
6.1 OSHA Regulations, Industrial Hygiene, and PPE 6.2 Hazard Assessment, Risk Management, and Environmental Rules 6.3 Gas Detection and Monitoring 6.4 Electrical Safety 6.5 Confined Space Entry and Ventilation Rates
8 Chapter 7: Engineering Economics
7.1 Time Value of Money, Interest Formulas, and Cash Flow Diagrams 7.2 Capital Budgeting: Present Worth, Annual Worth, IRR, and B/C Ratio 7.3 Depreciation Methods, Income Taxes, and Breakeven Analysis 7.4 Cost Analysis, Uncertainty, Expected Value, and Decision Trees
9 Chapter 8: Statics
8.1 Statics Equilibrium, Free-Body Diagrams, and Force Systems 8.2 Distributed Loads, Resultants, and Equivalent Force-Couple Systems 8.3 Internal Forces in Rigid Bodies: Trusses, Frames, Machines, and Friction 8.4 Three-Dimensional Equilibrium, Cables, and Pulley Systems 8.5 Area Properties: Centroids, Moments of Inertia, and Radius of Gyration 8.6 Weight, Mass, and Force Units: slug, lbm, lbf, and g_c
10 Chapter 9: Dynamics
9.1 Kinematics of Particles and Rigid Bodies 9.2 Newton's Second Law for Particles and Rigid Bodies 9.3 Angular Motion, Torque, and Mass Moment of Inertia 9.4 Work-Energy Principle, Power, and Efficiency 9.5 Impulse-Momentum, Impact, and Coefficient of Restitution 9.6 Dynamic Friction and Vibrations: Natural Frequency and Damping
11 Chapter 10: Strength of Materials
10.1 Stress Types, Axial Stress-Strain, and Thermal Deformation 10.2 Torsion of Circular Shafts, Polar Moment, and Angle of Twist 10.3 Shear and Moment Diagrams 10.4 Flexural Bending Stress and Transverse Shear Stress 10.5 Stress Transformations, Principal Stresses, and Mohr's Circle 10.6 Beam Deflections and Combined Axial/Bending Loading 10.7 Column Buckling (Euler Formula) and Yield/Failure Criteria
12 Chapter 11: Materials
11.1 Crystal Structure, Phase Diagrams, and Material Processing 11.2 Mechanical Properties, Fatigue, Fracture, and Corrosion 11.3 Thermal Properties of Materials 11.4 Electrical and Chemical Properties of Materials 11.5 Material Selection for Engineering Design
13 Chapter 12: Fluid Mechanics
12.1 Fluid Properties, Hydrostatic Pressure, and Manometry 12.2 Dimensionless Numbers and Flow Regimes 12.3 Continuity Equation, Bernoulli Equation, and Energy Equation 12.4 Impulse-Momentum Equation and Forces on Control Volumes 12.5 Flow in Pipes, Friction Factors (Moody Diagram), and Head Losses 12.6 Turbomachinery: Pumps, Turbines, Fans, and Compressors 12.7 Open-Channel Flow, Manning's Equation, and Drag 12.8 Fluid Transport Systems and Flow Measurement 12.9 Ideal Gas Law, Gas Mixtures, and the Real Gas Law
14 Chapter 13: Basic Electrical Engineering
13.1 Electrical Fundamentals, Ohm's Law, and DC Circuits 13.2 AC Circuits, Phasors, Impedance, and Three-Phase Power 13.3 Magnetic Fields, Induction, Transformers, and Motor Efficiency 13.4 Electrical Measuring Devices: Voltmeter, Ammeter, and Wattmeter
15 Chapter 14: Thermodynamics and Heat Transfer
14.1 First & Second Laws of Thermodynamics and Pure Substance Properties 14.2 Thermodynamic Processes and Property Diagrams (T-s, P-h, P-v) 14.3 Heat Transfer: Conduction, Convection, and Radiation 14.4 Ideal Gas Processes and Power/Refrigeration Cycles 14.5 Mass and Energy Balances on Control Volumes 14.6 Combustion and Combustion Products 14.7 Psychrometrics: Relative Humidity, Wet-Bulb Temperature, and the Psychrometric Chart
4.2 Data Sampling, Accuracy/Precision, and A/D Conversion
Key Takeaways Explain This Topic AI
The Nyquist-Shannon sampling theorem mandates that the sampling frequency f_s must be at least twice the highest frequency component of the analog signal (f_s >= 2 f_max) to prevent aliasing.
Signal components above the Nyquist frequency (f_s / 2) fold back into the baseband spectrum as false low-frequency aliases given by f_alias = |f_in - k f_s|, requiring analog anti-aliasing low-pass filters prior to digitization.
An n-bit Analog-to-Digital Converter (ADC) divides the full-scale voltage range (V_FSR) into 2^n quantization levels, yielding a minimum resolution step size of LSB = V_FSR / 2^n and a maximum ideal quantization error of ± LSB / 2.
Theoretical Signal-to-Quantization-Noise Ratio (SQNR) increases by approximately 6.02 dB per bit of ADC resolution (SQNR = 6.02 n + 1.76 dB).
Experimental measurement uncertainty combines systematic bias (reproducible calibration offsets) and random noise (statistical standard deviation of the mean) using Root-Sum-Square (RSS) error propagation.
Last updated: August 2026
4.2 Data Sampling, Accuracy/Precision, and A/D Conversion
Core Concept: Data acquisition (DAQ) bridges the physical analog domain and the digital processing domain. To capture dynamic physical signals without distortion, engineers must master the Nyquist-Shannon sampling theorem, anti-aliasing filtering, analog-to-digital converter (ADC) quantization limits, and statistical uncertainty analysis.
Nyquist-Shannon Sampling Theorem & Aliasing
When a continuous analog signal x ( t ) x(t) x ( t ) is sampled at discrete time intervals T s = 1 / f s T_s = 1/f_s T s = 1/ f s , the continuous frequency spectrum is periodicized at intervals of f s f_s f s .
The Nyquist Criterion
To ensure complete, unambiguous reconstruction of a continuous signal from its discrete samples, the sampling frequency f s f_s f s must be at least twice the maximum frequency component ( f m a x f_{max} f ma x ) present in the signal: f s ≥ 2 f m a x f_s \ge 2 f_{max} f s ≥ 2 f ma x
Nyquist Frequency ( f N f_N f N ): The upper frequency boundary of the un-aliased baseband, defined as half the sampling rate: f N = f s 2 f_N = \frac{f_s}{2} f N = 2 f s Continuous Analog Spectrum Sampled Spectrum at f_s
- | | | |
- --|----------------------|--- ---|-------------------|---
- f_max +f_max -f_s/2 0 +f_s/2 (Nyquist limit)
- Aliasing Mathematics
If the analog signal contains high-frequency components exceeding the Nyquist limit ( f i n > f s / 2 f_{in} > f_s / 2 f in > f s /2 ), those components fold back into the baseband spectrum [ 0 , f s / 2 ] [0, f_s/2] [ 0 , f s /2 ] and appear artificially as low-frequency signals known as aliases .
The apparent frequency ( f a l i a s f_{alias} f a l ia s ) of an aliased component is calculated by: f a l i a s = ∣ f i n − k f s ∣ f_{alias} = |f_{in} - k f_s| f a l ia s = ∣ f in − k f s ∣
where k k k is an integer chosen such that 0 ≤ f a l i a s ≤ f s 2 0 \le f_{alias} \le \frac{f_s}{2} 0 ≤ f a l ia s ≤ 2 f s .
Anti-Aliasing Low-Pass Filters
Because real-world sensor signals contain high-frequency noise and harmonics, an analog anti-aliasing low-pass filter must be placed before the sample-and-hold circuit and ADC. The filter corner frequency f c f_c f c is selected near f m a x f_{max} f ma x , sharply attenuating all spectral components above f s / 2 f_s/2 f s /2 .
Analog-to-Digital Converter (ADC) Performance Metrics
An Analog-to-Digital Converter (ADC) converts a continuous voltage V i n V_{in} V in within a Full-Scale Voltage Range ( V F S R = V m a x − V m i n V_{FSR} = V_{max} - V_{min} V FSR = V ma x − V min ) into an n n n -bit digital code.
Key Quantization Equations
Number of Discrete Levels ( N N N ): N = 2 n N = 2^n N = 2 n
Quantization Step Size / Least Significant Bit (LSB / Δ V \Delta V Δ V ): Δ V = Q = V F S R 2 n = V m a x − V m i n 2 n \Delta V = Q = \frac{V_{FSR}}{2^n} = \frac{V_{max} - V_{min}}{2^n} Δ V = Q = 2 n V FSR = 2 n V ma x − V min
Maximum Ideal Quantization Error ( e q e_q e q ): e q = ± Δ V 2 = ± V F S R 2 n + 1 e_q = \pm \frac{\Delta V}{2} = \pm \frac{V_{FSR}}{2^{n+1}} e q = ± 2 Δ V = ± 2 n + 1 V FSR
Signal-to-Quantization-Noise Ratio (SQNR): Assuming a full-scale sinusoidal input, theoretical SQNR in decibels is: SQNR (dB) = 6.02 n + 1.76 , dB \text{SQNR (dB)} = 6.02 n + 1.76\\,\text{dB} SQNR (dB) = 6.02 n + 1.76 , dB
Key Takeaway: Each additional bit of ADC resolution improves the signal-to-noise ratio by approximately 6.02 , dB 6.02\\,\text{dB} 6.02 , dB (a factor of 2 2 2 in voltage resolution).
Digital Output Code Computation ( D D D ): For a unipolar ADC ( 0 0 0 to V F S R V_{FSR} V FSR ): D = floor ( V i n − V m i n Δ V ) = floor ( V i n − V m i n V F S R ⋅ 2 n ) D = \text{floor}\left( \frac{V_{in} - V_{min}}{\Delta V} \right) = \text{floor}\left( \frac{V_{in} - V_{min}}{V_{FSR}} \cdot 2^n \right) D = floor ( Δ V V in − V min ) = floor ( V FSR V in − V min ⋅ 2 n )
Common ADC Architecture Types
ADC Type Conversion Speed Resolution ( n n n ) Dominant Characteristics & Use Case
Flash (Parallel) Ultra-Fast ( > 1 , GSPS > 1\\,\text{GSPS} > 1 , GSPS ) Low ( 6 – 8 6\text{--}8 6 – 8 bits) Uses 2 n − 1 2^n - 1 2 n − 1 parallel comparators. High power and cost. Oscilloscopes, radar.
Successive Approximation (SAR) Fast ( 100 , kSPS to 10 , MSPS 100\\,\text{kSPS} \text{ to } 10\\,\text{MSPS} 100 , kSPS to 10 , MSPS ) Medium ( 10 – 18 10\text{--}18 10 – 18 bits) Binary search algorithm using DAC and comparator. Standard choice for microcontroller DAQ systems.
Sigma-Delta ( Σ Δ \Sigma\Delta ΣΔ ) Slow to Moderate ( < 1 , MSPS < 1\\,\text{MSPS} < 1 , MSPS ) High ( 16 – 24 + 16\text{--}24+ 16 – 24 + bits) Over-sampling, noise shaping, digital filtering. Precision weigh scales, audio, RTD instrumentation.
Dual-Slope (Integrating) Slow ( 10 – 100 , Hz 10\text{--}100\\,\text{Hz} 10 – 100 , Hz ) Very High ( 16 – 20 16\text{--}20 16 – 20 bits) Integrates input voltage against reference. High noise rejection (50/60 Hz line rejection). Digital multimeters.
- Accuracy, Precision, and Statistical Error Propagation
- Accuracy vs. Precision
Accuracy: The degree of closeness between a measured value and the true, accepted reference value. Inaccuracy is caused by systematic errors (bias) such as calibration shifts, zero offsets, or uncompensated thermal drift.
Precision: The repeatability or mutual agreement among independent measurements taken under identical conditions. Imprecision is driven by random errors (noise) such as thermal Johnson noise or electromagnetic interference. High Accuracy, High Precision Low Accuracy, High Precision (Bias)
- +-----------+ +-----------+
- | ( (O) ) | | (O) |
- | (OO) | | (OO) |
- +-----------+ +-----------+
- Statistical Measures of Random Errors
For N N N repeated measurements of a variable x x x :
Sample Mean ( x ˉ \bar{x} x ˉ ): x ˉ = 1 N ∑ i = 1 N x i \bar{x} = \frac{1}{N} \sum_{i=1}^N x_i x ˉ = N 1 i = 1 ∑ N x i
Sample Standard Deviation ( s s s ): s = 1 N − 1 ∑ i = 1 N ( x i − x ˉ ) 2 s = \sqrt{\frac{1}{N - 1} \sum_{i=1}^N (x_i - \bar{x})^2} s = N − 1 1 i = 1 ∑ N ( x i − x ˉ ) 2
Standard Uncertainty of the Mean ( u x ˉ u_{\bar{x}} u x ˉ ): u x ˉ = s N u_{\bar{x}} = \frac{s}{\sqrt{N}} u x ˉ = N s
Error Propagation (Root-Sum-Square Law)
When a derived engineering parameter R R R is calculated from independent measured variables x 1 , x 2 , … , x k x_1, x_2, \dots, x_k x 1 , x 2 , … , x k according to a functional relationship R = f ( x 1 , x 2 , … , x k ) R = f(x_1, x_2, \dots, x_k) R = f ( x 1 , x 2 , … , x k ) , the combined standard uncertainty u R u_R u R is evaluated using partial derivative sensitivity coefficients: ν R = ∑ i = 1 k ( ∂ f ∂ x i u x i ) 2 = ( ∂ f ∂ x 1 u x 1 ) 2 + ( ∂ f ∂ x 2 u x 2 ) 2 + ⋯ + ( ∂ f ∂ x k u x k ) 2 \nu_R = \sqrt{\sum_{i=1}^k \left( \frac{\partial f}{\partial x_i} u_{x_i} \right)^2} = \sqrt{ \left(\frac{\partial f}{\partial x_1} u_{x_1}\right)^2 + \left(\frac{\partial f}{\partial x_2} u_{x_2}\right)^2 + \dots + \left(\frac{\partial f}{\partial x_k} u_{x_k}\right)^2 } ν R = i = 1 ∑ k ( ∂ x i ∂ f u x i ) 2 = ( ∂ x 1 ∂ f u x 1 ) 2 + ( ∂ x 2 ∂ f u x 2 ) 2 + ⋯ + ( ∂ x k ∂ f u x k ) 2
- Digital-to-Analog Converters (DAC) & Signal Reconstruction
- DAC Functionality & Architectures
A Digital-to-Analog Converter (DAC) performs the inverse operation of an ADC, mapping an n n n -bit digital binary word into a proportional continuous analog output voltage: V o u t = V m i n + D ⋅ ( V F S R 2 n ) V_{out} = V_{min} + D \cdot \left( \frac{V_{FSR}}{2^n} \right) V o u t = V min + D ⋅ ( 2 n V FSR )
Binary Weighted Resistor DAC: Uses parallel resistors scaled as R , 2 R , 4 R , 8 R , … , 2 n − 1 R R, 2R, 4R, 8R, \dots, 2^{n-1}R R , 2 R , 4 R , 8 R , … , 2 n − 1 R connected to an inverting summing amplifier. Simple concept, but requires impractically wide resistor precision ratios for high resolution.
R-2R Ladder Network DAC: Uses only two resistor values ( R R R and 2 R 2R 2 R ) arranged in a repeating ladder topology. Easily fabricated in integrated circuits and widely used in precision motion control and audio playback.
Signal Reconstruction & Zero-Order Hold (ZOH)
The raw output of a DAC forms a discrete staircase waveform (Zero-Order Hold). An analog smoothing low-pass reconstruction filter is applied at the DAC output to eliminate high-frequency staircase steps and restore a smooth continuous waveform.
- Worked Engineering Examples: Sampling & ADC Analysis
- Problem 1: ADC Resolution, Quantization Error, and Code Calculation
Scenario: A 12-bit data acquisition system operates over a full-scale voltage range of 0.00 , V 0.00\\,\text{V} 0.00 , V to 10.00 , V 10.00\\,\text{V} 10.00 , V ( V F S R = 10.00 , V V_{FSR} = 10.00\\,\text{V} V FSR = 10.00 , V ).
Calculate the LSB voltage step size ( Δ V \Delta V Δ V ) and the maximum ideal quantization error e q e_q e q .
Calculate the theoretical Signal-to-Quantization-Noise Ratio (SQNR) in decibels.
Determine the output digital decimal code D D D and quantized voltage for an analog input of V i n = 6.345 , V V_{in} = 6.345\\,\text{V} V in = 6.345 , V .
Solution:
Calculate LSB Step Size and Quantization Error: Δ V = V F S R 2 n = 10.00 , V 2 12 = 10.00 4096 ≈ 2.4414 × 10 − 3 , V = 2.4414 , mV \Delta V = \frac{V_{FSR}}{2^n} = \frac{10.00\\,\text{V}}{2^{12}} = \frac{10.00}{4096} \approx 2.4414 \times 10^{-3}\\,\text{V} = 2.4414\\,\text{mV} Δ V = 2 n V FSR = 2 12 10.00 , V = 4096 10.00 ≈ 2.4414 × 1 0 − 3 , V = 2.4414 , mV ≠ q = ± Δ V 2 = ± 2.4414 , mV 2 = ± 1.2207 , mV \ne_q = \pm \frac{\Delta V}{2} = \pm \frac{2.4414\\,\text{mV}}{2} = \pm 1.2207\\,\text{mV} = q = ± 2 Δ V = ± 2 2.4414 , mV = ± 1.2207 , mV
Calculate SQNR: SQNR = 6.02 n + 1.76 = 6.02 ( 12 ) + 1.76 = 72.24 + 1.76 = 74.00 , dB \text{SQNR} = 6.02 n + 1.76 = 6.02(12) + 1.76 = 72.24 + 1.76 = 74.00\\,\text{dB} SQNR = 6.02 n + 1.76 = 6.02 ( 12 ) + 1.76 = 72.24 + 1.76 = 74.00 , dB
Determine Digital Code and Quantized Voltage: D = floor ( V i n Δ V ) = floor ( 6.345 , V 0.0024414 , V ) = floor ( 2598.88 ) = 2598 D = \text{floor}\left( \frac{V_{in}}{\Delta V} \right) = \text{floor}\left( \frac{6.345\\,\text{V}}{0.0024414\\,\text{V}} \right) = \text{floor}(2598.88) = 2598 D = floor ( Δ V V in ) = floor ( 0.0024414 , V 6.345 , V ) = floor ( 2598.88 ) = 2598 V q u a n t i z e d = D ⋅ Δ V = 2598 × 2.44141 , mV = 6.3428 , V V_{quantized} = D \cdot \Delta V = 2598 \times 2.44141\\,\text{mV} = 6.3428\\,\text{V} V q u an t i ze d = D ⋅ Δ V = 2598 × 2.44141 , mV = 6.3428 , V
Problem 2: Nyquist Frequency and Aliasing Calculation
Scenario: An industrial machine vibration sensor produces a complex signal with frequency components at f 1 = 80 , Hz f_1 = 80\\,\text{Hz} f 1 = 80 , Hz , f 2 = 180 , Hz f_2 = 180\\,\text{Hz} f 2 = 180 , Hz , and f 3 = 380 , Hz f_3 = 380\\,\text{Hz} f 3 = 380 , Hz . The signal is sampled at f s = 500 , Hz f_s = 500\\,\text{Hz} f s = 500 , Hz without an anti-aliasing filter.
Calculate the Nyquist frequency f N f_N f N .
Identify which frequency components alias.
Determine the apparent alias frequency recorded in the digital dataset for any aliased component.
Solution:
Calculate Nyquist Limit: f N = f s 2 = 500 , Hz 2 = 250 , Hz f_N = \frac{f_s}{2} = \frac{500\\,\text{Hz}}{2} = 250\\,\text{Hz} f N = 2 f s = 2 500 , Hz = 250 , Hz
Evaluate Components for Aliasing:
f 1 = 80 , Hz ≤ 250 , Hz ⟹ Sampled accurately without aliasing. f_1 = 80\\,\text{Hz} \le 250\\,\text{Hz} \implies \text{Sampled accurately without aliasing.} f 1 = 80 , Hz ≤ 250 , Hz ⟹ Sampled accurately without aliasing.
f 2 = 180 , Hz ≤ 250 , Hz ⟹ Sampled accurately without aliasing. f_2 = 180\\,\text{Hz} \le 250\\,\text{Hz} \implies \text{Sampled accurately without aliasing.} f 2 = 180 , Hz ≤ 250 , Hz ⟹ Sampled accurately without aliasing.
f 3 = 380 , Hz > 250 , Hz ⟹ W i l l a l i a s ! f_3 = 380\\,\text{Hz} > 250\\,\text{Hz} \implies \mathbf{Will\\ alias!} f 3 = 380 , Hz > 250 , Hz ⟹ Will alias !
Calculate Apparent Alias Frequency: f a l i a s = ∣ f 3 − k f s ∣ = ∣ 380 , Hz − 1 ( 500 , Hz ) ∣ = ∣ − 120 , Hz ∣ = 120 , Hz f_{alias} = |f_3 - k f_s| = |380\\,\text{Hz} - 1(500\\,\text{Hz})| = |-120\\,\text{Hz}| = 120\\,\text{Hz} f a l ia s = ∣ f 3 − k f s ∣ = ∣380 , Hz − 1 ( 500 , Hz ) ∣ = ∣ − 120 , Hz ∣ = 120 , Hz
Engineering Insight: The 380 , Hz 380\\,\text{Hz} 380 , Hz vibration harmonic folds back into the spectrum and appears erroneously as a 120 , Hz 120\\,\text{Hz} 120 , Hz signal, potentially leading to false diagnostic conclusions unless an anti-aliasing filter cutting off near 200 – 250 , Hz 200\text{--}250\\,\text{Hz} 200 – 250 , Hz is installed.