Study guide
5.2 Analytical Data Evaluation: Errors, Uncertainty, Statistics, and Calibration
PRC Chemist Licensure Examination Exam
Track your progress as you read
Finished sections get a check mark.
1 Chapter 1: Exam Overview, Chemistry Law (RA 10657), and Laboratory Safety
1.1 PRC Chemist Licensure Examination: Format, Schedule, Grading, and Passing Standards 1.2 Republic Act 10657 (Chemistry Profession Act) and Professional Ethics 1.3 Chemical Laboratory Safety, GHS Classification, Hazardous Waste Management, and Quality Assurance
2 Chapter 2: Inorganic Chemistry: Atomic Structure, Periodicity, and Chemical Bonding
2.1 Atoms, Ions, Compounds, Inorganic Nomenclature, and Stoichiometry 2.2 Quantum Numbers, Electronic Configurations, and Periodic Trends 2.3 Chemical Bonding Models: Lewis Structures, VSEPR Theory, and Molecular Polarity 2.4 Molecular Orbital Theory and Magnetochemistry of Diatomic Molecules
3 Chapter 3: Inorganic Chemistry: Coordination Compounds and Transition Metals
3.1 Coordination Chemistry: Nomenclature, Formulas, and Isomerism 3.2 Crystal Field Theory, Ligand Field Theory, d-Orbital Splitting, and Reaction Mechanisms 3.3 Electronic Absorption Spectra, Tanabe-Sugano Diagrams, and Magnetic Properties
4 Chapter 4: Inorganic Chemistry: Main Group, Reactivity, Solid State, Nuclear, and Applied Topics
4.1 Systematic Descriptive Chemistry of Main Group Elements (s- and p-Blocks) 4.2 Reactivity of Inorganic Compounds: Acid-Base Concepts, HSAB, and Redox Diagrams 4.3 Solid-State Chemistry: Crystal Systems, Unit Cells, and Band Theory 4.4 Bioinorganic Chemistry: Metalloproteins, Oxygen Carriers, and Metal Ion Toxicity 4.5 Organometallic Chemistry: 18-Electron Rule, Carbonyl Complexes, and Catalysis 4.6 Nuclear Chemistry: Stability, Decay, Transmutation, and Radioanalytical Methods 4.7 Industrial, Environmental, and Atmospheric Inorganic Chemistry and Advanced Materials
5 Chapter 5: Analytical Chemistry: Measurements, Statistics, Classical Wet Analysis, and Chemical Equilibria
5.1 Analytical Measurements: Apparatus, Units, Concentration, Sampling, and Sample Preparation 5.2 Analytical Data Evaluation: Errors, Uncertainty, Statistics, and Calibration 5.3 Gravimetric Analysis and Precipitation Equilibria ($K_{sp}$) 5.4 Neutralization Titrimetry, Polyprotic Systems, Buffers, and Alpha Fractions 5.5 Complexometric (EDTA), Redox, and Precipitation (Argentometric) Titrimetry
6 Chapter 6: Analytical Chemistry: Electroanalytical Methods and Separations
6.1 Potentiometry, Ion-Selective Electrodes, and Voltammetric Techniques 6.2 Analytical Separations: Solvent Extraction, SPE, Ion Exchange, Precipitation, Masking, and Electrodeposition 6.3 Fundamentals of Chromatography: Theoretical Plates, Resolution, and van Deemter Equation 6.4 Gas Chromatography (GC): Columns, Stationary Phases, Detectors, and Applications 6.5 High-Performance Liquid Chromatography (HPLC): Normal vs. Reversed Phase and Method Development
7 Chapter 7: Analytical Chemistry: Spectroscopic, Mass Spectrometric, and Other Instrumental Methods
7.1 Molecular UV-Vis Spectroscopy and Quantitative Beer-Lambert Law 7.2 Infrared (FTIR) and Raman Spectroscopy: Vibrational Modes and Instrumentation 7.3 Atomic Spectroscopy: Atomic Absorption (AAS) and Inductively Coupled Plasma (ICP-OES/MS) 7.4 Mass Spectrometry: Ionization Sources, Mass Analyzers, and Fragmentation Analysis 7.5 Other Instrumental Methods (XRF, Flame Emission, CE, SFC, Thermal Analysis, Electronics) and Method Selection
8 Chapter 8: Physical Chemistry: Gases, Thermodynamics, and Thermochemistry
8.1 Ideal and Real Gases and the Kinetic Molecular Theory 8.2 First Law of Thermodynamics: Heat, Work, Internal Energy, and Enthalpy 8.3 Second and Third Laws of Thermodynamics: Entropy, Carnot Engine, and Absolute Entropies 8.4 Gibbs and Helmholtz Free Energy, Spontaneity, and Fundamental Equations 8.5 Chemical Potential, Partial Molar Quantities, Fugacity, and Activity
9 Chapter 9: Physical Chemistry: Equilibrium, Phase Equilibria, Solutions, and Electrochemistry
9.1 Chemical Equilibrium: Equilibrium Constants, Le Chatelier's Principle, and the van 't Hoff Equation 9.2 Phase Rule, Phase Diagrams of One- and Two-Component Systems, and Clausius-Clapeyron Equation 9.3 Solutions: Raoult's and Henry's Laws, Colligative Properties, and Electrolytes 9.4 Electrochemistry: Galvanic Cells, Standard Potentials, and the Nernst Equation 9.5 Electrolyte Conductance, Ionic Mobility, Transport Numbers, and Concentration Cells
10 Chapter 10: Physical Chemistry: Kinetics, Surface Chemistry, and Quantum Mechanics
10.1 Reaction Rates, Rate Laws, and Integrated Rate Equations 10.2 Temperature Dependence of Rates: Arrhenius Equation, Collision Theory, and Transition State Theory 10.3 Reaction Mechanisms: Steady-State Approximation, Chain Reactions, and Catalysis 10.4 Surface Chemistry, Adsorption Isotherms, Colloids, and Macromolecular Solutions 10.5 Postulates of Quantum Mechanics, Operators, Particle in a Box, and Harmonic Oscillator 10.6 Atomic Spectra, the Hydrogen Atom, Many-Electron Atoms, and Term Symbols
11 Chapter 11: Organic Chemistry: Structure, Stereochemistry, and Hydrocarbons
11.1 Systematic IUPAC Nomenclature and Conformational Analysis of Alkanes and Cycloalkanes 11.2 Stereochemistry: Chirality, Enantiomers, Diastereomers, (R)/(S) Configuration, and Optical Activity 11.3 Alkenes and Alkynes: Addition Reactions, Markovnikov Rule, and Stereospecificity 11.4 Aromaticity: Hückel's Rule, Electrophilic Aromatic Substitution, and Directing Effects
12 Chapter 12: Organic Chemistry: Functional Groups, Mechanisms, Synthesis, and Structure Elucidation
12.1 Nucleophilic Aliphatic Substitution ($S_N1$, $S_N2$) and Elimination ($E_1$, $E_2$) Mechanisms 12.2 Alcohols, Phenols, Ethers, and Epoxides: Structure, Synthesis, and Reactivity 12.3 Carbonyl Compounds I: Aldehydes and Ketones, Nucleophilic Addition, and Oxidation/Reduction 12.4 Carbonyl Compounds II: Carboxylic Acids and Derivatives, Enolate Chemistry, and Condensations 12.5 Amines: Basicity, Synthesis, Reactions, and Arenediazonium Chemistry 12.6 Structure Elucidation: NMR Spectroscopy, Combined Spectral Problems, and Qualitative Organic Tests 12.7 Organic Synthesis Strategy, Protecting Groups, Rearrangements, and Pericyclic Reactions
13 Chapter 13: Biochemistry: Cells, Biomolecules, Enzymes, and Membranes
13.1 Cells, Organelles, Water, and Biological Acid-Base Buffers 13.2 Amino Acids, Peptides, and Hierarchical Protein Structure 13.3 Protein Purification and Biochemical Analysis of Proteins, Carbohydrates, and Lipids 13.4 Enzyme Nomenclature and Classification, Cofactors, Coenzymes, and Vitamin Precursors 13.5 Enzyme Kinetics: Michaelis-Menten Model, Lineweaver-Burk Analysis, and Enzyme Inhibition 13.6 Carbohydrates, Lipids, Biological Membranes, and Membrane Transport
14 Chapter 14: Biochemistry: Metabolism, Bioenergetics, Photosynthesis, and Molecular Genetics
14.1 Carbohydrate Catabolism and Anabolism: Glycolysis, Gluconeogenesis, Glycogen, and Pentose Phosphate Pathway 14.2 Citric Acid Cycle, Mitochondrial Electron Transport, Oxidative Phosphorylation, and $\beta$-Oxidation 14.3 Photosynthesis: Light Reactions, Photophosphorylation, and the Calvin Cycle 14.4 Lipolysis and Lipid Biosynthesis: Fatty Acids, Triacylglycerols, and Cholesterol 14.5 Nitrogen Metabolism: Nitrogen Fixation, Amino Acid Metabolism, and the Urea Cycle 14.6 Nucleic Acids, DNA Replication, Transcription, Translation, and Recombinant DNA Techniques 14.7 Regulation of Gene Expression, Mutation and Mutagens, DNA Repair, Carcinogenesis, and cDNA Cloning
5.2 Analytical Data Evaluation: Errors, Uncertainty, Statistics, and Calibration
Key Takeaways Explain This Topic AI
Analytical errors are classified as determinate (systematic, unidirectional, identifiable, and correctable) or indeterminate (random, obeying a Gaussian distribution, affecting precision).
Statistical evaluation of small datasets relies on the sample mean ( x ˉ \bar{x} x ˉ ), sample standard deviation ( s s s ), relative standard deviation ( % R S D \%RSD % RS D ), and Student's t t t -distribution for confidence intervals ( C I = x ˉ ± t s n CI = \bar{x} \pm \frac{ts}{\sqrt{n}} C I = x ˉ ± n t s ).
Significance testing utilizes Student's t t t -tests to evaluate bias against reference values, compare experimental means, or perform paired comparisons; precision equivalence between methods is verified using the two-tailed F F F -test.
Uncertainty propagation combines absolute uncertainties in quadrature for addition and subtraction, and relative uncertainties in quadrature for multiplication and division.
Calibration approaches must match sample complexity: standard additions overcome matrix interferences, internal standards correct for operational drift and volume fluctuations, and figures of merit ( L O D = 3.3 s b m LOD = \frac{3.3 s_b}{m} L O D = m 3.3 s b , L O Q = 10 s b m LOQ = \frac{10 s_b}{m} L OQ = m 10 s b ) define performance limits.
Last updated: October 2026
Analytical Data Evaluation: Errors, Uncertainty, Statistics, and Calibration
Analytical chemistry provides qualitative and quantitative chemical information. However, no quantitative measurement is physically meaningful without an assessment of its experimental error and uncertainty. For the PRC Chemist Licensure Examination, mastery of analytical data evaluation requires differentiating error classifications, applying hypothesis testing, propagating measurement uncertainties, and selecting appropriate calibration models.
1. Classification of Analytical Errors: Determinate vs. Indeterminate
Every analytical measurement contains errors arising from instruments, chemical reagents, method limitations, or operational execution.
Attribute Determinate (Systematic) Errors Indeterminate (Random) Errors
Definition Errors that possess an assignable physical, chemical, or operational cause and have a definite magnitude. Errors caused by uncontrolled, infinitesimal fluctuations in experimental variables.
Directionality Unidirectional; consistently positive or consistently negative (biases results). Bidirectional; distributed symmetrically around the mean.
Effect on Data Impairs accuracy (creates systematic bias between experimental mean x ˉ \bar{x} x ˉ and true value μ \mu μ ). Impairs precision (causes random scatter among replicate observations).
Detection / Elimination Identifiable and correctable via calibration, blank determinations, and Standard Reference Materials (SRMs). Inherent to physical measurement; cannot be eliminated, but quantified via Gaussian statistics.
Statistical Model Quantified by absolute error ( E = x ˉ − x t E = \bar{x} - x_t E = x ˉ − x t ) and relative error ( E r = x ˉ − x t x t × 100 % E_r = \frac{\bar{x} - x_t}{x_t} \times 100\% E r = x t x ˉ − x t × 100% ). Quantified by standard deviation ( s s s ), variance ( s 2 s^2 s 2 ), and normal distribution curves.
Subtypes of Determinate Errors
Instrumental Errors: Caused by imperfections in measuring devices, uncalibrated glassware (volumetric flasks, pipets), electrical drift in spectrophotometers, or worn mechanical components.
Methodic Errors: The most severe and difficult errors to detect. They stem from non-ideal physical or chemical behavior of analytical systems, including incomplete precipitation, coprecipitation of impurities, reagent decomposition, side reactions, or non-stoichiometric reactions.
Personal (Operative) Errors: Result from personal judgment limitations of the analyst, such as consistently reading a buret meniscus from an angle (parallax error), overshooting visual titration endpoints, or improper mechanical sample transfer.
Constant vs. Proportional Determinate Errors
Constant Errors: The absolute magnitude of the error remains independent of the sample mass or analyte concentration analyzed. As sample size increases, the relative error decreases inversely ( E r ∝ 1 / w E_r \propto 1/w E r ∝ 1/ w ). A classic example is a constant excess of titrant ( 0.05 mL 0.05\text{ mL} 0.05 mL ) required to trigger an indicator color change.
Proportional Errors: The absolute magnitude of the error scales directly with the sample size analyzed, keeping the relative error invariant. A common example is the presence of an interfering contaminant in a standardized titrant or reagent whose consumption is proportional to sample volume.
Diagnostic Test: To diagnose whether a systematic error is constant or proportional, run replicate determinations across varying sample masses ( 0.1 g , 0.2 g , 0.5 g , 1.0 g 0.1\text{ g}, 0.2\text{ g}, 0.5\text{ g}, 1.0\text{ g} 0.1 g , 0.2 g , 0.5 g , 1.0 g ). If the calculated percent analyte varies with sample weight, the error is constant; if the percent analyte remains identical but systematically incorrect, the error is proportional.
Detection and Elimination of Determinate Errors
Standard Reference Materials (SRMs / CRMs): Certified reference matrices analyzed alongside unknowns to detect recovery biases.
Independent Analytical Methods: Validating a titration result using an orthogonal technique, such as inductively coupled plasma (ICP) spectrometry or gravimetry.
Blank Determinations:
Reagent Blank: Contains solvent and all reagents except the analyte, taken through every preparatory step. Subtracting the reagent blank corrects for background impurities.
Matrix Blank: Simulates the entire matrix of the sample without the analyte, accounting for matrix absorption or concomitant ion interferences.
2. Precision, Accuracy, and Fundamental Statistics
Accuracy: The degree of agreement between an experimental result (or the mean of replicate measurements) and the true or accepted reference value ( x t x_t x t or μ \mu μ ).
Precision: The degree of mutual agreement or reproducibility among independent measurements obtained under specified identical conditions.
Mathematical Metrics of Central Tendency and Dispersion
For a finite sample dataset containing n n n replicate observations ( x 1 , x 2 , … , x n x_1, x_2, \dots, x_n x 1 , x 2 , … , x n ):
Sample Mean ( x ˉ \bar{x} x ˉ ): x ˉ = ∑ i = 1 n x i n \bar{x} = \frac{\sum_{i=1}^n x_i}{n} x ˉ = n ∑ i = 1 n x i
Median: The central value of an array of data ranked in ascending order. For an odd n n n , it is the middle observation; for an even n n n , it is the arithmetic average of the two central observations. The median provides a robust measure of central tendency resistant to extreme outliers.
Sample Standard Deviation ( s s s ): s = ∑ i = 1 n ( x i − x ˉ ) 2 n − 1 s = \sqrt{\frac{\sum_{i=1}^n (x_i - \bar{x})^2}{n - 1}} s = n − 1 ∑ i = 1 n ( x i − x ˉ ) 2 where ( n − 1 ) (n - 1) ( n − 1 ) represents the degrees of freedom ( ν \nu ν ). The divisor ( n − 1 ) (n - 1) ( n − 1 ) provides an unbiased estimator of the population standard deviation (Bessel's correction).
Sample Variance ( s 2 s^2 s 2 ): The square of the standard deviation, representing the additive property of dispersion.
Relative Standard Deviation (%RSD / Coefficient of Variation, C V CV C V ): % R S D = C V = s x ˉ × 100 % \%RSD = CV = \frac{s}{\bar{x}} \times 100\% % RS D = C V = x ˉ s × 100% For parts-per-thousand precision reporting: RSD p p t = s x ˉ × 1000 ppt \text{RSD}_{ppt} = \frac{s}{\bar{x}} \times 1000\text{ ppt} RSD ppt = x ˉ s × 1000 ppt
Population vs. Sample Statistics
When the number of observations approaches infinity ( N → ∞ N \rightarrow \infty N → ∞ ), the population mean is denoted as μ \mu μ and the population standard deviation is: σ = ∑ i = 1 N ( x i − μ ) 2 N \sigma = \sqrt{\frac{\sum_{i=1}^N (x_i - \mu)^2}{N}} σ = N ∑ i = 1 N ( x i − μ ) 2 In a standardized normal (Gaussian) distribution, the probability of an observation falling within specified standard deviation intervals is:
μ ± 1 σ \mu \pm 1\sigma μ ± 1 σ : contains 68.27 % 68.27\% 68.27% of all observations.
μ ± 2 σ \mu \pm 2\sigma μ ± 2 σ : contains 95.45 % 95.45\% 95.45% of all observations.
μ ± 3 σ \mu \pm 3\sigma μ ± 3 σ : contains 99.73 % 99.73\% 99.73% of all observations.
Confidence Intervals ( C I CI C I )
The confidence interval defines the range within which the true population mean μ \mu μ is expected to lie with a specified probability ( 1 − α 1 - \alpha 1 − α ):
When σ \sigma σ is known (large sample limit, N > 30 N > 30 N > 30 ): C I = x ˉ ± z σ n CI = \bar{x} \pm \frac{z \sigma}{\sqrt{n}} C I = x ˉ ± n z σ where z = 1.960 z = 1.960 z = 1.960 for 95 % 95\% 95% confidence, and z = 2.576 z = 2.576 z = 2.576 for 99 % 99\% 99% confidence.
When σ \sigma σ is unknown (small experimental datasets, n < 30 n < 30 n < 30 ): C I = x ˉ ± t s n CI = \bar{x} \pm \frac{t s}{\sqrt{n}} C I = x ˉ ± n t s where t t t is Student's t t t -statistic evaluated at ν = n − 1 \nu = n - 1 ν = n − 1 degrees of freedom at the chosen confidence level (e.g., 95 % 95\% 95% ).
Worked Example: Statistical Evaluation of Titrimetric Data
An analyst performs 5 replicate titrations of a standardized alkali solution, obtaining volumes: 25.12 , 25.18 , 25.15 , 25.22 25.12, 25.18, 25.15, 25.22 25.12 , 25.18 , 25.15 , 25.22 , and 25.13 mL 25.13\text{ mL} 25.13 mL .
Mean ( x ˉ \bar{x} x ˉ ): x ˉ = 25.12 + 25.18 + 25.15 + 25.22 + 25.13 5 = 125.80 5 = 25.160 mL \bar{x} = \frac{25.12 + 25.18 + 25.15 + 25.22 + 25.13}{5} = \frac{125.80}{5} = 25.160\text{ mL} x ˉ = 5 25.12 + 25.18 + 25.15 + 25.22 + 25.13 = 5 125.80 = 25.160 mL
Deviations ( x i − x ˉ ) (x_i - \bar{x}) ( x i − x ˉ ) and Squared Deviations:
( 25.12 − 25.160 ) 2 = ( − 0.040 ) 2 = 0.001600 (25.12 - 25.160)^2 = (-0.040)^2 = 0.001600 ( 25.12 − 25.160 ) 2 = ( − 0.040 ) 2 = 0.001600
( 25.18 − 25.160 ) 2 = ( + 0.020 ) 2 = 0.000400 (25.18 - 25.160)^2 = (+0.020)^2 = 0.000400 ( 25.18 − 25.160 ) 2 = ( + 0.020 ) 2 = 0.000400
( 25.15 − 25.160 ) 2 = ( − 0.010 ) 2 = 0.000100 (25.15 - 25.160)^2 = (-0.010)^2 = 0.000100 ( 25.15 − 25.160 ) 2 = ( − 0.010 ) 2 = 0.000100
( 25.22 − 25.160 ) 2 = ( + 0.060 ) 2 = 0.003600 (25.22 - 25.160)^2 = (+0.060)^2 = 0.003600 ( 25.22 − 25.160 ) 2 = ( + 0.060 ) 2 = 0.003600
( 25.13 − 25.160 ) 2 = ( − 0.030 ) 2 = 0.000900 (25.13 - 25.160)^2 = (-0.030)^2 = 0.000900 ( 25.13 − 25.160 ) 2 = ( − 0.030 ) 2 = 0.000900
∑ ( x i − x ˉ ) 2 = 0.006600 mL 2 \sum (x_i - \bar{x})^2 = 0.006600\text{ mL}^2 ∑ ( x i − x ˉ ) 2 = 0.006600 mL 2
Sample Standard Deviation ( s s s ): s = 0.006600 5 − 1 = 0.006600 4 = 0.001650 = 0.04062 mL ≈ 0.041 mL s = \sqrt{\frac{0.006600}{5 - 1}} = \sqrt{\frac{0.006600}{4}} = \sqrt{0.001650} = 0.04062\text{ mL} \approx 0.041\text{ mL} s = 5 − 1 0.006600 = 4 0.006600 = 0.001650 = 0.04062 mL ≈ 0.041 mL
Relative Standard Deviation (%RSD): % R S D = 0.04062 25.160 × 100 % = 0.161 % \%RSD = \frac{0.04062}{25.160} \times 100\% = 0.161\% % RS D = 25.160 0.04062 × 100% = 0.161%
95 % 95\% 95% Confidence Interval (using t 0.05 , 4 = 2.776 t_{0.05, 4} = 2.776 t 0.05 , 4 = 2.776 ): C I = 25.160 ± 2.776 × 0.04062 5 = 25.160 ± 0.11276 2.2361 = 25.160 ± 0.050 mL CI = 25.160 \pm \frac{2.776 \times 0.04062}{\sqrt{5}} = 25.160 \pm \frac{0.11276}{2.2361} = 25.160 \pm 0.050\text{ mL} C I = 25.160 ± 5 2.776 × 0.04062 = 25.160 ± 2.2361 0.11276 = 25.160 ± 0.050 mL The true mean lies in the range [ 25.110 mL , 25.210 mL ] [25.110\text{ mL}, 25.210\text{ mL}] [ 25.110 mL , 25.210 mL ] at the 95 % 95\% 95% confidence level.
3. Significance Hypothesis Testing and Outlier Rejection
Significance testing assesses whether an experimental discrepancy between two numbers reflects genuine physical divergence (determinate bias) or expected random fluctuation (indeterminate error).
Case 1: Comparing an Experimental Mean to a Known True Value (Bias Test)
To evaluate whether a new method possesses systematic bias relative to a certified reference material value ( μ \mu μ ): t c a l c = ∣ x ˉ − μ ∣ n s t_{calc} = \frac{|\bar{x} - \mu|\sqrt{n}}{s} t c a l c = s ∣ x ˉ − μ ∣ n
If t c a l c > t c r i t t_{calc} > t_{crit} t c a l c > t cr i t (from t t t -table at ν = n − 1 \nu = n - 1 ν = n − 1 ), reject the null hypothesis ( H 0 : x ˉ = μ H_0: \bar{x} = \mu H 0 : x ˉ = μ ). A statistically significant determinate error is present.
If t c a l c ≤ t c r i t t_{calc} \le t_{crit} t c a l c ≤ t cr i t , retain H 0 H_0 H 0 . No significant bias is detected at the chosen confidence level.
Case 2: Comparing Two Experimental Means (Independent Datasets)
To test whether two independent analytical procedures yield equivalent mean results ( x ˉ 1 \bar{x}_1 x ˉ 1 vs x ˉ 2 \bar{x}_2 x ˉ 2 ):
First, verify that the two sample variances do not differ significantly via the F F F -test. If pooled precision is valid, calculate the pooled standard deviation ( s p o o l e d s_{pooled} s p oo l e d ): s p o o l e d = ( n 1 − 1 ) s 1 2 + ( n 2 − 1 ) s 2 2 n 1 + n 2 − 2 s_{pooled} = \sqrt{\frac{(n_1 - 1)s_1^2 + (n_2 - 1)s_2^2}{n_1 + n_2 - 2}} s p oo l e d = n 1 + n 2 − 2 ( n 1 − 1 ) s 1 2 + ( n 2 − 1 ) s 2 2 Calculate t c a l c t_{calc} t c a l c : t c a l c = ∣ x ˉ 1 − x ˉ 2 ∣ s p o o l e d n 1 n 2 n 1 + n 2 t_{calc} = \frac{|\bar{x}_1 - \bar{x}_2|}{s_{pooled}}\sqrt{\frac{n_1 n_2}{n_1 + n_2}} t c a l c = s p oo l e d ∣ x ˉ 1 − x ˉ 2 ∣ n 1 + n 2 n 1 n 2 Compare t c a l c t_{calc} t c a l c against t c r i t t_{crit} t cr i t with ν = n 1 + n 2 − 2 \nu = n_1 + n_2 - 2 ν = n 1 + n 2 − 2 degrees of freedom.
Case 3: Paired Student's t t t -Test
When two analytical methods are compared by analyzing multiple distinct sample matrices (e.g., comparing a new HPLC method with a standard GC method across 8 different blood plasma samples), individual sample differences must be isolated:
Compute the difference for each sample: d i = x 1 , i − x 2 , i d_i = x_{1, i} - x_{2, i} d i = x 1 , i − x 2 , i .
Compute the mean difference: d ˉ = ∑ d i n \bar{d} = \frac{\sum d_i}{n} d ˉ = n ∑ d i .
Compute the standard deviation of the differences ( s d s_d s d ): s d = ∑ ( d i − d ˉ ) 2 n − 1 s_d = \sqrt{\frac{\sum (d_i - \bar{d})^2}{n - 1}} s d = n − 1 ∑ ( d i − d ˉ ) 2
Compute t c a l c t_{calc} t c a l c : t c a l c = ∣ d ˉ ∣ n s d t_{calc} = \frac{|\bar{d}|\sqrt{n}}{s_d} t c a l c = s d ∣ d ˉ ∣ n Compare t c a l c t_{calc} t c a l c against t c r i t t_{crit} t cr i t with ν = n − 1 \nu = n - 1 ν = n − 1 degrees of freedom.
The F F F -Test for Comparing Precisions
The F F F -test evaluates whether two analytical methods exhibit statistically identical precision by comparing their variances ( s 2 s^2 s 2 ): F c a l c = s 1 2 s 2 2 where s 1 2 ≥ s 2 2 F_{calc} = \frac{s_1^2}{s_2^2} \quad \text{where } s_1^2 \ge s_2^2 F c a l c = s 2 2 s 1 2 where s 1 2 ≥ s 2 2 By convention, the larger variance is always placed in the numerator, ensuring F c a l c ≥ 1.0 F_{calc} \ge 1.0 F c a l c ≥ 1.0 .
If F c a l c > F c r i t F_{calc} > F_{crit} F c a l c > F cr i t (evaluated at ν 1 = n 1 − 1 \nu_1 = n_1 - 1 ν 1 = n 1 − 1 and ν 2 = n 2 − 1 \nu_2 = n_2 - 1 ν 2 = n 2 − 1 ), the hypothesis of equal precision ( H 0 : σ 1 2 = σ 2 2 H_0: \sigma_1^2 = \sigma_2^2 H 0 : σ 1 2 = σ 2 2 ) is rejected. The two methods have significantly different precision.
Outlier Rejection Criteria
An outlier is an extreme data point that appears anomalous relative to the rest of the dataset.
1. Dixon's Q Q Q -Test (for small datasets, 3 ≤ n ≤ 10 3 \le n \le 10 3 ≤ n ≤ 10 )
Arrange the data in ascending numerical order: x 1 ≤ x 2 ≤ ⋯ ≤ x n x_1 \le x_2 \le \dots \le x_n x 1 ≤ x 2 ≤ ⋯ ≤ x n .
Identify the suspect value ( x 1 x_1 x 1 or x n x_n x n ).
Calculate Q c a l c Q_{calc} Q c a l c : Q c a l c = ∣ x s u s p e c t − x n e a r e s t ∣ x m a x − x m i n = Gap Range Q_{calc} = \frac{|x_{suspect} - x_{nearest}|}{x_{max} - x_{min}} = \frac{\text{Gap}}{\text{Range}} Q c a l c = x ma x − x min ∣ x s u s p ec t − x n e a res t ∣ = Range Gap
Compare with Q c r i t Q_{crit} Q cr i t ( Q Q Q -table at n n n and 90 % 90\% 90% or 95 % 95\% 95% confidence). If Q c a l c > Q c r i t Q_{calc} > Q_{crit} Q c a l c > Q cr i t , reject the outlier; otherwise, retain it.
2. Grubbs' Test (Standardized ISO/ASTM Outlier Test)
Grubbs' test is preferred over the Q Q Q -test by international standards bodies because it accounts for overall distribution variance: G c a l c = ∣ x s u s p e c t − x ˉ ∣ s G_{calc} = \frac{|x_{suspect} - \bar{x}|}{s} G c a l c = s ∣ x s u s p ec t − x ˉ ∣ where x ˉ \bar{x} x ˉ and s s s are calculated including the suspect point.
If G c a l c > G c r i t G_{calc} > G_{crit} G c a l c > G cr i t , the point is rejected at the chosen significance level.
4. Propagation of Measurement Uncertainty
When experimental parameters with known random uncertainties are combined algebraically, their uncertainties propagate into the final calculated result ( y y y ).
1. Addition and Subtraction
For functions of the form y = a + b − c y = a + b - c y = a + b − c : s y = s a 2 + s b 2 + s c 2 s_y = \sqrt{s_a^2 + s_b^2 + s_c^2} s y = s a 2 + s b 2 + s c 2 Rule: For addition and subtraction, absolute uncertainties combine in quadrature .
2. Multiplication and Division
For functions of the form y = a ⋅ b c y = \frac{a \cdot b}{c} y = c a ⋅ b : s y y = ( s a a ) 2 + ( s b b ) 2 + ( s c c ) 2 \frac{s_y}{y} = \sqrt{\left(\frac{s_a}{a}\right)^2 + \left(\frac{s_b}{b}\right)^2 + \left(\frac{s_c}{c}\right)^2} y s y = ( a s a ) 2 + ( b s b ) 2 + ( c s c ) 2 Rule: For multiplication and division, relative uncertainties combine in quadrature .
3. Powers and Exponentials
For power functions y = x n y = x^n y = x n : s y y = ∣ n ∣ ( s x x ) \frac{s_y}{y} = |n| \left(\frac{s_x}{x}\right) y s y = ∣ n ∣ ( x s x )
For common logarithms y = log 10 ( x ) y = \log_{10}(x) y = lo g 10 ( x ) : s y = 0.4343 ( s x x ) s_y = 0.4343 \left(\frac{s_x}{x}\right) s y = 0.4343 ( x s x )
For natural logarithms y = ln ( x ) y = \ln(x) y = ln ( x ) : s y = s x x s_y = \frac{s_x}{x} s y = x s x
For antilogarithms y = 10 x y = 10^x y = 1 0 x : s y y = 2.3026 s x \frac{s_y}{y} = 2.3026 s_x y s y = 2.3026 s x
Worked Uncertainty Propagation Calculation
Calculate the molarity ( M M M ) of a sodium chloride solution prepared by dissolving m = 2.9220 ± 0.0004 g m = 2.9220 \pm 0.0004\text{ g} m = 2.9220 ± 0.0004 g of pure N a C l NaCl N a Cl ( F W = 58.4430 ± 0.0005 g/mol FW = 58.4430 \pm 0.0005\text{ g/mol} F W = 58.4430 ± 0.0005 g/mol ) into a volumetric flask with calibrated volume V = 500.00 ± 0.05 mL V = 500.00 \pm 0.05\text{ mL} V = 500.00 ± 0.05 mL :
Calculated Value: M = m / F W V = 2.9220 / 58.4430 0.50000 = 0.0999949 M M = \frac{m / FW}{V} = \frac{2.9220 / 58.4430}{0.50000} = 0.0999949\text{ M} M = V m / F W = 0.50000 2.9220/58.4430 = 0.0999949 M
Relative Standard Deviations:
s m m = 0.0004 2.9220 = 1.369 × 10 − 4 \frac{s_m}{m} = \frac{0.0004}{2.9220} = 1.369 \times 10^{-4} m s m = 2.9220 0.0004 = 1.369 × 1 0 − 4
s F W F W = 0.0005 58.4430 = 8.555 × 10 − 6 \frac{s_{FW}}{FW} = \frac{0.0005}{58.4430} = 8.555 \times 10^{-6} F W s F W = 58.4430 0.0005 = 8.555 × 1 0 − 6
s V V = 0.05 500.00 = 1.000 × 10 − 4 \frac{s_V}{V} = \frac{0.05}{500.00} = 1.000 \times 10^{-4} V s V = 500.00 0.05 = 1.000 × 1 0 − 4
Combined Relative Uncertainty: s M M = ( 1.369 × 10 − 4 ) 2 + ( 8.555 × 10 − 6 ) 2 + ( 1.000 × 10 − 4 ) 2 = 1.874 × 10 − 8 + 7.32 × 10 − 11 + 1.000 × 10 − 8 = 1.697 × 10 − 4 \frac{s_M}{M} = \sqrt{(1.369 \times 10^{-4})^2 + (8.555 \times 10^{-6})^2 + (1.000 \times 10^{-4})^2} = \sqrt{1.874 \times 10^{-8} + 7.32 \times 10^{-11} + 1.000 \times 10^{-8}} = 1.697 \times 10^{-4} M s M = ( 1.369 × 1 0 − 4 ) 2 + ( 8.555 × 1 0 − 6 ) 2 + ( 1.000 × 1 0 − 4 ) 2 = 1.874 × 1 0 − 8 + 7.32 × 1 0 − 11 + 1.000 × 1 0 − 8 = 1.697 × 1 0 − 4
Absolute Uncertainty ( s M s_M s M ): s M = M × ( 1.697 × 10 − 4 ) = 0.0999949 × 1.697 × 10 − 4 = 0.0000170 M s_M = M \times (1.697 \times 10^{-4}) = 0.0999949 \times 1.697 \times 10^{-4} = 0.0000170\text{ M} s M = M × ( 1.697 × 1 0 − 4 ) = 0.0999949 × 1.697 × 1 0 − 4 = 0.0000170 M
Reported Concentration: 0.09999 ± 0.00002 M 0.09999 \pm 0.00002\text{ M} 0.09999 ± 0.00002 M .
5. Quantitative Calibration Strategies and Figures of Merit
Quantitative analytical instrumentation measures an analytical signal ( S S S ) that must be correlated with analyte concentration ( C C C ).
1. External Standard Calibration and Linear Regression
A series of standard solutions containing known analyte concentrations is prepared in pure solvent. Linear least-squares regression fits the equation y = m x + b y = mx + b y = m x + b :
Slope ( m m m - Calibration Sensitivity): m = ∑ ( x i − x ˉ ) ( y i − y ˉ ) ∑ ( x i − x ˉ ) 2 m = \frac{\sum (x_i - \bar{x})(y_i - \bar{y})}{\sum (x_i - \bar{x})^2} m = ∑ ( x i − x ˉ ) 2 ∑ ( x i − x ˉ ) ( y i − y ˉ )
y y y -Intercept ( b b b ): b = y ˉ − m x ˉ b = \bar{y} - m\bar{x} b = y ˉ − m x ˉ
Coefficient of Determination ( R 2 R^2 R 2 ): Measures the proportion of variance in signal explained by analyte concentration ( R 2 > 0.995 R^2 > 0.995 R 2 > 0.995 is typically required in regulatory testing).
Limitation: External calibration assumes that the sample matrix produces no signal enhancement or suppression (zero matrix interference).
2. Standard Addition Method (Spike Recovery)
Used when the chemical matrix of the sample is complex and produces matrix effects (such as viscosity, ionic strength, or concomitants) that alter analyte sensitivity.
Aliquots of the sample solution are spiked with increasing, precisely known quantities of analyte standard.
In a multiple-addition plot where signal ( S S S ) is plotted against added concentration ( C a d d e d C_{added} C a dd e d ): S = m C a d d e d + S 0 S = m C_{added} + S_0 S = m C a dd e d + S 0 Setting S = 0 S = 0 S = 0 gives the negative x x x -intercept: C u n k n o w n = S 0 m = − x intercept C_{unknown} = \frac{S_0}{m} = -x_{\text{intercept}} C u nkn o w n = m S 0 = − x intercept
3. Internal Standard Method
Used when experimental variables cause instrument drift, volatilization, or injection volume fluctuations (e.g., in Gas Chromatography or ICP-MS):
A fixed, unvarying concentration of an internal standard (a distinct compound chemically and physically similar to the analyte, absent in the original sample) is added to all blanks, standards, and unknowns.
Calibration plots the ratio of analyte signal to internal standard signal ( S a n a l y t e S i n t e r n a l _ s t d \frac{S_{analyte}}{S_{internal\_std}} S in t er na l _ s t d S ana l y t e ) against analyte concentration.
Any variation in sample injection volume or nebulizer efficiency affects both analyte and internal standard identically, preserving the signal ratio.
Analytical Figures of Merit
Figure of Merit Definition and Mathematical Expression Significance
Calibration Sensitivity ( m m m ) Slope of calibration curve: m = Δ S Δ C m = \frac{\Delta S}{\Delta C} m = Δ C Δ S . Reflects instrument response change per unit concentration change.
Analytical Sensitivity ( γ \gamma γ ) γ = m s b \gamma = \frac{m}{s_b} γ = s b m , where s b s_b s b is the standard deviation of blank signals. Takes measurement precision into account; independent of signal amplification.
Limit of Detection ( L O D LOD L O D ) L O D = 3.3 s b m LOD = \frac{3.3 s_b}{m} L O D = m 3.3 s b (or 3 s b / m 3 s_b / m 3 s b / m ). Minimum analyte concentration distinguishable from background blank with 99 % 99\% 99% confidence.
Limit of Quantitation ( L O Q LOQ L OQ ) L O Q = 10 s b m LOQ = \frac{10 s_b}{m} L OQ = m 10 s b . Lowest concentration that can be quantitatively determined with acceptable precision and accuracy.
Dynamic Linear Range Concentration range extending from the L O Q LOQ L OQ to the limit of linearity ( L O L LOL L O L ). Range where signal remains directly proportional to concentration (deviation < 5 % < 5\% < 5% ).