Study guide
15.1 Statistical Study Design, Random Sampling Techniques & Sources of Bias
FTCE Mathematics 6-12 026
Track your progress as you read
Finished sections get a check mark.
1 Chapter 1: Exam Overview & Rational Number Systems
1.1 FTCE Mathematics 6-12 Overview, Interface & Test-Taking Strategies 1.2 Rational Numbers, Representations & Multi-Step Operations
2 Chapter 2: Real Number Approximations & Proportional Reasoning
2.1 Irrational Numbers, Radical Estimation & Scientific Notation 2.2 Ratios, Rates, Proportions & Dimensional Analysis 2.3 Percent Applications, Financial Models & Depreciation
3 Chapter 3: Algebraic Expressions & Polynomial Operations
3.1 Polynomial Arithmetic, Factoring Strategies & Special Products 3.2 Radical Operations, Rational Expressions & Equations 3.3 Field Properties, Exponent Laws & Literal Equations
4 Chapter 4: Linear Relationships, Systems & Inequalities
4.1 Linear Equations, Slope Concepts & Line Forms 4.2 Systems of Linear Equations & Real-World Applications 4.3 Single & Systems of Linear Inequalities on the Coordinate Plane 4.4 Absolute Value Equations & Inequalities in One and Two Variables
5 Chapter 5: Quadratic Equations, Functions & Complex Numbers
5.1 Quadratic Equations, Discriminant & Complex Number Arithmetic 5.2 Quadratic Functions: Vertex, Axis, Intercepts & Concavity 5.3 Quadratic Inequalities in One/Two Variables & Optimization
6 Chapter 6: Function Foundations, Transformations & Inverses
6.1 Function Definitions, Relations, Domain, Range & Notation 6.2 Function Families, Key Graphical Behaviors & Even/Odd Symmetry 6.3 Shifting, Scaling & Reflecting Functions Across Representations 6.4 Function Composition, Invertibility & Inverse Functions
7 Chapter 7: Geometric Foundations, Angles & Deductive Proofs
7.1 Angle Relationships, Parallel Lines & Transversals 7.2 Triangle Sum, Exterior Angles & Polygon Angle Formulas 7.3 Formal Proof Methods, CPCTC & Quadrilateral Properties
8 Chapter 8: Congruence, Similarity & Geometric Transformations
8.1 Triangle Congruence (SSS, SAS, ASA, AAS, HL) & Similarity (AA, SAS, SSS) 8.2 Rigid Motions: Translations, Reflections, Rotations & Symmetry 8.3 Dilations, Scale Factors & Proportional Reasoning in Geometry
9 Chapter 9: Coordinate Geometry & 3D Spatial Measurement
9.1 Distance, Midpoint, Slope Criteria & Coordinate Proofs 9.2 Perimeter, Area, Surface Area & Volume of 2D and 3D Figures 9.3 Cross Sections of 3D Figures & Solids of Revolution
10 Chapter 10: Circle Theorems & Geometric Constructions
10.1 Central, Inscribed, Tangent & Chord Angles and Arcs 10.2 Intersecting Chords, Secant/Tangent Lengths, Arc Length & Sector Area 10.3 Euclidean Constructions with Compass and Straightedge
11 Chapter 11: Conic Sections & Coordinate Modeling
11.1 Circles and Parabolas: Geometric Definitions, Equations & Modeling 11.2 Ellipses and Hyperbolas: Foci, Axes, Asymptotes & Real-World Applications
12 Chapter 12: Trigonometric Foundations & Oblique Triangles
12.1 Right-Triangle Trigonometry, Pythagorean Theorem & Special Triangles 12.2 The Unit Circle, Radian Measure & Exact Trigonometric Values 12.3 Law of Sines (Ambiguous Case), Law of Cosines & Oblique Triangle Area
13 Chapter 13: Trigonometric Functions, Polar & Parametric Systems
13.1 Graphs of the Six Trigonometric Functions & Periodic Modeling 13.2 Polar Coordinates, Polar-Rectangular Conversion & Polar Graphs 13.3 Parametric Equations, Elimination of Parameters & Projectile Motion
14 Chapter 14: Descriptive Statistics & Data Distributions
14.1 Measures of Central Tendency, Dispersion & Resistant Statistics 14.2 Univariate Displays (Histograms, Boxplots, Stemplots) & Distribution Shapes 14.3 Normal Distribution Properties, Empirical Rule & Standard Normal Z-Scores
15 Chapter 15: Statistical Studies, Bivariate Data & Linear Regression
15.1 Statistical Study Design, Random Sampling Techniques & Sources of Bias 15.2 Survey Sampling, Margin of Error & Population Estimation 15.3 Scatterplots, Correlation Coefficient r, Linear Regression & Residuals
16 Chapter 16: Probability Theory, Two-Way Tables & Expected Value
16.1 Fundamental Counting Principle, Permutations & Combinations 16.2 Addition Rule, Multiplication Rule, Independent Events & Conditional Probability 16.3 Two-Way Frequency Tables, Law of Large Numbers & Expected Value of Random Variables
17 Chapter 17: Precalculus: Polynomial, Rational & Transcendental Functions
17.1 Fundamental Theorem of Algebra, Remainder/Factor Theorems & Polynomial Roots 17.2 Rational Functions, Domain Restrictions, Holes & Asymptotes 17.3 Exponential & Logarithmic Functions, Base e & Logarithmic Properties
18 Chapter 18: Sequences, Series, Binomial Theorem & Vectors
18.1 Arithmetic & Geometric Sequences, Finite Sums & Infinite Series Convergence 18.2 Binomial Theorem, Pascal's Triangle & General Term Determination 18.3 Vector Representations, Operations, Magnitude, Direction & Dot Product
19 Chapter 19: Differential Calculus Foundations
19.1 Limits, One-Sided Limits, Indeterminate Forms & Continuity 19.2 Derivative Definition, Power, Product, Quotient & Transcendental Rules 19.3 Chain Rule, Tangent Line Equations & Rates of Change
20 Chapter 20: Applications of Derivatives & Integral Calculus
20.1 First & Second Derivative Tests, Extrema, Concavity & Optimization 20.2 Antiderivatives, Indefinite Integrals & Integration by U-Substitution 20.3 Fundamental Theorem of Calculus, Net Signed Area & Geometric Applications
21 Chapter 21: Mathematical Representations, Progressions & Tools
21.1 Concrete-Representational-Abstract (CPA) Progressions & Concept Continuity 21.2 The Rule of Four: Translating Among Representations to Support Fluency 21.3 Manipulatives, Dynamic Software & Technology in Secondary Mathematics
22 Chapter 22: Assessment, Error Analysis & Misconception Remediation
22.1 Student Misconceptions & Error Analysis Across Core Secondary Domains 22.2 Evaluating Validity of Student Mathematical Arguments & Reasonableness Checks 22.3 Formative Assessment Formats, Data-Driven Differentiation & Tiered Tasks
15.1 Statistical Study Design, Random Sampling Techniques & Sources of Bias
Key Takeaways Explain This Topic AI
Statistical investigations are partitioned into sample surveys, observational studies, and controlled experiments; only well-designed randomized comparative experiments can establish cause-and-effect relationships because randomization balances confounding variables across treatment groups.
Probability sampling designs—simple random, stratified, cluster, and systematic sampling—rely on objective chance mechanisms, whereas non-probability designs like voluntary response and convenience sampling suffer from fatal selection bias.
Stratified sampling samples from all homogeneous strata to minimize sampling variance, while cluster sampling surveys all individuals within a subset of randomly selected heterogeneous clusters for operational efficiency.
Systematic errors in survey research stem from selection bias and undercoverage, non-response bias among unreachable subjects, response bias from inaccurate reporting, and leading question wording.
The four foundational pillars of experimental design are comparison, randomization, control, and replication, supplemented by blinding protocols and randomized block designs to eliminate placebo effects and isolate treatment efficacy.
Last updated: September 2026
- 15.1 Statistical Study Design, Random Sampling Techniques & Sources of Bias
- Taxonomy of Empirical Studies: Surveys, Observational Studies, and Experiments
Statistical inquiry begins with data collection. The methodology used to collect data dictates what conclusions can legitimately be drawn. The discipline classifies empirical investigations into three distinct paradigms: sample surveys, observational studies, and controlled experiments.
A sample survey collects data from a representative subset of a population to estimate unknown population parameters through structured questionnaires, interviews, or standardized physical measurements. In an ideal survey, the investigator records responses without attempting to influence subjects or alter their environment.
An observational study observes and measures variables of interest across individuals in their natural state without imposing any treatment or intervening in any way. Observational studies can be retrospective , where researchers examine historical records or past behaviors (such as reviewing medical archives to link dietary habits with cardiac health), or prospective , where cohorts are tracked forward in time to record emergent outcomes. Because the investigator does not assign subjects to conditions, observational studies are inherently vulnerable to confounding variables —extraneous factors that correlate simultaneously with both the explanatory variable and the response variable, obscuring whether the explanatory variable truly produces changes in the response.
A controlled experiment , by contrast, involves the deliberate imposition of one or more experimental treatments on subjects or experimental units to measure their subsequent responses. The defining criterion of an experiment is active intervention: researchers manipulate the explanatory variable (factor) to assess its direct impact on the response variable.
A fundamental tenet of statistics tested on the FTCE Mathematics 6-12 exam is that correlation does not imply causation . An observational study or sample survey can reveal strong associations between two variables, but it cannot establish cause-and-effect. For instance, an observational study might reveal a strong positive correlation between ice cream sales and drowning incidents; however, warmer summer temperatures act as a confounding variable driving increases in both. Only a well-designed, randomized comparative experiment can establish a causal relationship , because the random allocation of subjects to treatments balances out lurking and confounding variables across groups, isolating the treatment as the sole systematic difference.
Probability vs. Non-Probability Sampling Designs
To generalize conclusions from a sample to an entire target population, researchers must utilize probability sampling designs , in which every member of the population has a known, non-zero probability of selection determined by an objective chance mechanism.
Simple Random Sample (SRS): An SRS of size n n n is chosen in such a manner that every individual in the population has an equal probability of selection, and every possible subset of n n n individuals has an equal chance of constituting the chosen sample. Common implementations include assigning integers to every member in a sampling frame and generating values with a pseudo-random number generator. While an SRS provides an unbiased benchmark, it can be logistically challenging or costly across geographically dispersed populations.
Stratified Random Sample: The population is partitioned into mutually exclusive, internally homogeneous subgroups called strata based on a shared characteristic known or suspected to correlate with the variable of interest (e.g., grouping high school students by grade level: 9th, 10th, 11th, and 12th). An independent SRS is drawn from every stratum, and the sampled individuals are pooled. Stratification guarantees representation of key demographic subgroups, substantially reducing sampling variability across repeated samples.
Cluster Sample: The population is divided into pre-existing, naturally occurring, internally heterogeneous groups called clusters (e.g., city blocks, school homerooms, or voting precincts). A random sample of clusters is selected, and all individuals within the chosen clusters are surveyed. Unlike stratified sampling—which samples some individuals from all groups—cluster sampling measures all individuals from some groups. Cluster sampling provides operational and travel efficiencies, though it yields higher sampling variability if clusters are internally homogeneous rather than representative mini-populations.
Systematic Sample: From an ordered population list of size N N N , researchers select every k k k -th individual (where k ≈ N / n k \approx N/n k ≈ N / n ) after randomly choosing a starting point between 1 and k k k . Systematic sampling is simple to administer in industrial quality control or customer exit surveys, but it introduces severe bias if the population list exhibits a periodic or cyclical pattern that coincides with k k k .
In sharp contrast, non-probability sampling designs rely on convenience or self-selection rather than chance mechanisms, introducing fatal systemic bias:
Convenience Sample: Researchers select individuals who are easiest to contact or recruit (e.g., questioning shoppers at a single shopping mall entrance on a weekday morning). Convenience samples systematically exclude large segments of the population.
Voluntary Response Sample: The sample consists of individuals who choose themselves by responding to an open invitation (e.g., online polls, call-in radio shows). Voluntary response samples overwhelmingly overrepresent individuals with intense, strongly held, or negative opinions.
Sources of Systematic Bias in Sampling
Bias refers to any systematic favoritism in data collection that causes sample statistics to consistently overestimate or underestimate the true population parameter.
Undercoverage (Selection Bias): Occurs when the sampling frame (the list of individuals from which the sample is drawn) fails to include certain population segments. For example, a telephone survey relying solely on registered landlines systematically undercovers younger and lower-income demographics who rely exclusively on mobile phones.
Non-Response Bias: Arises when selected individuals refuse to participate or cannot be contacted. If individuals who do not respond possess systematically different attitudes or characteristics than respondents, the resulting sample statistic is distorted.
Response Bias: Occurs when respondents provide inaccurate or untruthful answers due to social desirability pressures, fear of stigma, faulty memory, or intimidation by the interviewer.
Wording of Questions Bias: The use of leading, emotionally loaded, or confusing phrasing systematically steers respondents toward a specific viewpoint (e.g., asking 'Do you support investing in clean water to protect our children?' versus 'Do you support increasing municipal property taxes?').
The Four Pillars of Experimental Design
To isolate treatment effects and establish causal validity, an experiment must be structured around four core principles:
Comparison: An experiment must compare two or more treatments (e.g., an experimental medication versus a control group) to ensure that observed outcomes are not simply the consequence of time trends, maturation, or external environmental fluctuations.
Randomization: Experimental units must be assigned to treatment groups using an objective chance procedure. Random assignment neutralizes the effect of confounding variables by dispersing both known and unknown lurking variables evenly across all treatment conditions on average.
Control: Researchers must keep extraneous variables constant across all treatment groups (e.g., maintaining identical temperature, lighting, and administration schedules) to ensure that the treatment is the sole variable operating. A control group provides an essential baseline, receiving either a standard existing treatment or a placebo (an inert dummy treatment). This isolates the placebo effect , wherein subjects exhibit measurable improvements purely due to their psychological expectation of receiving treatment.
Replication: Treatments must be administered to a sufficiently large number of experimental units so that genuine treatment differences can be distinguished from random background variation. Replication does not mean repeating the entire study; rather, it refers to applying the treatment to multiple independent units within the experiment.
To prevent psychological bias, researchers employ single-blind designs (where subjects do not know which treatment they receive) or double-blind designs (where neither the participating subjects nor the clinicians and evaluators measuring the outcomes know who received which treatment). When a known extraneous variable (such as age, biological sex, or baseline blood pressure) is expected to influence the response, researchers utilize a randomized block design : subjects are first partitioned into homogeneous blocks , and treatments are then randomly assigned independently within each block.
Comparative Synthesis of Sampling Methodologies
Sampling Method Selection Mechanism Group Structure Key Advantages Primary Vulnerabilities / Risks
Simple Random Sample (SRS) Objective chance (random number generator, lottery) None; population treated as a single uniform group Unbiased; mathematically straightforward; equal subset probability Logistically difficult for large, dispersed populations; high operational costs
Stratified Random Sample Draw an independent SRS from every single subgroup Homogeneous within strata, heterogeneous between strata Guarantees representation of all subgroups; reduces sampling variance Requires prior knowledge of population stratification variables
Cluster Sample Randomly select entire subgroups; census all members within chosen units Heterogeneous within clusters, homogeneous between clusters Maximizes geographical and operational efficiency; lowers survey cost Increased sampling error if clusters differ substantially from one another
Systematic Sample Select every k k k -th item from an ordered list after random start Sequential ordering across population Easy to execute in field work and continuous industrial processes Susceptible to extreme bias if list possesses hidden cyclical periodicity
Convenience Sample Select individuals easiest to access or interview Uncontrolled opportunistic grouping Quick, inexpensive, minimal operational planning required Extreme selection bias; systematically unrepresentative; invalid inference
Voluntary Response Individuals self-select by choosing whether to respond Self-selected respondent group Inexpensive; rapid collection of large numbers of responses Severe non-response and self-selection bias; overrepresents extreme views