Study guide

3.4 Data-Driven Decision Making & Analytical Pitfalls

Career Executive Service CES

Track your progress as you read

Finished sections get a check mark.

1 Chapter 1: Verbal Ability & Error Recognition

1.1 CES-WE Verbal Examination Overview & Error Recognition Scheme 1.2 Grammar & Syntax Rules in Executive Writing 1.3 Diction & Vocabulary Precision in Public Administration Contexts 1.4 Verbosity, Redundancy & Executive Conciseness

2 Chapter 2: Reading Comprehension & Information Extraction

2.1 Passages, Main Ideas & Executive Summarization 2.2 Textual Inference, Tone & Authorial Intent 2.3 Critical Analysis of Official Reports, Policy Papers & Case Studies 2.4 Time-Management Strategies for Lengthy Reading Passages

3 Chapter 3: Numerical & Data Interpretation

3.1 Statistical Tables & Tabular Data Analysis 3.2 Graphical Analysis: Bar, Line & Pie Charts in Public Reporting 3.3 Percentage, Ratio, Rate of Growth & Budget Calculations 3.4 Data-Driven Decision Making & Analytical Pitfalls

4 Chapter 4: Logical & Analytical Reasoning

4.1 Categorical Syllogisms & Formal Deductive Logic 4.2 Number, Letter & Pattern Series 4.3 Verbal & Concept Analogies in Management Scenarios 4.4 Argument Validity, Premises & Logical Fallacies

5 Chapter 5: Core Management Functions & Organizational Dynamics

5.1 Strategic & Operational Planning 5.2 Organizational Structure, Design & Delegation of Authority 5.3 Leadership Styles, Power Dynamics & Executive Influence 5.4 Motivation Theories in Public Sector Management 5.5 Organizational Control Systems & Performance Evaluation

6 Chapter 6: Executive Decision-Making & Public Management Problems

6.1 Decision-Making Models, Risk Analysis & Crisis Management 6.2 Public Sector Reform, Good Governance & New Public Management 6.3 Change Management & Conflict Resolution in Public Bureaucracy 6.4 Case Analysis Methodology for CES-WE Management Scenarios

7 Chapter 7: Philippine Constitution, State Structure & Public Ethics

7.1 The 1987 Philippine Constitution & Executive Branch Power 7.2 Legislative & Judicial Branches: Check and Balance Mechanisms 7.3 Constitutional Commissions (CSC, COA, COMELEC) & Oversight Bodies 7.4 RA 6713 (Code of Conduct and Ethical Standards for Public Officials) 7.5 Anti-Graft, Transparency Laws (RA 3019, FOI) & Public Accountability

8 Chapter 8: The Career Executive Service System & Executive Essay Writing

8.1 The CES System: Concept, Ranks, Eligibility & CESB Mandate 8.2 Structure & Scoring of the CES-WE Essay Sub-Test 8.3 Analytical Framing & Essay Outlining for Policy Issues 8.4 Model Essay Responses & Executive Writing Standards

3.4 Data-Driven Decision Making & Analytical Pitfalls

Key Takeaways Explain This Topic AI

Data-driven decision making in public administration requires evaluating statistical validity, risk probabilities, and potential systemic biases rather than relying solely on surface-level metrics.

Selecting the appropriate measure of central tendency depends on data distribution; median is preferred over mean for highly skewed datasets such as household income or real property values.

Simpson's Paradox occurs when a statistical trend observed within sub-groups disappears or completely reverses when those sub-groups are combined into an aggregate dataset.

Confusing correlation with causation leads to flawed policy interventions, as two variables may covary due to a shared third confounding variable or spurious coincidence.

Ecological fallacy involves drawing improper inferences about individual members of a group based exclusively on aggregate statistics from the overall group level.

Last updated: July 2026

3.4 Data-Driven Decision Making & Analytical Pitfalls

In modern public governance, executive leaders are tasked with implementing Evidence-Based Policy Making (EBPM) . Relying on intuition, political pressure, or flawed statistical analysis leads to misallocated public resources and policy failure. Data-driven decision making requires not only calculating descriptive statistics but also critically auditing analytical methodologies to uncover hidden biases, logical fallacies, and statistical paradoxes. The CES-WE evaluates an executive's ability to interpret statistical measures correctly and identify analytical traps in policy proposals.

Fundamentals of Evidence-Based Policy Making (EBPM)

Evidence-Based Policy Making structures decision-making around systematically gathered empirical data. Executives evaluate policy options using an established hierarchy of evidence: HIERARCHY OF PUBLIC POLICY EVIDENCE

  • +------------------------------------------------------------------+
  • | 1. Meta-Analyses & Systematic Reviews of Policy Evaluations | <-- Highest Rigor
  • | 2. Randomized Controlled Trials (RCTs) & Experimental Studies |
  • | 3. Quasi-Experimental & Difference-in-Differences Studies |
  • | 4. Observational Time-Series & Cross-Sectional Econometrics |
  • | 5. Administrative Case Studies, Expert Panel Opinions & Audits | <-- Contextual
  • +------------------------------------------------------------------+
  • Balancing Rigor with Administrative Reality

While quantitative rigor is paramount, executive civil servants must balance statistical findings against three practical operational constraints:

Fiscal Feasibility : Cost-benefit ratios and long-term budgetary sustainability.

Administrative Capacity : Institutional readiness of frontline personnel to execute the policy.

Equity & Legal Compliance : Alignment with constitutional mandates and social justice provisions.

Measures of Central Tendency & Dispersion in Policy Contexts

Selecting the correct statistical summary metric is critical for executive reporting:

1. Central Tendency Metrics

Arithmetic Mean (Average) : X ˉ = ∑ X i N \bar{X} = \frac{\sum X_i}{N} X ˉ = N ∑ X i ​ ​

Strengths : Incorporates every data point; ideal for symmetric distributions (e.g., standardized exam scores).

Weakness : Highly sensitive to extreme outliers. In public finance, a few ultra-wealthy individuals or extremely high-cost infrastructure projects distort the mean upward.

Median (50th Percentile) :

The middle value when data points are arranged in order.

Strengths : Robust against extreme outliers and skewed distributions.

Policy Application : Always prefer the Median when reporting skewed public datasets such as household income, land parcel values, municipal procurement lead times, or agricultural landholding sizes.

Mode :

The most frequently occurring value in a dataset.

Policy Application : Identifies modal service demand categories, standard permit processing codes, or frequent audit non-compliance types. SYMMETRIC DISTRIBUTION SKEWED DISTRIBUTION (e.g., Income)

  • /\ / / \ / / \ / \________
  • Mean=Median=Mode Mode Median Mean (Pulled by Outliers)
  • 2. Measures of Dispersion

Disparity across administrative regions or service units cannot be detected by central tendency alone.

Range : Difference between maximum and minimum values ( X max − X min X_{\text{max}} - X_{\text{min}} X max ​ − X min ​ ). Simple but vulnerable to single extreme outliers.

Standard Deviation ( σ \sigma σ ) & Variance ( σ 2 \sigma^2 σ 2 ) : Quantifies how widely individual values deviate from the mean: σ = ∑ ( X i − X ˉ ) 2 N \sigma = \sqrt{\frac{\sum (X_i - \bar{X})^2}{N}} σ = N ∑ ( X i ​ − X ˉ ) 2 ​ ​

Executive Significance : In civil service delivery audits, a low mean processing time accompanied by a high standard deviation indicates severe operational inconsistency—some citizens receive service in 2 days while others wait 60 days.

Key Analytical Pitfalls & Statistical Fallacies

Executive civil servants must scrutinize policy submissions for five classic analytical traps:

1. Simpson's Paradox

Simpson's Paradox occurs when a statistical trend or pattern visible within distinct sub-groups disappears or completely reverses when those sub-groups are aggregated together.

Cause : Driven by unbalanced sample sizes or lurking confounding variables across sub-groups.

Public Sector Case : Suppose Hospital A has a higher overall patient mortality rate (8%) than Hospital B (5%). However, when patients are split into "Critical Cases" and "Minor Cases", Hospital A achieves lower mortality in both sub-groups. Hospital A's overall rate appears worse simply because it handles a far higher proportion of critical cases.

2. Correlation vs. Causation (Spurious Correlation)

Assuming that because two variables move together ( Correlation r ≠ 0 \text{Correlation } r \neq 0 Correlation r  = 0 ), one causes the other.

Confounding Variable Trap : Two variables may co-vary due to a third unaccounted variable. For example, municipal ice cream sales and drowning incidents correlate strongly, but both are caused by summer heatwaves, not by ice cream consumption.

Policy Danger : Spending public funds to eliminate a non-causal correlate will fail to improve policy outcomes.

3. Ecological Fallacy

Making improper inferences about an individual based solely on aggregate group-level statistics.

Example : Assuming that an individual residing in a province with a high average household income must be wealthy, ignoring intra-provincial wealth inequality and localized poverty pockets.

4. Survivorship Bias & Selection Bias

Evaluating program success based only on entities that passed through a selection filter while ignoring those that dropped out or failed.

Example : Assessing a public vocational training program by interviewing only employed graduates, ignoring the 40% of enrollees who dropped out due to program flaws.

5. Base Rate Fallacy & False Positive Paradox

Misjudging risk by ignoring baseline prevalence rates when evaluating screening or audit algorithms.

Executive Multi-Criteria Decision Analysis (MCDA)

When selecting between competing public policy proposals, executives construct weighted decision matrices: Composite Score = ∑ i = 1 k ( W i × S i ) \text{Composite Score} = \sum_{i=1}^{k} \left( W_i \times S_i \right) Composite Score = i = 1 ∑ k ​ ( W i ​ × S i ​ )

where W i W_i W i ​ is the weight of criterion i i i ( ∑ W i = 1.0 \sum W_i = 1.0 ∑ W i ​ = 1.0 ) and S i S_i S i ​ is the option's score for criterion i i i .

Sample Weighted Executive Decision Matrix

  • Evaluation Criterion Weight ( W i W_i W i ​ ) Option A (Regional Hub) Option B (Distributed LGUs)
  • Cost Efficiency 0.30 8.0 (Score: 2.40) 5.0 (Score: 1.50)
  • Social Equity Impact 0.40 6.0 (Score: 2.40) 9.0 (Score: 3.60)
  • Administrative Speed 0.30 7.0 (Score: 2.10) 6.0 (Score: 1.80)
  • Composite Score 1.00 6.90 6.90

Loading diagram... Executive Protocol for Identifying Statistical Fallacies