Study guide

9.2 How to Judge Effectiveness

USA Hire Assessment OPM Federal Clerical and Administrative Hiring Assessment

Track your progress as you read

Finished sections get a check mark.

1 Chapter 1: How USA Hire Works

1.1 What USA Hire Is and Which Assessments You Will Take 1.2 From USAJOBS Application to Assessment Invitation 1.3 The Testing Window, Deadlines, and Automatic Ineligibility

2 Chapter 2: Cut Scores, Test-Day Mechanics, and Preparation

2.1 Cut Scores, the Cut-Score Job Series, and Referral 2.2 The Five-Minute Item Clock, RECORD ANSWER, and No Review 2.3 Calculator, Scratch Paper, Devices, and the Testing Environment 2.4 Score Retention, Reuse, and the One-Year Retest Rule 2.5 Official Practice Assessments and Reasonable Accommodation

3 Chapter 3: Occupational Reading — The Core Method

3.1 The Closed-Text Principle and the Five-Minute Reading Method 3.2 Locating Stated Facts, Conditions, and Exceptions 3.3 Vocabulary in Context, Word Parts, and Precise Wording

4 Chapter 4: Occupational Reading — Tables, Application, and Inference

4.1 Reading Tables, Schedules, and Rate Charts 4.2 Applying Written Rules to Specific Situations 4.3 Supported Conclusions vs. Unsupported Assumptions

5 Chapter 5: Occupational Math — Arithmetic and Number Sense

5.1 Arithmetic, Word Problems, and Translating Words into Operations 5.2 Fractions 5.3 Decimals, Money, and Rounding 5.4 Estimation, Calculator Discipline, and Checking Your Work

6 Chapter 6: Occupational Math — Percentages and Proportional Reasoning

6.1 Percentages: Finding the Part, the Whole, and the Rate 6.2 Percent Increase, Percent Decrease, and Reverse Percentages 6.3 Ratios, Proportions, and Unit Rates

7 Chapter 7: Occupational Math — Algebra, Geometry, and Probability

7.1 Basic Algebra 7.2 Basic Geometry and Measurement 7.3 Basic Probability

8 Chapter 8: Occupational Reasoning

8.1 What the Occupational Reasoning Assessment Actually Asks 8.2 Drawing Logical Conclusions from Given Statements 8.3 Analysing Scenarios and Tracking Conditions 8.4 Evaluating Arguments: Assumptions, Flaws, and Support

9 Chapter 9: Occupational Judgment

9.1 The Video Format: Most and Least Effective 9.2 How to Judge Effectiveness 9.3 Recurring Scenario Families and How to Work Them

10 Chapter 10: Occupational Interaction — Format and Personal Effectiveness

10.1 The Untimed Interaction Assessment and Its Response Scales 10.2 Accountability and Self-Management 10.3 Attention to Detail and Learning 10.4 Flexibility and Stress Tolerance

11 Chapter 11: Occupational Interaction — Working With Others

11.1 Customer Service and Interpersonal Skills 11.2 Integrity/Honesty 11.3 Teamwork and Influencing/Negotiating

12 Chapter 12: Other USA Hire Assessments You May Be Assigned

12.1 The Early Career Talent Assessment (ECTA) 12.2 Premium, Supervisory, and Custom USA Hire Assessments

9.2 How to Judge Effectiveness

Key Takeaways Explain This Topic AI

The Occupational Judgment Assessment measures Decision Making: making sound, well-informed and objective decisions, perceiving their impact and implications, and committing to action even in uncertain situations.

Effective actions typically address the actual problem directly, use available resources, and keep the right people informed.

Least effective actions typically ignore the problem, pass it to someone else without cause, act on assumptions rather than facts, or create a new problem.

The Early Career Judgment Assessment uses an explicit five-point effectiveness scale that illustrates how OPM frames effectiveness.

OPM's own advice is to answer honestly rather than to guess at an idealised response.

Last updated: September 2026

9.2 How to Judge Effectiveness

Quick Summary: The competency measured is Decision Making : makes sound, well-informed, and objective decisions; perceives the impact and implications of decisions; commits to action, even in uncertain situations, to accomplish organizational goals; causes change. Every clause in that definition is a criterion you can apply to a course of action.

What OPM's own effectiveness scale looks like

OPM publishes an explicit five-point effectiveness scale for the Early Career Judgment Assessment , and it is the clearest available statement of how OPM frames effectiveness in a judgment context:

Rating Definition

1. Highly Ineffective The response is not constructive in this situation and risks negative consequences.

2. Ineffective The response has limited value and does not address the situation well.

3. Somewhat Effective The response is reasonable in this situation, but the solution is incomplete or does not directly address the issue.

4. Effective The response is a useful action that directly addresses the situation in a constructive way.

5. Highly Effective The response is one of the best and most effective possible actions given the information provided.

Read the middle rows carefully, because they define the boundary you will be judging.

Somewhat Effective is reasonable but incomplete, or does not directly address the issue. Effective is useful and directly addresses the situation. The dividing line is directness — whether the action engages the actual problem or works around its edges.

Highly Ineffective is not merely unhelpful; it risks negative consequences . That is your marker for the least effective option: look for the action that could make things worse, not just the one that achieves least.

Note too the closing phrase in the top row: given the information provided . Effectiveness is judged against what is known in the scenario, not against what an ideal actor with perfect information would do.

Characteristics of effective actions

Drawing the competency definition and the scale together:

Addresses the actual problem. Identify what the problem in the scenario really is. If a colleague missed a deadline because they did not know how to use a system, then training or help with the system addresses it; a reminder about deadlines does not.

Well-informed. Sound decisions rest on facts. Actions that gather relevant information before acting — asking a clarifying question, checking the record — usually score better than actions taken on assumption, provided information-gathering is not merely a way of postponing action.

Objective. Decisions rest on the situation rather than on personal preference or on who is involved.

Commits to action. The definition explicitly includes commits to action, even in uncertain situations . Options that do nothing, wait indefinitely, or hope the problem resolves itself are weak, and uncertainty is not a reason to avoid acting.

Perceives impact and implications. Strong actions consider consequences for others — the customer waiting, the colleague depending on the output, the deadline that follows.

Keeps the right people informed. Where an action affects others or exceeds what you can resolve, informing a supervisor or colleague is part of the effective response.

Characteristics of ineffective actions

The least effective option normally shows one of these patterns:

  • Pattern Example
  • Ignores the problem Do nothing and hope it resolves
  • Avoids without cause Pass the whole matter to someone else when you could handle it
  • Acts on assumption Conclude a colleague is being careless without checking
  • Creates a new problem Solve your issue by disrupting someone else's work
  • Risks negative consequences Discuss a colleague's error with uninvolved staff
  • Addresses a symptom only Fix today's error without addressing why it happened
  • Disproportionate escalation Take a routine question straight to senior management

The last row deserves a note. Escalation is not automatically good or bad — it depends on proportion. Escalating a matter you can resolve yourself is weak; failing to escalate something that genuinely exceeds your authority is also weak. Ask whether the level of response matches the size of the problem.

The two poles are usually clear

Because you select only the extremes, focus your effort there.

For the most effective , look for the option that directly addresses the actual problem, uses available information, and accounts for the people affected. On the five-point scale, you are looking for a 4 or 5.

For the least effective , look for the option that risks making things worse. On the scale, a 1 rather than a 2. If two options both seem weak, prefer the one with a negative consequence over the one that is merely unhelpful.

That distinction — harmful versus merely inadequate — is the most useful tiebreaker in the whole assessment.

Two false heuristics to avoid

"Always ask the supervisor." Deferring every decision upward contradicts commits to action and, in routine matters, is only somewhat effective at best. Involve a supervisor when the matter genuinely warrants it.

"Always choose the most thorough option." An action can be thorough and still miss the point, or be disproportionate to a small problem. Directness beats elaborateness.

And OPM's own advice

OPM's tips for this assessment are to read thoroughly, be honest , and stay true to yourself — don't overthink . The framework above is a way of thinking clearly about what would genuinely work, which is not the same as guessing at a scoring key. Where your considered judgement and a clever theory about "what they want" diverge, OPM's guidance points toward the former.