Study guide

12.2 Evidence Analysis — Corroboration & Evaluation

PECB ISO 14001 Lead Auditor Exam

Track your progress as you read

Finished sections get a check mark.

1 Introduction & Exam Overview

1.1 Current Exam Facts 1.2 PECB Credential Path & Requirements 1.3 ISO 14001, ISO 19011 & ISO/IEC 17021-1

2 EMS Fundamentals & ISO 14001 Context

2.1 Management Systems, EMS & ISO 14001 Applicability 2.2 ISO 14000 Family, Related Standards & Frameworks 2.3 EMS Advantages & Environmental Management Principles

3 Certification Scheme & Core EMS Concepts

3.1 Certification Process & Party Roles 3.2 Key EMS Definitions 3.3 Environmental Aspects vs Impacts

4 PDCA, Context & Leadership (Clauses 4–5)

4.1 PDCA Cycle for EMS Implementation 4.2 Clause 4 — Context of the Organization 4.3 Clause 5 — Leadership

5 Planning & Support (Clauses 6–7)

5.1 Clause 6.1 — Aspects, Compliance Obligations & Risks 5.2 Clause 6.2 — Environmental Objectives 5.3 Clause 7 — Support

6 Operation, Performance & Improvement (Clauses 8–10)

6.1 Clause 8 — Operation 6.2 Clause 9 — Performance Evaluation 6.3 Clause 10 — Improvement

7 Audit Definition, Parties & Principles

7.1 Audit Definition & First/Second/Third-Party Audits 7.2 Audit Objectives & Criteria 7.3 Audit Principles (ISO 19011)

8 Auditor Competence, Irregularities & Evidence

8.1 Irregularities & Illegal Acts in an Audit 8.2 Auditor Knowledge, Skills & Technology 8.3 Types of Audit Evidence 8.4 Evidence Reliability, Materiality & Reasonable Assurance

9 Preparing an ISO 14001 Audit

9.1 Audit Offer & Feasibility 9.2 Audit Team Roles & Auditor Rejection 9.3 Objectives, Scope, Criteria & Initial Contact 9.4 Defining the Audit Schedule

10 Stage 1 Audit & Stage 2 Planning

10.1 Stage 1 Purpose & On-Site Activities 10.2 Stage 1 Documented Information Review & Outputs 10.3 Stage 2 Planning & Activities Overview

11 Stage 2 Execution: Meetings, Guides & Evidence Collection

11.1 Audit Test Plans & Work Documents 11.2 Opening Meeting 11.3 Guides, Observers & Conflict Management 11.4 Evidence Collection Procedures

12 Evidence Tools, Analysis & Audit Findings

12.1 Evidence Collection Tools — Sampling & Technical Verification 12.2 Evidence Analysis — Corroboration & Evaluation 12.3 Types of Audit Findings 12.4 Drafting Nonconformity Reports

13 Benefit of the Doubt & Audit Record Quality

13.1 Benefit of the Doubt in Audit Judgments 13.2 Quality Reviews of Audit Records

14 Closing the Audit: Conclusions, Recommendations & Meeting

14.1 Audit Conclusions 14.2 Certification Recommendations 14.3 Closing Meeting

15 Audit Report, Follow-Up, Surveillance & Recertification

15.1 Audit Report Contents 15.2 Follow-Up, Action Plans & Surveillance Audits 15.3 Recertification & Certificate Modification, Suspension, Withdrawal

16 Managing the EMS Audit Program

16.1 Audit Program Management via PDCA 16.2 Internal vs External Audits & the Internal Audit Function 16.3 Main Activities in an Internal Audit

17 Audit Program Records & Continual Improvement

17.1 Audit Program Records — Archival, Maintenance & Protection 17.2 Monitoring, Evaluating & Improving the Audit Program

12.2 Evidence Analysis — Corroboration & Evaluation

Key Takeaways Explain This Topic AI

Analysis organizes evidence, tests quality, corroborates sources, evaluates against criteria, then classifies outcomes.

Sufficiency is risk-sensitive: high-impact environmental and compliance controls need deeper evidence than low-risk housekeeping items.

Corroboration triangulates interviews, observation, and records before declaring conformity or nonconformity.

Evaluation compares evidence to defined audit criteria, not personal best-practice preferences.

Patterns across areas support systemic conclusions; a single ambiguous point usually needs expanded sampling first.

Last updated: July 2026

12.2 Evidence Analysis — Corroboration & Evaluation

Quick Answer: After collecting evidence, auditors analyze it for sufficiency, appropriateness, and reliability; corroborate across independent sources; resolve contradictions; and evaluate results against audit criteria (ISO 14001, compliance obligations, and the organization's EMS). Findings must follow from evidence — not from auditor preference or incomplete trails.

Collection without analysis produces notebooks, not audit conclusions. Lead Auditor candidates are expected to show how evidence supports (or fails to support) conformity statements, when more evidence is needed, and how conflicting information should be handled before a finding is raised.

1. The Analysis Sequence

A practical sequence used in ISO 19011-style audits:

Organize evidence by process, clause, or risk theme

Test quality — is it relevant, reliable, and sufficient?

Corroborate — do independent sources agree?

  • Evaluate against stated audit criteria
  • Classify the outcome (conformity, nonconformity, or other finding type)
  • Record the rationale and remaining uncertainty

Skipping steps — especially corroboration — is how auditors raise unsupported nonconformities or miss systemic failures.

2. Sufficiency, Appropriateness, and Reliability

Attribute Meaning for EMS audits Weak example Stronger example

Appropriate Relevant to the criterion and scope Training matrix for sales staff used to judge wastewater competence Competence evidence for operators who sample effluent

Reliable Trustworthy source and method Unsigned handwritten "OK" with no date Controlled log with timestamps, IDs, and review

Sufficient Enough to support the conclusion at the needed confidence One good manifest for a year of hazardous waste Sample across waste streams, contractors, and time periods

Sufficiency is risk-sensitive. A low-risk housekeeping control may need less depth than a significant aspect tied to a legal discharge limit. Exam scenarios often hide this distinction: the "right" answer increases evidence depth where environmental risk and compliance risk are high.

3. Corroboration — Triangulate Before You Conclude

Corroboration means checking whether independent evidence sources tell a consistent story.

Classic EMS triangulation:

  • Say (interview): Operator explains secondary containment inspection
  • Show (observation): Containment is cracked / drain valve open to stormwater
  • Prove (record): Last inspection checklist marked "OK" the same morning

When sources conflict, do not average them into a vague feeling. Investigate:

Is the record falsified, rushed, or poorly designed?

Is the interviewee describing the intended process rather than actual practice?

Is observation during an abnormal condition (maintenance shutdown)?

Is documented information outdated relative to current operations?

Corroboration also works positively: interview + matching records + observed practice can justify a clear conformity statement for that control within the sampled scope.

4. Evaluating Against Audit Criteria

Audit criteria for an ISO 14001 audit typically include:

  • Requirements of ISO 14001:2015 (and any CB interpretation rules)
  • The organization's EMS documented information (scope, procedures, criteria it set for itself)
  • Compliance obligations the organization identified as applicable (legal and other requirements)

Evaluation rule: compare evidence to criteria , not to the auditor's personal "best practice" wishlist. If practice differs from a procedure but still meets ISO 14001 and legal requirements, you may have a documentation/control issue under the organization's own requirements — still a potential nonconformity if the organization committed to that procedure — but you must cite the correct requirement.

Performance evaluation linkage (Clause 9 thinking): Evidence that monitoring occurred is not the same as evidence that results were analyzed, evaluated against criteria, and used in decisions. Trace whether exceedances or adverse trends triggered communication, investigation, or corrective action as the EMS requires.

5. Handling Incomplete or Ambiguous Evidence

Not every gap is immediately a nonconformity. Options:

Situation Auditor action

Key record missing but process owner can retrieve from archive within audit time Continue collection; do not rush to NC

Evidence permanently unavailable for a required activity Evaluate against the requirement; likely NC if the activity was required

  • Partial sample suggests a problem Expand sample / corroborate before calling it systemic
  • Criterion itself is unclear in client's EMS Clarify intended requirement with auditee; note ambiguity
  • Team lacks technical competence to interpret data Use technical expert; do not guess

More evidence needed is a legitimate interim conclusion. Raising a major nonconformity on a single ambiguous data point without follow-up is an exam trap answer.

6. Distinguishing Fact, Inference, and Opinion

Fact: "Calibration certificate for pH meter SN-118 expired on 12 March; meter was in use on 20 March sampling run."

Supported inference: "Monitoring results from 20 March are not demonstrated as reliable under the organization's calibration control."

Opinion (avoid as a finding basis): "The lab looks disorganized, so results are probably wrong."

Findings should be written so another competent auditor could reach a similar conclusion from the same evidence. That is the fairness and evidence-based approach principles in action.

7. Systemic Patterns vs Isolated Lapses

Analysis includes deciding whether issues are isolated or indicative of system failure:

Same failure across shifts, departments, or sites

Multiple related minors against one process (e.g., competence, operational control, and monitoring all weak for one significant aspect)

  • Absence of an entire required process (no compliance evaluation performed)
  • Recurrence of a previously closed corrective action

Pattern recognition supports classification in the next section (major vs minor) and strengthens the audit conclusion. Document the pattern with multiple evidence points — do not label something "systemic" from a single slip without expansion of the sample.

8. Team Review Before Finalizing

Lead auditors facilitate team analysis: compare notes, challenge weak trails, align on criteria citations, and agree where evidence is still insufficient. Technical experts contribute interpretation; the team still decides conformity against criteria. Unresolved contradictions should be pursued before the closing meeting whenever feasible.

  • 9. Exam Traps
  • Equating "I don't like this method" with nonconformity without a criterion
  • Accepting perfect documents when observation contradicts them
  • Calling a single error systemic without expanded sampling
  • Ignoring compliance obligations when only checking ISO clause text
  • Writing conclusions that go beyond what the sample can support

Strong analysis turns raw notes into defensible findings: corroborated, criterion-linked, risk-aware, and honest about sampling limits.