Study guide

8.3 A.7 Data for AI Systems

PECB ISO/IEC 42001 Lead Auditor AI Management

Track your progress as you read

Finished sections get a check mark.

1 Chapter 1: Exam Orientation & AI Landscape

1.1 Current Exam Facts & PECB Credential Path 1.2 AI Concepts & ISO/IEC 22989 Terminology 1.3 AI Lifecycle & Trustworthiness Characteristics

2 Chapter 2: ISO AI Family & AIMS Purpose

2.1 ISO/IEC AI Standards Family 2.2 AIMS Purpose, PDCA & Management System Thinking 2.3 Global AI Governance Landscape for Auditors

3 Chapter 3: AIMS Requirements — Context & Leadership

3.1 Annex SL High-Level Structure & Clauses Overview 3.2 Clause 4 Context of the Organization 3.3 Clause 5 Leadership & AI Policy

4 Chapter 4: AIMS Requirements — Planning

4.1 Clause 6.1 Risks, Opportunities & AI Risk Assessment 4.2 Clause 6.1.4 AI System Impact Assessment 4.3 Clause 6.2 AI Objectives & Planning to Achieve Them 4.4 Clause 6.3 Planning of Changes

5 Chapter 5: AIMS Requirements — Support & Operation

5.1 Clause 7 Support 5.2 Clause 8 Operation & Operational Planning and Control 5.3 Clause 8 AI System Lifecycle Controls in Operation

6 Chapter 6: AIMS Requirements — Evaluation & Improvement

6.1 Clause 9 Performance Evaluation 6.2 Clause 10 Improvement 6.3 Integrated AIMS–ISMS Thinking for Auditors

7 Chapter 7: Annex A Controls — Governance & Resources

7.1 Annex A Architecture: 38 Controls Across A.2–A.10 7.2 A.2 Policies Related to AI & A.3 Internal Organization 7.3 A.4 Resources for AI Systems 7.4 A.5 Assessing Impacts of AI Systems

8 Chapter 8: Annex A Controls — Lifecycle & Data

8.1 A.6 AI System Life Cycle — Design, Development, Verification 8.2 A.6 Deployment, Operation, Monitoring & Documentation 8.3 A.7 Data for AI Systems 8.4 Bias, Fairness & Data Quality Audit Focus

9 Chapter 9: Annex A Controls — Transparency, Use & Third Parties

9.1 A.8 Information for Interested Parties 9.2 A.9 Use of AI Systems 9.3 A.10 Third-Party and Customer Relationships

10 Chapter 10: Fundamental Audit Concepts (ISO 19011)

10.1 Seven Audit Principles 10.2 Audit Types, Objectives, Criteria & Scope 10.3 Evidence-Based & Risk-Based Audit Approaches 10.4 Auditor Competence, Ethics & Impartiality

11 Chapter 11: Preparing an ISO/IEC 42001 Audit

11.1 Initiating the Audit & Feasibility 11.2 Determining Audit Objectives, Scope & Criteria 11.3 Document Review & Stage 1 Readiness 11.4 Audit Plan, Team & Working Documents

12 Chapter 12: Conducting an ISO/IEC 42001 Audit

12.1 Opening Meeting & On-Site Kickoff 12.2 Collecting Evidence: Interviews, Observation, Documents 12.3 AI-Specific Evidence: Model Cards, Lineage, Logs, Impact Assessments 12.4 Sampling Strategies & Generating Findings

13 Chapter 13: Closing an ISO/IEC 42001 Audit

13.1 Classifying Nonconformities & Observations 13.2 Audit Conclusions & Closing Meeting 13.3 Writing the Audit Report 13.4 Corrective Action Follow-Up & Verification

14 Chapter 14: Managing the AIMS Audit Program

14.1 Establishing & Implementing an Audit Program 14.2 Program Resources, Risks & Opportunities 14.3 Monitoring, Reviewing & Improving the Program 14.4 Certification Cycle: Surveillance, Recertification & Multi-Standard Audits

8.3 A.7 Data for AI Systems

Key Takeaways Explain This Topic AI

Annex A.7 governs data used to develop, evaluate, and enhance AI systems—acquisition, quality, provenance, and preparation under defined responsibilities.

Data acquisition controls address lawful/authorized collection, licensing, consent where relevant, and fitness of sources—not only “we scraped a lot.”

Data quality for AI is multi-dimensional (accuracy, completeness, representativeness, timeliness, consistency) and must be measured for the intended task.

Provenance and lineage enable auditors to answer where data came from, how it was transformed, and which model versions consumed which snapshots.

Strong audit evidence includes datasheets, lineage graphs, quality metrics, access controls, and preparation pipelines that are versioned and reviewable.

Last updated: August 2026

8.3 A.7 Data for AI Systems

Auditor focus: Models inherit the virtues and vices of their data. Annex A.7 (Data for AI systems) asks whether the organization governs training, validation, test, and enhancement data with the same seriousness as production code—quality, origin, preparation, and rights.

Control objective and typical A.7 map

Control (common map) Intent Primary auditor questions

A.7.2 Data for AI systems Overall data management for AI development/enhancement Are policies, roles, and inventories defined for AI data assets?

A.7.3 Data acquisition Obtain data appropriately Legal basis, licenses, contracts, collection methods, suitability?

A.7.4 Data quality Fit for purpose Defined dimensions, metrics, thresholds, remediation?

A.7.5 Data provenance Origin and lineage Can the chain of custody and transformations be reconstructed?

A.7.6 Data preparation Clean, label, transform under control Versioned pipelines, labeling QA, documented transforms?

A.7 interfaces with A.6 (especially development and V&V data), A.5 (impact—who is affected by data gaps), A.4 (data/compute resources), privacy/security (often ISMS), and A.10 (third-party data and foundation-model training corpora claims).

Data for development and enhancement

AI systems consume data at multiple points:

Training / fine-tuning data that shapes parameters.

Validation / test data for V&V (should be controlled against leakage).

Operational / feedback data used for monitoring and periodic enhancement.

Synthetic or augmented data, which still needs provenance and quality rules.

Inventory expectation: Data assets linked to AI systems (which model versions use which datasets/snapshots). Without inventory, sampling collapses and shadow datasets proliferate.

Enhancement risk: Continuous learning or frequent retrain can silently change behavior. Auditors check whether new data batches pass the same acquisition, quality, and preparation controls before they affect production (gate back to A.6 deploy).

Data acquisition (A.7.3)

Acquisition controls address how data enters the AI estate:

  • Source type Evidence to request
  • Internal operational systems Data sharing agreements, purpose limitation, minimization
  • Customer / user data Privacy notices, consent or other lawful basis, retention
  • Licensed third-party datasets License terms, permitted use (train vs. redistribute), restrictions
  • Public web / scrape Legal review, robots/ToS analysis, sensitive content filters
  • Human subjects / special categories Ethics approval, heightened safeguards
  • Vendor / partner feeds Contractual quality and rights clauses; security of transfer

Red flags: “Public data is free for any ML use” without review; training on customer content despite contractual prohibition; no record of who approved a new source; personal data in prompts logged without governance.

Auditor stance: You are not the general counsel, but you test whether a process exists , whether required reviews occurred for sampled datasets, and whether exclusions in the SoA are honest if acquisition control is claimed N/A.

Data quality for AI systems (A.7.4)

Quality is task-relative . A dataset can be complete for billing yet unsuitable for fair credit decisioning.

  • Dimension Example AI concern
  • Accuracy Wrong labels; sensor error
  • Completeness Missing fields correlated with subgroups
  • Consistency Conflicting schemas across sources
  • Timeliness Stale labels after concept change
  • Representativeness Under-coverage of populations in production
  • Uniqueness / duplication Leakage; inflated metrics
  • Integrity Unauthorized alteration of labels

Evidence: defined quality criteria per dataset class; measurement results (before train and periodically); defect handling; exclusion of bad batches; link between quality failures and model risk acceptance.

Trap: Single overall accuracy of a model is not a data quality program. Ask for dataset-level metrics and labeling QA (e.g., inter-annotator agreement where labels are human).

Data provenance (A.7.5)

Provenance answers: Where did this come from, what happened to it, and which models used it?

Strong lineage package:

Source system / supplier and acquisition date.

Raw storage location and access controls.

Transformation pipeline version and parameters.

Labeling vendor/version and QA outcomes.

Snapshot or feature-store version IDs consumed by training run X.

Link from training run X → model version Y → production deploy Z.

  • Weak provenance Strong provenance
  • “From the data lake” Named pipelines, job IDs, dataset semantic versions
  • Labels with no author Annotator guidelines + sample audit
  • Manual CSV email Controlled registry with checksums
  • Unknown scrape date Documented crawl window and filters

Without provenance, organizations cannot investigate poisoning, bias sources, or regulatory data-subject issues—and cannot support reproducible V&V.

Data preparation (A.7.6)

Preparation includes cleaning, normalization, feature engineering, tokenization, anonymization/pseudonymization, balancing, and labeling . Controls should ensure:

Documented recipes (not only tribal notebook knowledge).

Version control of preparation code.

Separation of train/validation/test splits with leakage prevention.

Labeling guidelines, training for annotators, quality sampling.

Privacy-preserving transforms applied before broad ML access where required.

Review when preparation changes (can alter model behavior as much as architecture).

Sampling: Pick one labeled dataset. Review guidelines, sample labeled items vs. guidelines, QA metrics, and whether disputed labels have an escalation path. Pick one feature pipeline and confirm the production features match training assumptions (train–serve skew is both A.7 and A.6.2.6 operation and monitoring).

Auditor evidence catalog

  • Evidence type What you learn
  • Datasheets for datasets / data cards Intended use, composition, collection, limitations
  • Lineage / feature store records Provenance and reuse
  • Quality dashboards & reports Whether A.7.4 is operational
  • Licenses, DPAs, consent records Acquisition legitimacy
  • Access control & DLP logs Who can alter training data
  • Preparation pipeline repos Reproducibility of transforms
  • Data incident records Poisoning, leakage, mislabel events → Clause 10
  • Interview targets

Data owner / steward for AI datasets.

ML engineer who last retrained.

Privacy/legal reviewer for a new source.

Labeling lead or vendor manager.

Scenario: Generative system fine-tuned on mixed internal documents. No license review for embedded third-party content; no datasheet; quality defined only as “enough tokens.” Findings likely under A.7.2–A.7.5 , with possible A.10 and privacy ISMS linkage. Severity rises if outputs can reproduce confidential or personal data.

Exam tip: Do not confuse A.7 (data for AI) with A.6 life cycle or with A.8 information for interested parties . Data quality failures that cause unfair outcomes also connect to section 8.4 audit techniques—but the normative home for data controls is A.7.