Study guide
9.2 Lineage, Fairness, Transparency & Continuous Governance
AWS Certified Generative AI Developer - Professional AIP-C01
Track your progress as you read
Finished sections get a check mark.
1 Chapter 1: Exam Overview & Foundation Model Fundamentals
1.1 AIP-C01 Exam Structure, Logistics & Passing Strategy 1.2 AIP-C01 Scoring & Professional Decision Strategy 1.3 Foundation Model Landscape & Model Selection on Amazon Bedrock 1.4 Model Abstraction, Controlled Switching & Resilience 1.5 Customization Spectrum: Prompting vs RAG vs Fine-Tuning vs Continued Pre-training 1.6 Custom Model Deployment & Lifecycle Management
2 Chapter 2: Bedrock Knowledge Bases & RAG Architectures
2.1 Managed RAG Architecture with Bedrock Knowledge Bases 2.2 Knowledge Source Integration, Synchronization & Freshness 2.3 Data Ingestion, Parsing & Chunking Strategies 2.4 Embedding Models & Vector Representations 2.5 Vector Index Scale, Migration & Retrieval Evaluation 2.6 Vector Database Selection: OpenSearch Serverless vs Aurora pgvector vs Managed Stores 2.7 Vector Store Security, Multi-Tenancy & Connectivity
3 Chapter 3: Advanced Vector Search, Indexing & Data Compliance
3.1 Hybrid Search, Metadata Filtering & Semantic Reranking 3.2 Metadata Filtering, Reranking & Query Transformation 3.3 Fine-Tuning & Continued Pre-Training Data Pipeline Engineering 3.4 Data Validation, Multimodal Processing & Model Formatting 3.5 Data Privacy, Data Residency & Compliance Governance 3.6 Privacy Preservation, Source Lineage & Audit Evidence
4 Chapter 4: Prompt Engineering & Bedrock Runtime APIs
4.1 Advanced Prompt Engineering Techniques & Inference Parameters 4.2 Inference Parameters, Prompt Governance & Regression 4.3 Converse API vs InvokeModel API & Message Formatting 4.4 Tool Calling, FM API Resilience & Model Routing 4.5 Streaming Architectures & Asynchronous Event Processing 4.6 Resilient Streaming, Deployment & Asynchronous Processing
5 Chapter 5: Amazon Bedrock Agents & Tool Integration
5.1 Agentic Architecture, ReAct Reasoning Loops & Orchestration 5.2 Agent Frameworks, MCP & Lifecycle Management 5.3 Action Groups, OpenAPI Schemas & AWS Lambda Integration 5.4 Agent Memory, Session State & Multi-Agent Collaboration Patterns 5.5 Persistent State & Multi-Agent Coordination 5.6 Advanced Agent Prompt Templates & Flow Customization 5.7 Agent Safeguards, Tool Reliability & Cost Control
6 Chapter 6: Workflow Orchestration & Application Integration
6.1 Amazon Bedrock Prompt Flows & Visual Orchestration 6.2 Step Functions Orchestration & Human-in-the-Loop Workflows 6.3 Enterprise Integration: API Gateway, AppSync, and EventBridge 6.4 Hybrid Integration, GenAI Gateways & CI/CD Tooling
7 Chapter 7: AI Safety & Guardrails for Amazon Bedrock
7.1 Guardrails Architecture, Denied Topics & Content Filters 7.2 Content Safety, Defense in Depth & Threat Detection 7.3 Sensitive Information Filters & PII Redaction/Masking 7.4 Contextual Grounding Checks & Hallucination Prevention
8 Chapter 8: Security, Access Control & Network Architecture
8.1 IAM Least Privilege & Resource Policies for Bedrock 8.2 PrivateLink VPC Endpoints & Network Isolation 8.3 Encryption with AWS KMS & Cross-Account Access Patterns
9 Chapter 9: Governance, Auditing & Operational Logging
9.1 SageMaker Model Cards & AI Governance Frameworks 9.2 Lineage, Fairness, Transparency & Continuous Governance 9.3 Invocation Logging, CloudTrail Auditing & Observability 9.4 Responsible AI, Bias Mitigation & Red Teaming Methodologies
10 Chapter 10: Performance, Throughput & Cost Optimization
10.1 On-Demand vs Provisioned Throughput & Capacity Planning 10.2 Capacity Measurement, Scaling Patterns & Resilience 10.3 Batch Inference & Bedrock Intelligent Prompt Routing 10.4 Intelligent Prompt Routing & Application Eligibility 10.5 Prompt Caching, Token Optimization & Latency Reduction
11 Chapter 11: Testing, Evaluation & Troubleshooting GenAI Solutions
11.1 Amazon Bedrock Model Evaluation (Automatic & Human Workflows) 11.2 Human, RAG & Continuous Evaluation 11.3 Evaluation Metrics & RAG Quality Benchmarking (Ragas, ROUGE, BLEU) 11.4 RAG and Agent Performance Evaluation 11.5 CloudWatch Metrics, Throttling & Operational Observability 11.6 Quota Diagnosis, Retry Control & Operational Troubleshooting 11.7 Troubleshooting Common GenAI Failure Modes & Agent Traces 11.8 Prompt Maintenance, Content Handling & Deployment Validation
9.2 Lineage, Fairness, Transparency & Continuous Governance
Key Takeaways Explain This Topic AI
Lineage records stable versions and identifiers without copying restricted source content into open logs.
Fairness evaluation compares relevant slices and documents sample size, blind spots, and remediation decisions.
Continuous governance maps drift, misuse, policy, and complaint signals to rollback, review, or quarantine actions.
Last updated: September 2026
- 9.2 Lineage, Fairness, Transparency & Continuous Governance
- Lineage and traceability
Traceability connects an output back to the components that could have influenced it. Record the source dataset or document snapshot, preprocessing version, training or adapter job, evaluation dataset, prompt version, Guardrail version, application release, and deployment target. AWS Glue Data Catalog can register governed data sources; SageMaker lineage and Model Registry can track training and model artifacts; CloudTrail can record management activity; application telemetry can connect a request to approved component versions.
Do not put secrets or raw personal data in governance metadata. Use stable identifiers, hashes, versioned S3 locations, and access-controlled evidence stores. If a data source changes, preserve the version that supported the evaluation or document why a reproducible snapshot is not legally permitted.
Source attribution in generated output is related but different. A RAG response can cite the passages it used, while governance lineage explains how the overall system was built and approved. Both are necessary for many audits.
Transparency, fairness, and responsible operation
Transparency should be useful to the affected user. Disclose that content is AI-generated where appropriate, show source evidence, communicate uncertainty, and provide an escalation path. Do not expose hidden reasoning traces or sensitive prompts merely to appear transparent. Bedrock agent traces are an operator diagnostic and can contain sensitive context; they are not automatically a safe end-user explanation.
Fairness evaluation starts by defining the decision context and potentially affected groups. Construct representative test slices, compare error or refusal rates, inspect counterfactual pairs, and involve domain reviewers. Aggregate quality can hide a severe subgroup failure. Document the metric choice, sample size, known blind spots, and remediation decision in the governance record.
Continuous governance watches for drift, misuse, policy violations, and incidents after release. Useful signals include safety-filter interventions, unauthorized tool attempts, response-quality samples, subgroup metrics, retrieval-source changes, complaints, and model-version changes. Alerts should lead to a defined action: pause traffic, require human approval, roll back a version, quarantine a source, or open a review.
Governance workflow
Define the use case, risk tier, owner, and non-goals.
Register model, prompt, retrieval, and tool versions.
Attach evaluation and red-team evidence.
Review privacy, security, safety, fairness, and operational controls.
Approve a specific release configuration.
Monitor it against stated thresholds.
Create a new review when a material dependency changes.
Retire the release and retain required evidence.
The key exam distinction is precise: use SageMaker Model Cards and Model Registry for customer governance documentation and version records, while using Bedrock, IAM, Guardrails, CloudTrail, data catalogs, and application controls to implement and observe the governed GenAI system.
Worked fairness and transparency review
Suppose a recruiting assistant summarizes candidate materials but does not make the hiring decision. Build evaluation slices across relevant job families, languages, document formats, and demographic proxies that legal and ethics reviewers approve. Compare omission, hallucination, sentiment, and refusal behavior, then inspect counterfactual pairs that change only a sensitive attribute. A global average can hide a subgroup with a much higher omission rate.
The user-facing interface should disclose the assistant's role, show source evidence used in a summary, allow correction, and direct disputed cases to a human. Do not expose hidden chain-of-thought or raw operator traces; provide evidence and a concise explanation appropriate to the decision context.
After release, monitor sampled quality, complaints, override rates, safety interventions, source changes, and slice metrics. A material model, prompt, data, Guardrail, or workflow change reopens review. Define who can pause the system and how affected records are reprocessed after a defect.
For forensic traceability, connect a request to release and source identifiers under restricted access. Use separate storage for raw content when retention is lawful and necessary. Governance is stronger when it can reconstruct the configuration without creating a second uncontrolled copy of sensitive data.
Policy-as-code connection
Where possible, turn approval statements into tests and configuration checks. A prohibited tool can be absent from the release manifest; an allowed Region can be checked in deployment policy; a required Guardrail version can be asserted in integration tests; an evaluation threshold can block promotion. Preserve human judgment for ambiguous risk, but automate the controls that have deterministic evidence.
Set an expiration date on approvals for high-risk systems. A scheduled review forces owners to reconfirm data, model, metrics, and controls even when no incident triggered an earlier assessment.