Study guide
9.4 Logging, Monitoring, CloudTrail, CloudWatch, and Config
AWS AI Practitioner Study Guide Exam
Track your progress as you read
Finished sections get a check mark.
1 Chapter 1: AIF-C01 Orientation and Official Source Control
1.1 Credential Scope, Code, and Search Language 1.2 Exam Format, Cost, Score, and Delivery 1.3 Official Exam Guide, Skill Builder, and Practice Workflow 1.4 Target Candidate Boundaries and Out-of-Scope Tasks 1.5 Domain Weights and Study Prioritization 1.6 Exam Policy, Retake, Results, and Recertification
2 Chapter 2: AI/ML Foundations and Use-Case Fit
2.1 AI, ML, Deep Learning, and Core Terminology 2.2 Supervised, Unsupervised, and Reinforcement Learning 2.3 Data Types, Labels, Structure, and Quality 2.4 Inference Patterns: Batch, Real-Time, and Embedded AI 2.5 AI Use-Case Fit and No-AI Decisions 2.6 Classification, Regression, Clustering, Forecasting, and Recommendation 2.7 AI/ML Foundations Case Lab
3 Chapter 3: ML Lifecycle, Metrics, and Practitioner MLOps
3.1 Data Collection, EDA, Preprocessing, and Feature Concepts 3.2 Training, Evaluation, Deployment, and Monitoring Lifecycle 3.3 Model Sources: Managed APIs, Open Source, and Custom Models 3.4 Evaluation Metrics and Business Metrics 3.5 Practitioner MLOps: Repeatability, Monitoring, and Retraining 3.6 SageMaker Lifecycle Service Map 3.7 ML Lifecycle Case Lab
4 Chapter 4: Generative AI Foundations and Inference Concepts
4.1 Foundation Models, LLMs, Transformers, and Modalities 4.2 Tokens, Context Windows, Embeddings, and Vector Search 4.3 Inference Parameters: Temperature, Top-p, and Output Controls 4.4 Hallucination, Grounding, and Context Quality 4.5 GenAI Use-Case Fit and Risk Triage 4.6 Prompt Injection, Data Leakage, and User Input Risk 4.7 Generative AI Foundations Case Lab
5 Chapter 5: Prompting, Model Selection, Customization, and Evaluation
5.1 Prompt Engineering Patterns and Business Quality 5.2 Zero-Shot, Few-Shot, Templates, and Instruction Design 5.3 Model Selection: Capability, Latency, Cost, and Risk 5.4 RAG vs Fine-Tuning vs Prompting vs Custom Models 5.5 Model Evaluation, Human Review, and Red-Team Feedback 5.6 Cost, Performance, and Throughput Decision-Making 5.7 Prompting and Model Selection Case Lab
6 Chapter 6: Amazon Bedrock, RAG, Agents, and Guardrails
6.1 Bedrock Core Concepts, Model Access, and Managed FM Choice 6.2 Knowledge Bases, RAG, Data Sources, and Grounding 6.3 AI Agents, Tools, Orchestration, and Business Workflows 6.4 Guardrails, Content Filters, Denied Topics, and Sensitive Data 6.5 Bedrock Model Evaluation, Monitoring, and Human Feedback 6.6 Bedrock Cost, Latency, Throughput, and Operational Fit 6.7 Bedrock, RAG, and Agents Case Lab
7 Chapter 7: AWS Managed AI/ML Services and SageMaker Map
7.1 Managed AI Services vs Foundation Model Apps vs Custom ML 7.2 Text, Language, Search, and Document AI Services 7.3 Vision, Speech, Contact Center, and Personalization Services 7.4 Amazon Quick, Amazon Q Developer, Kiro, and Practitioner Fit 7.5 SageMaker Canvas, Studio, Clarify, Autopilot, and Data Wrangler 7.6 Data Foundation Services: S3, Glue, OpenSearch, and Quick Sight 7.7 AWS AI Service Selection Case Lab
8 Chapter 8: Responsible AI, Human Review, and Safety
8.1 Fairness, Bias, Transparency, and Explainability 8.2 Privacy, Safety, Human Review, and Accountability 8.3 Guardrails, Clarify, Human Review, and Content Safety Controls 8.4 Responsible AI Risk Registers and Governance Workflows 8.5 Monitoring, Feedback, Drift, and Incident Response 8.6 Responsible AI Case Lab
9 Chapter 9: Security, Compliance, Governance, and Cost Controls
9.1 Shared Responsibility, IAM, and Least Privilege for AI 9.2 Encryption, Secrets, Networking, and Data Privacy 9.3 Prompt Injection, Data Exfiltration, and GenAI Threat Modeling 9.4 Logging, Monitoring, CloudTrail, CloudWatch, and Config 9.5 Compliance: Artifact, Config, Macie, and Policy Evidence 9.6 AI Cost Controls, Pricing, Throughput, and Budget Governance 9.7 Security and Governance Case Lab
10 Chapter 10: Integrated AWS AI Business Scenario Labs
10.1 Customer Support GenAI Assistant Lab 10.2 Document Intelligence and Compliance Review Lab 10.3 Personalization, Forecasting, and Fraud Detection Lab 10.4 Enterprise Search, RAG, and Knowledge Management Lab 10.5 Responsible AI and Security Review Board Lab 10.6 Cost, Performance, and Operations Review Lab 10.7 Full AIF-C01 Business Simulation
11 Chapter 11: Final Review, Exam Readiness, and Recertification
11.1 Final 30-Day AIF-C01 Study Plan 11.2 Official Practice Resources and Weak-Domain Remediation 11.3 90-Minute Exam Timing, Flagging, and Guessing Workflow 11.4 Test-Day Checklist: Online or Test Center 11.5 Post-Exam Results, Retake, and Recertification Plan 11.6 AWS AI Practitioner Final Mixed Review
9.4 Logging, Monitoring, CloudTrail, CloudWatch, and Config
Key Takeaways Explain This Topic AI
CloudTrail records AWS API activity and helps answer who did what, when, from where, and against which AWS resource.
CloudWatch supports operational visibility through metrics, logs, dashboards, alarms, and service-specific signals such as errors, throttles, and latency where available.
AWS Config records resource configuration history and evaluates resources against rules, which helps with drift detection and compliance monitoring.
AI logging must balance troubleshooting value with privacy risk because prompts, responses, retrieved context, and traces can contain sensitive data.
A practitioner should ask which events are logged, who reviews them, where alerts go, how long logs are retained, and whether logs support audit and incident response.
Last updated: October 2026
Observability as a governance control
An AI application should leave enough evidence to answer basic operational and security questions. Who changed model access? Which application role invoked a model? Did an agent call a fulfillment function? Are requests failing because of throttling? Did a bucket policy drift from the approved standard? Logging and monitoring make those questions answerable. Without them, governance becomes a policy document with no feedback loop.
AWS CloudTrail records AWS API activity for an account. It helps teams investigate who made a call, what action was requested, when it happened, where it came from, and which resource was involved. For AI scenarios, CloudTrail can help track administrative and service API activity such as changes to Bedrock resources, IAM policies, S3 access, Lambda actions, or SageMaker AI resources. It is not a replacement for application-level logs, but it is a core audit source.
Amazon CloudWatch provides metrics, logs, dashboards, and alarms. An AI team might use CloudWatch metrics to watch invocation counts, latency, errors, throttles, and downstream service health where the service publishes those signals. Application logs can capture request IDs, user IDs, guardrail outcomes, retrieval IDs, and tool execution status. Alarms can notify teams when errors spike, latency exceeds a threshold, or usage patterns look abnormal.
AWS Config records configuration changes for supported AWS resources and can evaluate them against rules. This is useful when governance depends on configuration state. For example, Config can help detect whether S3 buckets meet encryption expectations, whether public access settings changed, or whether resource configurations drift from approved baselines. It does not decide whether a model answer was correct; it helps monitor the AWS resource environment around the AI workload.
Monitoring source Best at answering AI governance example
CloudTrail Who called which AWS API and when? Investigate who changed model access, IAM policies, or logging settings.
CloudWatch Metrics Is the workload healthy and within expected behavior? Watch invocation volume, errors, latency, throttles, and function failures.
CloudWatch Logs What happened inside the application or service flow? Review request IDs, retrieval status, guardrail outcomes, or agent tool calls.
AWS Config Did resource configuration change or drift from policy? Detect storage, network, or encryption configuration changes.
Service-specific reports What did the AI service or security service detect? Review Macie findings, Guardrails activity, or model invocation logs where enabled.
The hardest logging decision in AI is content sensitivity. Prompts and responses are valuable for debugging hallucinations, policy failures, prompt injection attempts, and user complaints. They can also contain confidential information, personal data, secrets, or regulated content. A team should decide whether to log full content, metadata only, redacted content, or sampled content. The answer may differ between sandbox and production.
Model invocation logging, application traces, and agent traces should be treated as sensitive if they include prompt text, retrieved passages, intermediate reasoning traces, tool inputs, or response content. Those destinations need encryption, IAM controls, retention rules, and access review. A support engineer may need operational metadata, but not every engineer needs full customer transcripts or legal document excerpts.
Monitoring should include both technical and business signals. Technical signals include failed invocations, throttling, Lambda errors, vector store failures, timeouts, and access denied errors. Business signals include user escalation rates, blocked guardrail events, low-quality feedback, high-risk output categories, and unexpected action attempts. A practitioner should ask how the team will notice that the AI solution is not behaving as intended.
Incident response benefits from correlation IDs. If a user reports a harmful answer, the team should be able to trace the user session, model invocation, retrieved sources, guardrail result, tool call, and output if policy allows. If an agent created an incorrect ticket, the team should know which tool was called, with which parameters, by which application role, and whether the downstream system accepted the action.
Monitoring workflow for an AI release:
Identify the questions logs must answer for audit, support, privacy, and incident response.
Enable CloudTrail and protect trails according to organizational policy.
Decide which application and model invocation details should be logged.
Send operational metrics and errors to CloudWatch dashboards and alarms.
Use AWS Config or equivalent controls to monitor configuration drift for key resources.
Protect logs with encryption, IAM, retention, and review processes.
Test an incident scenario before launch and confirm the team can reconstruct the event.
Scenario: an AI agent on AWS starts returning access denied errors. CloudWatch logs might show failed Lambda calls or application errors. CloudTrail can show whether an IAM policy changed. AWS Config can show whether a resource configuration drifted. Together, these services help narrow the cause without guessing from the model response alone.
Scenario: a public assistant suddenly receives many prompt injection attempts. Application logs and Guardrails events can show blocked prompts or unusual input patterns. CloudWatch alarms can alert on volume spikes. CloudTrail can help confirm whether permissions were changed during the same period. The response may involve tightening guardrails, reviewing source documents, and checking whether any sensitive output was returned.
For AWS Skill Builder practice, do not treat CloudTrail, CloudWatch, and Config as interchangeable. CloudTrail is about API activity. CloudWatch is about metrics, logs, alarms, and operations. Config is about resource configuration history and compliance checks. Knowing that boundary is enough for many practitioner scenarios.