Study guide

5.7 Prompting and Model Selection Case Lab

AWS AI Practitioner Study Guide Exam

Track your progress as you read

Finished sections get a check mark.

1 Chapter 1: AIF-C01 Orientation and Official Source Control

1.1 Credential Scope, Code, and Search Language 1.2 Exam Format, Cost, Score, and Delivery 1.3 Official Exam Guide, Skill Builder, and Practice Workflow 1.4 Target Candidate Boundaries and Out-of-Scope Tasks 1.5 Domain Weights and Study Prioritization 1.6 Exam Policy, Retake, Results, and Recertification

2 Chapter 2: AI/ML Foundations and Use-Case Fit

2.1 AI, ML, Deep Learning, and Core Terminology 2.2 Supervised, Unsupervised, and Reinforcement Learning 2.3 Data Types, Labels, Structure, and Quality 2.4 Inference Patterns: Batch, Real-Time, and Embedded AI 2.5 AI Use-Case Fit and No-AI Decisions 2.6 Classification, Regression, Clustering, Forecasting, and Recommendation 2.7 AI/ML Foundations Case Lab

3 Chapter 3: ML Lifecycle, Metrics, and Practitioner MLOps

3.1 Data Collection, EDA, Preprocessing, and Feature Concepts 3.2 Training, Evaluation, Deployment, and Monitoring Lifecycle 3.3 Model Sources: Managed APIs, Open Source, and Custom Models 3.4 Evaluation Metrics and Business Metrics 3.5 Practitioner MLOps: Repeatability, Monitoring, and Retraining 3.6 SageMaker Lifecycle Service Map 3.7 ML Lifecycle Case Lab

4 Chapter 4: Generative AI Foundations and Inference Concepts

4.1 Foundation Models, LLMs, Transformers, and Modalities 4.2 Tokens, Context Windows, Embeddings, and Vector Search 4.3 Inference Parameters: Temperature, Top-p, and Output Controls 4.4 Hallucination, Grounding, and Context Quality 4.5 GenAI Use-Case Fit and Risk Triage 4.6 Prompt Injection, Data Leakage, and User Input Risk 4.7 Generative AI Foundations Case Lab

5 Chapter 5: Prompting, Model Selection, Customization, and Evaluation

5.1 Prompt Engineering Patterns and Business Quality 5.2 Zero-Shot, Few-Shot, Templates, and Instruction Design 5.3 Model Selection: Capability, Latency, Cost, and Risk 5.4 RAG vs Fine-Tuning vs Prompting vs Custom Models 5.5 Model Evaluation, Human Review, and Red-Team Feedback 5.6 Cost, Performance, and Throughput Decision-Making 5.7 Prompting and Model Selection Case Lab

6 Chapter 6: Amazon Bedrock, RAG, Agents, and Guardrails

6.1 Bedrock Core Concepts, Model Access, and Managed FM Choice 6.2 Knowledge Bases, RAG, Data Sources, and Grounding 6.3 AI Agents, Tools, Orchestration, and Business Workflows 6.4 Guardrails, Content Filters, Denied Topics, and Sensitive Data 6.5 Bedrock Model Evaluation, Monitoring, and Human Feedback 6.6 Bedrock Cost, Latency, Throughput, and Operational Fit 6.7 Bedrock, RAG, and Agents Case Lab

7 Chapter 7: AWS Managed AI/ML Services and SageMaker Map

7.1 Managed AI Services vs Foundation Model Apps vs Custom ML 7.2 Text, Language, Search, and Document AI Services 7.3 Vision, Speech, Contact Center, and Personalization Services 7.4 Amazon Quick, Amazon Q Developer, Kiro, and Practitioner Fit 7.5 SageMaker Canvas, Studio, Clarify, Autopilot, and Data Wrangler 7.6 Data Foundation Services: S3, Glue, OpenSearch, and Quick Sight 7.7 AWS AI Service Selection Case Lab

8 Chapter 8: Responsible AI, Human Review, and Safety

8.1 Fairness, Bias, Transparency, and Explainability 8.2 Privacy, Safety, Human Review, and Accountability 8.3 Guardrails, Clarify, Human Review, and Content Safety Controls 8.4 Responsible AI Risk Registers and Governance Workflows 8.5 Monitoring, Feedback, Drift, and Incident Response 8.6 Responsible AI Case Lab

9 Chapter 9: Security, Compliance, Governance, and Cost Controls

9.1 Shared Responsibility, IAM, and Least Privilege for AI 9.2 Encryption, Secrets, Networking, and Data Privacy 9.3 Prompt Injection, Data Exfiltration, and GenAI Threat Modeling 9.4 Logging, Monitoring, CloudTrail, CloudWatch, and Config 9.5 Compliance: Artifact, Config, Macie, and Policy Evidence 9.6 AI Cost Controls, Pricing, Throughput, and Budget Governance 9.7 Security and Governance Case Lab

10 Chapter 10: Integrated AWS AI Business Scenario Labs

10.1 Customer Support GenAI Assistant Lab 10.2 Document Intelligence and Compliance Review Lab 10.3 Personalization, Forecasting, and Fraud Detection Lab 10.4 Enterprise Search, RAG, and Knowledge Management Lab 10.5 Responsible AI and Security Review Board Lab 10.6 Cost, Performance, and Operations Review Lab 10.7 Full AIF-C01 Business Simulation

11 Chapter 11: Final Review, Exam Readiness, and Recertification

11.1 Final 30-Day AIF-C01 Study Plan 11.2 Official Practice Resources and Weak-Domain Remediation 11.3 90-Minute Exam Timing, Flagging, and Guessing Workflow 11.4 Test-Day Checklist: Online or Test Center 11.5 Post-Exam Results, Retake, and Recertification Plan 11.6 AWS AI Practitioner Final Mixed Review

5.7 Prompting and Model Selection Case Lab

Key Takeaways Explain This Topic AI

A good AI recommendation starts with the business workflow, allowed data, user audience, measurable quality bar, and risk level.

Prompting, RAG, model selection, guardrails, evaluation, and human review should be combined only as needed for the scenario.

Practitioner case work should explain tradeoffs, not just name an AWS service.

AWS Skill Builder, official practice resources, and small console explorations can reinforce service-selection judgment without relying on unauthorized question collections.

Last updated: October 2026

Case Lab: Internal Product Support Assistant

Scenario: a software company wants an internal assistant for support agents. Agents need quick answers from product manuals, release notes, and troubleshooting articles. The assistant should summarize relevant steps, cite approved sources when possible, avoid inventing fixes, and escalate safety or legal issues to a human lead. The company wants to start with one product line and expand if quality is acceptable.

Start with the workflow, not the model. The user is a support agent, not an end customer. The output helps the agent decide what to do next, but should not automatically close cases or send customer messages. The approved sources are product manuals, release notes, and troubleshooting articles. The risk is moderate because bad advice could waste time or harm customer trust, but a trained agent remains in the loop.

Decision point Recommended case choice Reason

First scope One product line and internal users Limits risk and makes evaluation practical.

Prompt pattern Template with task, constraints, sources, format, and fallback Makes output consistent for agents.

Knowledge method RAG through a managed knowledge approach such as Amazon Bedrock Knowledge Bases Product facts change and need grounding.

Model selection Compare candidate Amazon Bedrock models against a rubric Select by measured quality, latency, and cost.

Safeguards Guardrails and escalation rules Reduces unsafe or out-of-scope responses.

Review Human agent reviews before customer response Keeps final action accountable.

A first prompt template could ask for a concise support answer using only retrieved source excerpts. It should include sections for likely issue, evidence from sources, recommended next step, missing information, and escalation flag. It should tell the model not to invent product behavior, not to use unsupported fixes, and to mark unknown when the retrieved context is insufficient.

Prompting alone is not enough here because the manuals and release notes are too large and change over time. Fine-tuning is also not the first choice because the problem is current factual knowledge, not mainly tone or repeated style. RAG fits because approved content remains outside the model weights and can be updated as products change.

Model selection should compare at least two candidates. The team should measure whether each model finds the right answer from retrieved context, handles missing context, refuses unsafe requests, and returns a useful structured response. The selected model should meet the support quality bar at acceptable latency and cost. If a smaller model passes, it may be the better production choice.

Evaluation set design:

Common how-to questions with clear source answers.

Recent release changes that older content might contradict.

Questions with missing source information.

Customer-sensitive or legal wording that should trigger escalation.

Prompt injection attempts inside user text and retrieved-like content.

Ambiguous cases where the assistant should ask for more information.

The team should define failure conditions before launch. Examples include inventing a fix, ignoring a newer release note, exposing restricted internal notes, failing to escalate safety language, or presenting a source-free answer as certain. These failures should lead to prompt changes, source cleanup, retrieval tuning, guardrail updates, or a narrower rollout.

Cost and performance planning should be practical. Estimate the number of support agents, expected requests per case, average retrieved context length, output length, and peak traffic during incidents. Limit the answer to the fields agents need. Avoid sending whole manuals when retrieved chunks are enough. Use usage monitoring and cost allocation so the product support owner can see adoption and spend.

Security and governance should be explicit. Use IAM least privilege for the application components. Protect source documents in Amazon S3 or the chosen repository according to sensitivity. Use encryption at rest and in transit where applicable. Log activity for troubleshooting and audit needs. Make sure any retrieved content is approved for support-agent use.

A non-builder approval review should ask five questions: What business problem are we solving? What data can the assistant use? How did candidate models perform against the rubric? What happens when the model is uncertain or unsafe? How will we monitor quality, cost, and user feedback after launch?

Practice drill for study: in AWS Skill Builder or official AWS training, focus on the distinction between Amazon Bedrock, Amazon Quick, SageMaker AI, managed AI services, RAG, guardrails, and model evaluation. In the AWS console, safely explore service pages and documentation without uploading sensitive data. Use official practice resources to test service-selection reasoning. Do not rely on unauthorized question collections or claims about live test items.

The final recommendation for this case is a scoped RAG assistant on Amazon Bedrock, using a prompt template, approved knowledge sources, candidate model evaluation, guardrails, support-agent review, monitoring, and a pilot rollout. The recommendation also says what not to do: do not start with a custom model, do not fine-tune as the only knowledge source, do not auto-send responses to customers, and do not expand beyond the pilot until evaluation evidence supports it.