Study guide
5.1 Generative AI Fundamentals
Microsoft Azure AI Fundamentals AI-900
Track your progress as you read
Finished sections get a check mark.
1 Introduction
About the Azure AI Fundamentals (AI-900) Exam Study Strategies and Exam Tips for the AI-900
2 Domain 1: Describe AI Workloads and Considerations (15-20%)
1.1 What Is Artificial Intelligence? 1.2 Responsible AI Principles 1.3 Identifying Common AI Workloads and Use Cases 1.4 Responsible AI Tools and Practices on Azure
3 Domain 2: Fundamental Principles of Machine Learning on Azure (20-25%)
2.1 Core Machine Learning Concepts 2.2 Regression Models 2.3 Classification Models 2.4 Clustering Models 2.5 Deep Learning and Neural Networks 2.6 Azure Machine Learning Service
4 Domain 3: Computer Vision Workloads on Azure (15-20%)
3.1 Computer Vision Concepts and Tasks 3.2 Azure AI Vision Service 3.3 Azure AI Custom Vision and Face Services 3.4 Azure AI Document Intelligence
5 Domain 4: Natural Language Processing Workloads on Azure (15-20%)
4.1 NLP Concepts and Common Tasks 4.2 Azure AI Language Service 4.3 Azure AI Speech Service 4.4 Azure AI Translator Service
6 Domain 5: Generative AI Workloads on Azure (15-20%)
5.1 Generative AI Fundamentals 5.2 Azure OpenAI Service 5.3 Prompt Engineering 5.4 Retrieval-Augmented Generation (RAG) 5.5 Responsible Generative AI 5.6 Microsoft Copilot and AI-Powered Applications
7 Exam Review and Full-Length Practice Questions
6.1 Domain Summary and Key Comparisons 6.2 Practice Questions: AI Workloads and Responsible AI 6.3 Practice Questions: Machine Learning 6.4 Practice Questions: Computer Vision, NLP, and Generative AI
5.1 Generative AI Fundamentals
Key Takeaways Explain This Topic AI
Generative AI creates NEW content (text, images, code, audio) rather than only analyzing or classifying existing data; it is the largest AI-900 domain at 20-25%.
Large Language Models (LLMs) are deep neural networks that predict the next token; GPT stands for Generative Pre-trained Transformer.
The Transformer's self-attention mechanism lets the model weigh all words at once, enabling context understanding and long context windows (GPT-4o ~128K, GPT-4.1 up to ~1M tokens).
Customization progresses from pre-training (most expensive) to fine-tuning (moderate) to prompt engineering (cheapest, no training) — the AI-900 emphasizes prompt engineering.
Key limitations are hallucinations (confident false output), bias, knowledge cutoff, non-determinism, and prompt injection; RAG and grounding reduce hallucinations.
Last updated: June 2026
Quick Answer: Generative AI creates new content (text, images, code, audio) using large language models (LLMs) built on the Transformer architecture. LLMs like GPT are pre-trained on massive datasets and can generate human-like text, answer questions, summarize documents, and write code. Key limitations include hallucinations, bias, and lack of real-time knowledge. Generative AI is the largest AI-900 domain at 20-25% after the May 2025 update.
What Is Generative AI?
Generative AI is a category of AI that creates new, original content. Unlike traditional AI that analyzes or classifies existing data ("is this email spam?"), generative AI produces new outputs that did not exist before.
What Generative AI Can Create
- Content Type Example Model Family
- Text Articles, emails, summaries, code, poetry GPT-4.1, GPT-4o
- Images Photographs, illustrations, design concepts GPT-image-1 (DALL-E 3 superseded)
- Code Functions, classes, entire applications GPT-4.1, GPT-4o
- Audio Transcription, synthesized speech Whisper (STT), neural TTS
- Conversations Chatbot responses, assistant dialogues GPT-4.1, GPT-4o
- Generative AI vs. Traditional AI
- Aspect Traditional AI Generative AI
- Task Analyze and classify existing data Create new content
- Output Labels, scores, predictions Text, images, code, audio
- Example "This email is spam" (classification) "Write a professional email about..." (generation)
- Data flow Input -> analysis -> label Prompt -> generation -> new content
- Large Language Models (LLMs)
Large Language Models are the neural networks that power text-based generative AI. They are "large" because they have billions of parameters — adjustable values learned during training.
How LLMs Work (Conceptual)
Pre-training: the model is trained on massive amounts of text (books, websites, articles, code) and learns the statistical patterns of language — which words tend to follow which.
Token prediction: at its core, an LLM predicts the next token (a word or word-part). Given "The capital of France is", it predicts "Paris" as the most likely next token.
Context understanding: through the Transformer's self-attention mechanism, the model interprets the context of words — "bank" differs in "river bank" vs. "bank account".
Emergent capabilities: large models exhibit abilities that were not explicitly trained, such as multi-step reasoning and following complex instructions.
Key LLM Concepts
- Concept Definition Example
- Token A unit of text (word, subword, or character) "Hello world" ~ 2 tokens; "unbelievable" ~ 3 tokens
- Context window Maximum tokens processed at once GPT-4o ~ 128K tokens; GPT-4.1 supports up to ~1,000,000
- Parameters Internal values learned during training Frontier models: hundreds of billions
- Temperature Controls randomness (0 = deterministic, higher = creative) 0 for factual; 0.7 for creative writing
- Inference Generating output from the model Sending a prompt and receiving a response
- The Transformer Architecture
The Transformer is the neural-network architecture that makes modern generative AI possible. It was introduced in the 2017 paper "Attention Is All You Need."
Why Transformers Changed Everything
Before Transformers, language models processed text sequentially (one word at a time). Transformers introduced self-attention , letting the model consider ALL words in the input at once:
- Old Approach (RNNs) Transformer Approach
- Process words one at a time (sequential) Process all words simultaneously (parallel)
- Struggle with long-distance relationships Capture relationships across the entire text
- Slow to train Fast to train (parallelizable on GPUs)
- Limited context Very long context windows
- Self-Attention Explained (Conceptual)
Self-attention lets each word "attend to" (weigh the relevance of) every other word. In "The cat sat on the mat because it was tired," self-attention determines that "it" refers to "cat," not "mat," by scoring the relevance of every word. This is how the model understands context and references.
Pre-Training, Fine-Tuning, and Prompting
- Approach Cost What It Does
- Pre-training Highest Train a foundation model on massive general data (thousands of GPUs for weeks)
- Fine-tuning Moderate Adapt a pre-trained model to a domain with a smaller labeled dataset
- Prompt engineering Lowest Use the model as-is by crafting effective prompts — no training needed
On the Exam: Know the progression — pre-training (expensive, builds the foundation) -> fine-tuning (moderate, adapts a domain) -> prompt engineering (cheap, customizes via instructions). The AI-900 focuses on prompt engineering because it requires no ML expertise.
- Limitations of Generative AI
- 1. Hallucinations
The model generates information that sounds plausible but is factually wrong . It does not "know" facts — it predicts statistically likely text. For example, "Einstein won the Nobel Prize in 1922 for relativity" sounds right but is wrong: he won the 1921 prize, awarded for the photoelectric effect.
2. Bias
Models inherit biases in their training data and can perpetuate stereotypes or underrepresentation.
3. Knowledge Cutoff
Pre-trained models do not know about events after their training data was collected — a key reason grounding and RAG matter.
4. Non-Determinism
The same prompt can yield different responses depending on temperature and sampling, so outputs are not guaranteed to repeat.
5. Prompt Injection
Malicious users can craft inputs that trick the model into ignoring its instructions or producing harmful content.
On the Exam: Hallucination is the most commonly tested limitation. Know that generative AI can produce convincing false information, and that RAG (Retrieval-Augmented Generation) and grounding are the key techniques to reduce it.