Study guide

8.1 Configure the Generative Answers Node

Microsoft Certified: AI Agent Builder Associate AB-620

Track your progress as you read

Finished sections get a check mark.

1 Introduction & Exam Overview

1.1 Current Exam Facts 1.2 Candidate Profile & Prerequisites 1.3 Skills Map & Study Strategy

2 Plan Integration, Identity & Channels

2.1 Plan Integration with Enterprise Systems 2.2 Plan Identity Strategy 2.3 Plan Channels and Deployment

3 Responsible AI, Security & Reuse

3.1 Plan Responsible AI Strategy 3.2 Security and Governance Considerations 3.3 Plan Reusable Agent Components 3.4 Design Agents for Internal or External Audiences

4 Agent Flows Fundamentals

4.1 Create an Agent Flow 4.2 Human-in-the-Loop Agent Flows 4.3 Configure Actions and Connectors in Flows

5 Agent Flow Monitoring & Resilience

5.1 Monitor Agent Flows 5.2 Input and Output Parameters 5.3 Error Handling in Agent Flows

6 Topics Configuration Core

6.1 Add Agent Flows to a Topic 6.2 Configure Agent Response Formatting 6.3 Add Tools to a Topic

7 Advanced Topic Responses

7.1 Custom Prompts for Advanced Responses 7.2 Custom Knowledge Sources for Advanced Responses 7.3 API and Send HTTP Request Responses

8 Generative Answers, Cards & Variables

8.1 Configure the Generative Answers Node 8.2 Configure Adaptive Cards 8.3 Manage Variables

9 Enterprise Knowledge Sources

9.1 Connect to Copilot Connectors 9.2 Connect to Power Platform Connectors 9.3 Connect to Azure AI Search

10 Add Tools to Agents

10.1 Configure and Monitor Computer Use 10.2 Configure MCP Tools 10.3 Tools via Existing Custom Connectors 10.4 Add REST APIs to an Agent

11 Multi-Agent Collaboration

11.1 Design Multi-Agent Solutions 11.2 Integrate a Foundry Agent 11.3 Integrate an Existing Copilot Studio Agent

12 Fabric Data Agents & A2A

12.1 Integrate a Fabric Data Agent 12.2 Multi-Agent Solutions with A2A Protocol

13 Integrate Agents with Azure

13.1 Generative Answers with Azure AI Search & Foundry 13.2 Foundry Model Catalog for Custom Prompts 13.3 Monitor Agents with Application Insights

14 Evaluate Agent Performance

14.1 Create a Test Set 14.2 Choose an Evaluation Method 14.3 Review Test Results

15 Application Lifecycle Management

15.1 Create a Solution 15.2 Add Existing Agents to a Solution 15.3 Create and Use Environment Variables 15.4 Power Platform Pipelines for Agents

8.1 Configure the Generative Answers Node

Key Takeaways Explain This Topic AI

A generative answers node searches and summarizes knowledge at the topic level so the agent can answer from authoritative sources instead of authored message text alone.

Search only selected sources replaces agent-level knowledge for that node; when it is off, the node uses the agent’s current knowledge set.

Content moderation on the node (topic level) overrides agent Generative AI moderation at runtime; default is High.

Classic conversational boosting uses fixed source limits and often acts as fallback; generative orchestration plans knowledge with higher limits and description-driven selection.

Grounded answers rely on retrieval plus citations; ungrounded general knowledge is controlled separately and customized answers may require explicit citation rendering.

Last updated: August 2026

8.1 Configure the Generative Answers Node

Quick Answer: Add Advanced → Generative answers in a topic, open Properties , choose knowledge (agent-wide or Search only selected sources ), set content moderation , control general knowledge and web options, and decide whether the node sends a message or stores the answer in a variable for custom formatting and cards.

AB-620 leaf skill Configure generative answers node sits inside Configure topics . Exam scenarios often ask whether an agent should answer from SharePoint only, escalate when moderation blocks content, or behave differently under classic conversational boosting versus generative orchestration.

Why the generative answers node exists

Authored topics match intents and run deterministic nodes. Users still ask free-form questions that no trigger phrase covers. A Create generative answers node lets that topic (or a system topic such as Conversational boosting ) search knowledge sources , ground a model response in retrieved chunks, and return a summarized answer—often with citations back to the source document or page.

You can use generative answers as:

  • Fallback when no topic matches (Conversational boosting / unknown intent path)
  • Intent-specific retrieval inside a deliberate topic (policy FAQ, product manuals, onboarding guide)
  • Focused override that ignores noisy agent-level sources for a sensitive conversation path
  • Adding the node

Open Topics → the topic you need.

Add node → Advanced → Generative answers .

A Create generative answers node appears.

Open … → Properties to configure knowledge, classic data, advanced options, and moderation.

For Input , makers commonly bind System.Activity.Text (latest user message) so the node answers the current utterance.

Save the topic and republish the agent after meaningful knowledge or moderation changes, then retest with a new conversation so stale session state does not hide configuration mistakes.

Knowledge sources you can use

Microsoft documents internal and external sources. Capabilities and limits differ by orchestration mode.

Source family Examples Auth (typical) Notes for the node

Public websites Org-owned URLs searched via Bing None Confirm ownership; generative mode supports more URLs than classic

Documents Files uploaded to Dataverse None Content search over uploaded docs

SharePoint / OneDrive patterns Site/library URLs, supported file types User Entra ID Graph/search-based; only content the user can access

Dataverse Tables with generative retrieval User Entra ID RAG over configured tables

Enterprise connectors (Microsoft Search) Indexed enterprise content User Entra ID Connector-backed enterprise data

Classic data path Bing Custom Search, Azure OpenAI on your data, Custom data Varies Use Classic data in node properties when modern knowledge list does not host that source

Supported file/content patterns commonly include modern SharePoint pages and docx / pptx / pdf . Always verify current limits for unstructured folders and large files in Microsoft Learn before exam day—numbers change, but the idea of per-mode caps does not.

Authentication and least privilege

When the source requires identity (SharePoint, Dataverse, many connectors), the agent calls on behalf of the chatting user . Configure agent authentication (manual Microsoft Entra ID with delegated Graph permissions such as Files.Read.All and Sites.Read.All when SharePoint content is required). The exam expects: users only see knowledge they are allowed to open —not a shared maker service account that leaks restricted libraries.

Search only selected sources

The Knowledge sources section includes Search only selected sources . This is a top AB-620 trap.

  • Setting What the node searches When to use
  • Off (default) All currently enabled agent-level knowledge sources Broad Q&A; keep one knowledge inventory

On Only the sources you tick in the node list— replaces agent-level set for this node Sensitive topics; product-line isolation; compliance “single approved site”

Important behaviors:

Selected sources replace agent knowledge for that node; they do not “add on top.”

Explicitly selected sources ignore trigger conditions that might otherwise limit when an agent-level source is eligible.

There is no automatic fallback to agent-level knowledge if selected sources return nothing. (Agent-level generative answers fallback is a separate system-topic behavior, not a silent second search inside this node.)

Turning a source off at agent level removes it from nodes that inherit the agent set; nodes with explicit selections keep searching those selected items as configured.

Answer using only custom data from a variable

For pipeline-fed context (API payload already in a variable):

Turn Search only selected sources on and leave knowledge sources unselected (no enterprise search).

Under Classic data , set Custom data to the variable holding content.

Keep Web search and Allow the AI to use its own general knowledge off so the answer depends only on your variable.

That pattern is pure grounding on maker-supplied text, not a free web answer.

Classic conversational boosting vs generative orchestration

Think of two layers: how the agent plans (classic vs generative orchestration) and how knowledge is searched inside boosting or a generative answers node.

Classic orchestration + conversational boosting

Topics match by trigger phrases; tools run when topics call them.

Default Conversational boosting system topic hosts a generative answers path as fallback when intents do not match.

Knowledge searches obey classic caps (examples from Microsoft Learn: roughly four public website URLs, four SharePoint URLs per generative answers node, two Dataverse knowledge sources with table limits, limited connector counts—memorize the pattern of lower fixed caps).

Custom data and Bing Custom Search remain relevant via classic data / node configuration.

Generative orchestration

Planner chooses topics, tools, and knowledge using names, descriptions, and context .

Higher practical limits (for example many more website/SharePoint URLs in generative mode; unlimited-style connector/Dataverse patterns in generative mode—again, know “generative scales higher than classic”).

When more than about 25 distinct knowledge sources exist, an internal model filters which sources to search; strong descriptions matter.

Uploaded files are treated specially relative to the “25 sources” filter (files are not counted the same way as discrete knowledge entries).

Generative orchestration does not treat custom data / Bing Custom Search the same as first-class agent knowledge—embed those via a generative answers node and classic data when needed.

Behavior Classic + boosting Generative orchestration

Primary knowledge path Boosting fallback + explicit generative answers nodes Planner + knowledge + tools + topics

Source selection Node/agent config with classic caps Descriptions + filters when many sources

Custom data / Bing Custom Search Supported patterns via classic data Prefer embedding in generative answers node

  • Multi-intent turns Mostly one topic match + fallback May combine knowledge with tools/topics
  • Maker control High for scripted topics High descriptions + optional explicit nodes for sensitive paths

Exam trap: Enabling generative orchestration does not remove the value of a topic-scoped generative answers node. Use the node when you need a predictable, moderated, source-locked answer inside a regulated flow—even if the planner could also search knowledge on its own.

Grounding, general knowledge, and ungrounded responses

Grounding means the model’s answer is based on retrieved knowledge (and tools), not free invention. Related agent settings (Generative AI / Knowledge pages):

Control Effect

Allow ungrounded responses When off (with generative orchestration), blocks turns where the agent answered without calling knowledge or a tool—even if conversation history seems “enough.”

General knowledge / AI general knowledge Whether the model may lean on pretrained knowledge outside your sources

Web search / use information from the web Parallel Bing-grounded public web search interleaved with configured public sites

Citation expectation With ungrounded answers restricted, answers often must include in-text citation linkage to sources; intermittent missing citations can look like “no answer”

Responsible AI pattern: keep moderation High (default), prefer enterprise sources over open general knowledge for HR/legal/medical-adjacent content, and disclose that generative answers may be AI-generated (Conversation Start is a common place).

Content moderation on the node

Moderation levels range from Lowest to Highest (product default High ):

  • Lower → more answers, higher risk of undesirable content
  • Higher → fewer answers, stricter filters

Precedence at runtime:

  • Topic-level setting on the generative answers node wins when set
  • Else agent-level Generative AI moderation
  • Prompt tools can further override completion moderation when configured

If answers suddenly vanish after raising moderation, diagnose content blocked by content moderation before blaming SharePoint indexing.

Citations and customized delivery

By default, the node can Send a message with the generated answer and platform-managed citations. Advanced pattern for Adaptive Cards or branded layouts:

Expand Advanced on the node.

Create a global variable to store the generated answer.

Clear Send a message so the node does not immediately post the raw answer.

Author a Message or Question node (or Adaptive Card) that renders the variable with Power Fx.

Teams citation caveat: When you customize delivery, citation links may not auto-render the same way. Microsoft documents that Teams automatically returns citation links mainly for non-customized answers; customized Teams experiences must explicitly render citations. Also note channel limits (Teams citation count and title/snippet length caps).

Limitation: Citations from knowledge generally cannot be fed as structured inputs into subsequent tools/actions—plan tools to re-query systems of record rather than parse citation objects.

  • End-to-end scenarios
  • Scenario A — HR policy isolation

Topic Leave policy should never mix marketing web pages. Turn Search only selected sources on, select only the HR SharePoint site, moderation Highest , general knowledge off. Message node summarizes remaining leave after a Dataverse tool; generative answers handles “what is parental leave eligibility?” from the policy library.

Scenario B — Conversational boosting fallback

Classic agent relies on authored sales topics. Unmatched questions hit Conversational boosting’s generative answers node over product PDFs. If boost fails, Fallback system topic escalates. Maker tunes classic caps so only four public URLs and approved SharePoint paths are searchable.

Scenario C — Custom data only

A prior agent flow returns a JSON-like string of ticket notes into Global.TicketContext . Generative answers node uses custom data variable only, no web, no general knowledge, stores answer in Global.TicketSummary , then Adaptive Card shows summary + “Open ticket” button.

Scenario D — Generative orchestration with 30+ sources

Descriptions on each knowledge source disambiguate “warranty” vs “shipping” content. Planner filters sources; sensitive legal topic still uses an explicit generative answers node with Search only selected sources for the legal library.

Troubleshooting checklist

Confirm authentication and user can open the SharePoint/Dataverse content in a browser.

Check Search only selected sources vs agent knowledge inventory mismatch.

Lower moderation temporarily in a dev agent to see if filters hide answers—then restore policy-compliant levels.

Verify indexing/file type support (docx/pptx/pdf/modern pages).

For customized answers in Teams, verify citation rendering code/card fields.

Ensure Input is the user question you think it is ( System.Activity.Text vs a stale variable).

Republish and test a fresh session; review activity map under generative orchestration.

  • Success checklist
  • Node added under Advanced with correct input binding
  • Knowledge scope intentional (inherit vs selected-only vs custom data)
  • Moderation set and understood relative to agent default
  • Classic vs generative implications documented for the solution
  • Grounding/citation behavior matches channel and compliance
  • Sensitive topics do not accidentally search the open web

Mastering the generative answers node is how AB-620 candidates turn static topics into grounded, moderated, source-aware conversations without authoring hundreds of FAQ topics by hand.