Study guide

7.1 AHV Virtual Networking Architecture, Open vSwitch (OVS), and Bridges

Nutanix Certified Associate NCA

Track your progress as you read

Finished sections get a check mark.

1 Chapter 1: Nutanix Cloud Platform & HCI Foundations

1.1 Nutanix NCA Exam Overview, Format, and Objectives 1.2 Hyperconverged Infrastructure (HCI) vs. Traditional 3-Tier Architecture 1.3 The Nutanix Enterprise Cloud Portfolio (NCI, NUS, NCM, EUC, NC2)

2 Chapter 2: Platform Architecture & Distributed Core Services

2.1 Hardware Building Blocks: Nodes, Blocks, Clusters, and Quorum 2.2 Controller VM (CVM) Architecture, Datapath, and Autopathing 2.3 Core Distributed Services: Cassandra, Stargate, Curator, Zookeeper, and Genesis

3 Chapter 3: Prism Administration & Cluster Operations

3.1 Prism Element vs. Prism Central Architecture and Interface Navigation 3.2 Entity Management, Categories, and Role-Based Access Control 3.3 Nutanix Licensing Tiers, Add-ons, and Pulse Telemetry

4 Chapter 4: AOS Distributed Storage Fabric & Data Placement

4.1 Storage Pools, Storage Containers, and vDisk Virtual Architecture 4.2 Redundancy Factor (RF2 vs. RF3), Failure Domains, and Fault Tolerance 4.3 Data Locality Mechanics and Intelligent Lifecycle Management (ILM)

5 Chapter 5: Storage Optimization & Business Continuity

5.1 Storage Efficiency: Compression, Deduplication, and Erasure Coding (EC-X) 5.2 Space-Efficient Redirect-on-Write (ROW) Snapshots and Zero-Byte Clones 5.3 Protection Domains, Consistency Groups, and Disaster Recovery Replication

6 Chapter 6: AHV Virtual Machine Lifecycle Management

6.1 AHV VM Provisioning, Resource Allocation (vCPU, vRAM, Disks), and Boot Types 6.2 Nutanix Image Service and Virtual Machine Templates 6.3 Nutanix Guest Tools (NGT) Architecture, Features, and Deployment 6.4 AHV High Availability (HA), Acropolis Dynamic Scheduling (ADS), and Affinity Rules

7 Chapter 7: AHV Networking & Flow Security Fundamentals

7.1 AHV Virtual Networking Architecture, Open vSwitch (OVS), and Bridges 7.2 Host Network Uplinks, Virtual Switch Configuration, and NIC Bonding Modes 7.3 Virtual Networks: Managed vs. Unmanaged Networks and IPAM 7.4 Nutanix Flow Network Security & Microsegmentation Fundamentals

8 Chapter 8: Cluster Maintenance, Health Monitoring & Support

8.1 Nutanix Cluster Health Monitoring, Alerts, and Events Engine 8.2 Nutanix Cluster Check (NCC) Architecture and Execution 8.3 Life Cycle Manager (LCM) and Rolling Non-Disruptive Upgrades 8.4 Nutanix Support Ecosystem: Diagnostics, Log Gathering, and Support Bundles

9 Chapter 9: Recognizing Nutanix Solutions, Hypervisors & the Product Portfolio

9.1 Supported Hypervisors for NCI and Feature Supportability 9.2 NCI Core Components, Configurations, and Common Deployment Scenarios 9.3 Nutanix Unified Storage: Files, Objects, and Volumes Use Cases 9.4 Nutanix Database Service (NDB) and Database Automation 9.5 Nutanix Kubernetes Platform, Enterprise AI, and End-User Computing

10 Chapter 10: Nutanix Tools — Migration, Deployment, and Validation

10.1 Nutanix Move: Cross-Hypervisor and Cloud Migration 10.2 Foundation and Foundation Central: Imaging and Cluster Deployment 10.3 X-Ray, Collector, and the Objective 1.3 Tool Inventory

11 Chapter 11: Cluster Configuration, Security & Hardware Maintenance

11.1 Cluster Services Configuration: DNS, NTP, SMTP, and SNMP 11.2 Cluster Security Options: Lockdown, Encryption, and the Recycle Bin 11.3 Node Maintenance Mode, Host Shutdown, and Cluster Shutdown 11.4 Cluster Expansion: Node Types and In-Node Expansion Capabilities 11.5 Out-of-Band Management and Remote Console Access

12 Chapter 12: Storage, Network, and Software Administration Tasks

12.1 Volume Groups, vDisk Placement, and Live vDisk Migration 12.2 Network Visualizer, Physical Switch Monitoring, and Network Segmentation 12.3 The Software Compatibility Matrix and Upgrade Path Planning 12.4 Taking and Managing VM Snapshots in Prism 12.5 License Operations: State, Assignment, Reclamation, and Expiry

13 Chapter 13: Performance Analysis, Reporting & Support Operations

13.1 Prism Analysis: Metric Charts, Entity Charts, and Custom Reports 13.2 Custom Alert Policies and Behavioural Anomaly Detection 13.3 Interpreting Workload Performance: CPU Contention, CPU Ready, Memory, and I/O Latency 13.4 Creating Support Cases, Required Documentation, and Insights

7.1 AHV Virtual Networking Architecture, Open vSwitch (OVS), and Bridges

Key Takeaways Explain This Topic AI

Nutanix AHV employs Open vSwitch (OVS) as its native software switch, splitting execution between a high-performance kernel datapath module (openvswitch.ko) and user-space management daemons (ovs-vswitchd and ovsdb-server).

The default virtual bridge br0 aggregates all physical host uplinks (in bond br0-up), the Controller VM management and storage interface (eth0), and guest virtual machine tap devices (vnet*).

The internal Linux bridge virbr0 operates strictly without physical uplinks on the private, non-routable 192.168.5.0/24 subnet, facilitating dedicated host-to-CVM communication (AHV host at 192.168.5.1 and CVM eth1 at 192.168.5.2).

Unlike VMware vSphere Distributed Switch (vDS) which depends on a centralized vCenter Server, AHV OVS maintains decentralized, localized state databases on every host that are automatically synchronized cluster-wide via Acropolis and ZooKeeper.

OVS utilizes a two-tier flow table pipeline where initial packet classification occurs in the user-space OpenFlow tables before caching exact-match flow entries into the kernel space for sub-millisecond wire-speed forwarding.

Last updated: September 2026

AHV Virtual Networking Architecture, Open vSwitch (OVS), and Bridges

Quick Summary: Nutanix AHV delivers enterprise virtualization without relying on proprietary third-party switching fabrics or external management servers. Virtual networking in AHV is powered natively by Open vSwitch (OVS) , an open-source, production-grade distributed virtual multilayer switch. OVS operates directly within the Linux kernel and user-space layers of the AHV hypervisor. Network traffic is partitioned across specialized virtual bridges—most notably br0 (which aggregates physical host NIC uplinks, Controller VM management traffic, and guest VM virtual NICs) and virbr0 (an internal, isolated Linux bridge dedicated to private host-to-CVM communication on the 192.168.5.0/24 subnet). Understanding the split-plane OVS architecture, virtual bridge topologies, and OpenFlow flow processing is fundamental to administering Nutanix enterprise clouds.

1. Open vSwitch (OVS) Architectural Foundations

In traditional enterprise virtualization platforms, hypervisors employ proprietary virtual switches (such as the VMware vSphere Standard Switch or vSphere Distributed Switch) that require dedicated licensing and centralized management appliances. Nutanix AHV adopts an open, modular approach by standardizing on Open vSwitch (OVS) .

OVS is designed to operate in high-density multi-tenant environments, supporting standard network management protocols, telemetry (sFlow, NetFlow, IPFIX), and automated flow programmability via OpenFlow.

Kernel Space vs. User Space Split-Plane Design

OVS in AHV divides networking responsibilities between two operational domains to maximize packet throughput while preserving dynamic programmability: +-------------------------------------------------------------------------+

  • | AHV Host User Space |
  • | |
  • | +--------------------------+ +---------------------------+ |
  • | | ovsdb-server | | ovs-vswitchd | |
  • | | (Configuration Database) |<-------->| (OpenFlow Switching & Flow| |
  • | | [/etc/openvswitch] | IPC/RPC | Pipeline Engine) | |
  • | +--------------------------+ +-------------+-------------+ |
  • +-------------------------------------------------------|-----------------+
  • | Upcall / Netlink
  • +-------------------------------------------------------|-----------------+
  • | AHV Host Kernel Space v |
  • | +-----------------------------------------------------------------+ |
  • | | openvswitch.ko (Datapath) | |
  • | | - Exact Match Cache (EMC) & Megaflow Fast Path | |
  • | | - Hardware NIC Interfacing & Ring Buffer Processing | |
  • | +-----------------------------------------------------------------+ |
  • +-------------------------------------------------------------------------+

User Space Components:

ovsdb-server (Configuration Database Server): A lightweight, transactional database server that stores the virtual switch schema, bridge definitions, port configurations, interface mappings, and bond states in /etc/openvswitch/conf.db . It ensures persistence across host reboots.

ovs-vswitchd (OVS Daemon): The switching core that implements the OpenFlow control engine. It communicates with ovsdb-server via local IPC, processes complex OpenFlow classification rules, interfaces with the Nutanix management plane (Acropolis), and computes forwarding decisions for unrecognized packet streams.

Kernel Space Components:

openvswitch.ko (Fast-Path Datapath Module): A lean, hyper-optimized kernel module executing in the Linux kernel space. It inspects packet headers against cached flow rules. When an incoming packet matches an existing cached flow, openvswitch.ko immediately modifies, forwards, or drops the packet directly in kernel memory without incurring an expensive user-space context switch.

Note

By processing the vast majority of ongoing network traffic inside the kernel datapath, AHV achieves near-line-rate switching performance with negligible hypervisor CPU overhead.

2. Virtual Bridge Topology: br0 vs. virbr0

AHV uses logical virtual bridges to direct traffic between physical adapters, virtual machines, and the internal storage infrastructure. Every Nutanix AHV host deploys two default bridges upon installation: br0 and virbr0 . +---------------------------------------------------------------------------------+

  • | AHV Physical Host |
  • | |
  • | +--------------------+ +--------------------+ +-----------------------+ |
  • | | User VM 1 | | User VM 2 | | Controller VM |
  • | | [vnet0 / tap] | | [vnet1 / tap] | | (CVM) |
  • | +---------+----------+ +---------+----------+ +---+---------------+---+ |
  • | | | | | |
  • | | | eth0 | eth1 | |
  • | v v v | |
  • | +-------------------------------------------------------+--+ | |
  • | | Virtual Bridge: br0 | | |
  • | | (Open vSwitch) | | |
  • | | Aggregates VM vNICs, CVM eth0, and Physical Bond | | |
  • | +---------------------------+------------------------------+ | |
  • | | | |
  • | v | |
  • | +--------------------------+ | |
  • | | Bond Port: br0-up | | |
  • | | (Active-Backup / LACP) | | |
  • | +-------------+------------+ | |
  • | | | |
  • | +---------+---------+ | |
  • | | | | |
  • | v v | |
  • | [ eth2 ] [ eth3 ] | |
  • | 10/25GbE 10/25GbE | |
  • | | | | |
  • | +------------------+-------------------+--------------------------------+---+ |
  • | | | | | |
  • | | Physical Network v v | |
  • | | ToR Switches +----+--------------------------------+ | |
  • | | | Virtual Bridge: virbr0 | | |
  • | | | (Standard Linux Bridge) | | |
  • | | | Subnet: 192.168.5.0/24 (Private) | | |
  • | | | AHV Host: .1 <----> CVM eth1: .2| | |
  • | | +-------------------------------------+ | |
  • +--+---------------------------------------------------------------------------+--+
  • The External Bridge: br0 (Open vSwitch)

br0 is the primary data and management bridge of the AHV host. It is instantiated as an Open vSwitch bridge and manages all network ingress and egress between the host, the virtual workloads, and the physical datacenter switching fabric.

Key interfaces attached to br0 include:

br0-up (Uplink Bond): The logical bonded port that aggregates physical server network adapters (e.g., eth2 , eth3 ). All external network traffic leaving or entering the node traverses br0-up .

br0 (Host Interface): The virtual host management interface. It carries the primary management IP address of the AHV host, enabling communication with other AHV nodes, Prism Central, and external network services (DNS, NTP, Syslog).

CVM eth0 : The primary network interface of the local Controller Virtual Machine. It carries external storage I/O, Distributed Storage Fabric (DSF) metadata synchronization, remote replication, and Prism web management traffic.

Guest VM Virtual Interfaces ( vnet* / tap* ): As virtual machines power on, AHV generates a dedicated virtual network tap interface for each vNIC. These tap ports attach directly to br0 with appropriate IEEE 802.1Q VLAN membership tags.

The Internal Bridge: virbr0 (Standard Linux Bridge)

In stark contrast to br0 , virbr0 is NOT an Open vSwitch bridge . It is a traditional Linux bridge managed by the Linux kernel bridge module ( brctl ).

Critical characteristics of virbr0 :

Isolated Private Network: It is strictly assigned to the link-local, non-routable private subnet 192.168.5.0/24 with an MTU of 1500.

Zero Physical Uplinks: virbr0 has no physical network adapters attached and contains no external routes. Network packets traversing virbr0 can never leave the physical server chassis.

Fixed IP Addressing:

The AHV hypervisor assigns itself 192.168.5.1 on interface virbr0 .

The local Controller VM assigns itself 192.168.5.2 on interface eth1 .

Operational Purpose:

Cluster Bootstrapping and Genesis Startup: During initial node boot, the CVM and hypervisor establish cluster communication across this deterministic internal path before physical network links or external IP routing are fully online.

Localized Storage Redirection: When an AHV host requires local storage access (such as mounting local CVM storage endpoints, dispatching iSCSI/SCSI control primitives, or dumping hypervisor crash core dumps), traffic flows across 192.168.5.0/24 without traversing physical ToR switches.

Out-of-Band Host Management: Administrators connected to the CVM via SSH can jump directly into the underlying AHV hypervisor using ssh root@192.168.5.1 without requiring external host routing.

  • Feature / Property Bridge br0 Bridge virbr0
  • Switching Engine Open vSwitch (OVS) Standard Linux Kernel Bridge ( brctl )
  • Physical Uplinks Yes ( br0-up bond: 10/25/40/100GbE) None (Zero physical adapters)
  • Subnet / Addressing Customer Datacenter Subnet (Routable) 192.168.5.0/24 (Isolated / Non-routable)
  • AHV Host Interface IP Host Management IP (e.g., 10.10.10.51 ) 192.168.5.1
  • CVM Interface eth0 (External Management & DSF Storage) eth1 ( 192.168.5.2 Dedicated Internal)
  • Attached Endpoints CVM eth0 , Host br0 , Guest VM tap ports Host virbr0 , CVM eth1
  • Primary Function Workload I/O, Storage Sync, Prism Access Local host-to-CVM heartbeats & local I/O

Warning

Never delete, modify, or add physical network interfaces to virbr0 . Altering virbr0 breaks local CVM-to-hypervisor communication, causing the host to enter an unmanageable state and terminating local storage heartbeat processing.

3. Comparison: AHV Open vSwitch vs. VMware ESXi Virtual Switching

Understanding how AHV networking maps to legacy virtualization platforms helps clarify Nutanix design advantages:

Architecture / Feature VMware vSphere Standard Switch (vSS) VMware vSphere Distributed Switch (vDS) Nutanix AHV Open vSwitch (OVS)

Underlying Switch Engine VMware Proprietary Kernel Switch VMware Proprietary Distributed Switch Open vSwitch (Kernel Datapath + OVSDB)

Management Plane Per-host ESXi / Host Client Centralized vCenter Server Distributed Prism & Acropolis (ZooKeeper)

vCenter / Manager Dependency None (Host autonomous) Critical (vCenter failure freezes config changes) None (No single point of failure)

Host Uplink Aggregation NIC Teaming (Port ID, MAC Hash, IP Hash) NIC Teaming & LACP (Route based on IP hash) OVS Bonds ( active-backup , balance-slb , balance-tcp )

  • Network Segmentation Virtual Machine Port Groups Distributed Port Groups AHV Virtual Networks (VLAN 0 - 4094)
  • Software Programmability Limited Moderate via VMware APIs OpenFlow 1.0/1.3, OVSDB, REST APIs

Microsegmentation Requires VMware NSX (Add-on license) Requires VMware NSX (Add-on license) Native Flow Network Security (Embedded)

Decentralized Control Plane Resilience

In a VMware vSphere environment utilizing a Distributed Switch (vDS), the control plane resides within the vCenter Server appliance. If the vCenter Server VM crashes, suffers database corruption, or loses network connectivity, administrators cannot create port groups, assign VLANs, or migrate VM interfaces until vCenter is restored.

In Nutanix AHV, each node runs its own autonomous instance of ovsdb-server and ovs-vswitchd . The Acropolis service running across the CVM cluster coordinates network state changes. Configuration updates dispatched through Prism Element or Prism Central are replicated across the cluster using the distributed ZooKeeper consensus engine. Even if one or more CVMs are rebooted or Prism Central is temporarily offline, each AHV host continues switching packets and enforcing flow rules without disruption.

4. Flow Table Mechanics and the Packet Forwarding Pipeline

To understand how AHV forwards packets at microsecond latencies, one must analyze the interaction between the Kernel Datapath and the User-Space OpenFlow Pipeline . Incoming Packet from VM Tap / Physical Uplink

  • |
  • v
  • +-------------------------------+ MISS (Upcall)
  • | Kernel Datapath Cache (EMC) |-------------------+
  • +---------------+---------------+ |
  • | |
  • HIT | v
  • | +-----------------------------------+
  • | | ovs-vswitchd (User Space Engine) |
  • | | 1. Parse L2/L3/L4 Packet Headers |
  • | | 2. Traverse OpenFlow Tables |
  • | | 3. Check Flow Security Rules |
  • | | 4. Generate Datapath Flow Action |
  • | +-----------------+-----------------+
  • | |
  • | v
  • | +-----------------------------------+
  • | | Install Flow into Kernel Datapath |
  • | +-----------------+-----------------+
  • | |
  • +-----------------+-----------------+
  • |
  • v
  • Execute Actions (Push/Pop VLAN,
  • Forward to Port, or Drop Packet)
  • The Step-by-Step Packet Forwarding Process

Packet Ingress: A packet arrives on an AHV bridge port—either from a virtual machine's vnet tap interface or from a physical switch port via br0-up .

Kernel Fast-Path Lookup (Exact Match Cache - EMC):

The kernel datapath calculates a hash of the packet's 5-tuple header fields (Source IP, Destination IP, Source Port, Destination Port, Protocol) plus input port and VLAN.

It checks the Exact Match Cache (EMC) . If an identical flow has recently passed through the switch, a cache hit occurs.

The kernel module immediately executes the stored action (e.g., strip 802.1Q tag and transmit to vnet2 ) in a few microseconds.

Megaflow Cache Evaluation:

If the EMC misses, the datapath checks the Megaflow Cache , which supports wildcarded flow entries (e.g., matching an entire subnet rather than a single IP).

A hit here executes the cached action and updates the EMC.

The Upcall (Slow Path to User Space):

If the packet does not match any entry in the kernel cache, the kernel datapath generates an upcall via a Linux Netlink socket, passing the packet header to ovs-vswitchd in user space.

OpenFlow Multi-Table Pipeline Traversal:

ovs-vswitchd receives the packet and passes it through an ordered series of OpenFlow tables:

Table 0 (Ingress Classification): Validates source port security and assigns internal metadata.

Table 1 (VLAN Tagging / Untagging): Determines whether 802.1Q tags must be added (access to trunk) or stripped.

Table 2 (Flow Network Security / Conntrack): Evaluates stateful firewall rules via Linux connection tracking ( conntrack ).

Table 3 (Forwarding Decision): Looks up the destination MAC address in the OVS MAC learning table (FDB) to identify the destination bridge port.

Datapath Flow Installation and Egress:

ovs-vswitchd transmits the forwarding instruction back to the kernel datapath and installs a new exact-match rule in the kernel cache.

The datapath executes the action and forwards the packet out the target port.

All subsequent packets belonging to that same session hit the kernel fast path directly, bypassing user space entirely.

Loading diagram... AHV Open vSwitch (OVS) Architecture, Bridge Layout, and virbr0 Isolation