Study guide
10.1 Threat Intelligence & Indicator Match Rules
Elastic Certified SIEM Analyst Exam
Track your progress as you read
Finished sections get a check mark.
1 Chapter 1: Exam Overview & Study Strategy
1.1 Elastic Certified SIEM Analyst Exam Facts, Objectives & Study Plan
2 Chapter 2: Elastic Stack Architecture & SIEM Foundations
2.1 Elastic Stack Architecture for Security Operations 2.2 Telemetry Ingestion Architecture & Data Pipelines 2.3 Security Data Storage, Data Streams & ILM
3 Chapter 3: Elastic Common Schema (ECS) & Ingestion Normalization
3.1 ECS Structure, Core Principles & Essential Field Sets 3.2 Ingest Pipelines, Processors & Normalization Workflows 3.3 Fleet Server & Elastic Agent Integration Management
4 Chapter 4: Discover, Data Views & Security Query Languages
4.1 Kibana Discover, Security Data Views & Runtime Fields 4.2 Kibana Query Language (KQL) & Lucene for SecOps 4.3 ES|QL for Multi-Stage Security Analysis
5 Chapter 5: Security Visualizations & Threat Analytics
5.1 Metric, Aggregation & Histogram Visualizations for SOC 5.2 Data Tables, Heatmaps & Specialized Security Charts 5.3 Elastic Maps & Geospatial Telemetry Analysis
6 Chapter 6: Kibana Lens for Security Workflows
6.1 Lens Architecture & Multi-Layer Telemetry Visualizations 6.2 Lens Formulas, Ratios & Anomaly Baseline Metrics 6.3 Operationalizing Lens in SOC Triage & Drilldowns
7 Chapter 7: Security Dashboards & SOC Operations
7.1 Security Dashboard Architecture & SOC Layout Design 7.2 Interactive Controls, Time Sync & Cross-Filtering 7.3 Dashboard Exporting, Reporting & Spaces Sharing
8 Chapter 8: The Elastic Security App: Capabilities, Explore & Dashboards
8.1 Security App Capabilities & the Explore Pages (Hosts, Network, Users) 8.2 Monitoring with the Security App Dashboards
9 Chapter 9: Elastic Security Detection Engine & Core Rules
9.1 Detection Engine Architecture & Prebuilt Rule Management 9.2 Custom Query & Threshold Detection Rules 9.3 Event Correlation Rules with Event Query Language (EQL)
10 Chapter 10: Advanced Detection Rules, ML & Rule Tuning
10.1 Threat Intelligence & Indicator Match Rules 10.2 New Terms, ES|QL & Machine Learning Detection Rules 10.3 Detection Rule Tuning, Exceptions & Alert Suppression
11 Chapter 11: Alert Triage, Timelines & Investigation Workflows
11.1 Alert Triage Workflow & the Alert Details Flyout 11.2 Elastic Security Timeline & Timeline Templates 11.3 Visual Event Analyzer & Session View Forensics
12 Chapter 12: Case Management, Integrations & AI Assistant
12.1 Elastic Security Case Management & Triage Workflows 12.2 Case Connectors & External Incident Escalation 12.3 Elastic AI Assistant for Security & Attack Discovery
13 Chapter 13: Security Administration, RBAC & Kibana Spaces
13.1 Kibana Spaces for SOC Multitenancy & Segmentation 13.2 Role-Based Access Control, Feature Privileges & Index Security 13.3 Elastic Defend Administration & Endpoint Policy Controls
14 Chapter 14: End-to-End Threat Hunting & Incident Investigation Capstone
14.1 Hypothesis-Driven Threat Hunting & Baselining in Elastic 14.2 Investigating Lateral Movement & Credential Access Campaigns 14.3 Data Exfiltration, C2 Detection & Incident Reconstruction
10.1 Threat Intelligence & Indicator Match Rules
Key Takeaways Explain This Topic AI
Indicator Match rules execute a dual-query correlation, evaluating incoming operational telemetry indices alongside dedicated threat intelligence indicator indices within a single execution cycle.
Threat mapping field pairs bind source telemetry fields directly to normalized ECS indicator fields (such as file.hash.sha256 to threat.indicator.file.hash.sha256 or destination.ip to threat.indicator.ip).
Threat intelligence integrations in Fleet (such as MISP, AlienVault OTX, and Mandiant) normalize external indicators into ECS threat.indicator.* fields in logs-ti_* data streams, the default indicator index pattern.
Indicator match alerts store the matched field and the indicator's details (type, confidence, feed, TLP) in the threat.enrichments array, while the alert's MITRE ATT&CK mapping comes from the rule itself.
Indicator hygiene relies on a time-bounded indicator query (default @timestamp > "now-30d/d"), IOC expiration in supporting integrations, deduplication, and confidence filtering to limit load and false positives.
Last updated: September 2026
In modern enterprise Security Operations Centers (SOCs), defending against sophisticated threat actors requires continuously correlating internal operational telemetry with external cyber threat intelligence (CTI). Relying solely on static indicators of compromise (IOCs) hardcoded into traditional query rules introduces severe operational friction: updating an IP blocklist or file hash table would require manually editing dozens of individual detection rule queries. Furthermore, simple Lucene queries cannot cross-reference two independent data sets dynamically without complex ingestion-time joins.
Elastic Security addresses this challenge through Indicator Match Rules (internally designated as threat_match rules). This specialized rule type executes a high-performance, dual-query correlation engine that matches streaming telemetry against dedicated threat intelligence indices in real time. Mastering the architecture, field mapping mechanics, feed integrations, and lifecycle tuning of Indicator Match rules is a core competency for the Elastic Certified SIEM Analyst.
Indicator Match Rule Architecture: The Dual-Query Correlation Engine
Unlike standard Custom Query rules that inspect a single index pattern (such as logs-endpoint.events.* ), Indicator Match rules operate across two fundamentally distinct index sets during every execution interval:
Source Telemetry Indices : The operational event streams generated by enterprise infrastructure (e.g., endpoint process logs, perimeter firewall connections, DNS resolutions, authentication audits).
Threat Intelligence Indicator Indices : The reference data streams populated by threat intelligence integrations (by default the logs-ti_* pattern from the securitySolution:defaultThreatIndex advanced setting, which matches Elastic's threat intelligence integrations), containing validated indicators such as malicious file hashes, command-and-control (C2) domain names, and botnet IP addresses. +---------------------------------------------------------------------------------------------------+
- | INDICATOR MATCH DUAL-QUERY EXECUTION ARCHITECTURE |
- +---------------------------------------------------------------------------------------------------+
- | |
- | [ SOURCE TELEMETRY INDICES ] [ THREAT INTEL INDICATOR INDICES ] |
- | - Index Pattern: logs-endpoint.*, logs-network.* - Index Pattern: logs-ti_* |
- | - Source Query: event.category: "network" - Indicator Query: |
- | - Look-back Window: Last 5 minutes threat.indicator.confidence: "High" |
- | AND @timestamp > "now-30d/d" |
- | | | |
- | +---------------------------+----------------------------+ |
- | | |
- | v |
- | +-------------------------------+ |
- | | THREAT MAPPING CORRELATION | |
- | | destination.ip <=========> | |
- | | threat.indicator.ip | |
- | +-------------------------------+ |
- | | |
- | v |
- | [ MATCH IDENTIFIED: TRUE POSITIVE ] |
- | | |
- | v |
- | +-------------------------------+ |
- | | ALERT ENRICHMENT ENGINE | |
- | | Injects threat.* metadata: | |
- | | - threat.feed.name | |
- | | - threat.indicator.confidence | |
- | | - threat.tactic.name | |
- | +-------------------------------+ |
- | | |
- | v |
- | [ WRITE TO .alerts-security.alerts-* ] |
- | |
- +---------------------------------------------------------------------------------------------------+
- The Execution Pipeline
During each scheduled rule execution interval (e.g., every 5 minutes with a 1-minute look-back buffer), the Elastic Security Detection Engine executes the following operational phases:
Source Query Execution : The engine queries the source indices using the defined Source Query and time window. For example, it retrieves all network connection events where event.category: "network" and not destination.ip: (10.0.0.0/8 or 172.16.0.0/12 or 192.168.0.0/16) .
Indicator Query Execution : Concurrently, the engine evaluates the Indicator Query against the indicator indices. To prevent querying stale or low-confidence data, this query filters indicators by age and, where the feed provides it, confidence. The default indicator index query is @timestamp > "now-30d/d" , which keeps indicators ingested in the last 30 days (rounded down to midnight UTC). A stricter example: @timestamp > "now-30d/d" and threat.indicator.confidence: ("High" or "Medium") .
Threat Mapping Join : The engine cross-references the retrieved source events with the active indicator documents based on configured Threat Mapping Field Pairs . Elasticsearch performs optimized inverted index lookups between the specified fields.
Alert Synthesis and Metadata Enrichment : When a source document field matches an indicator field, the engine constructs a security alert document in .alerts-security.alerts-* . Crucially, the alert contains the full source event context combined with enriched metadata copied directly from the matching indicator document.
Configuring Threat Mapping Field Pairs
The foundation of an Indicator Match rule is the Threat Mapping configuration. This defines which ECS field in the source telemetry corresponds to which ECS field in the threat indicator index.
Elastic Common Schema (ECS) standardizes threat intelligence fields under the top-level threat.* and threat.indicator.* hierarchies. Because different attack vectors manifest across distinct telemetry types, analysts must establish precise mapping pairs:
Common Threat Mapping Field Pairs
Telemetry Type Source Telemetry Field Target Indicator Field Indicator Data Type SecOps Detection Scenario
File / Binary Execution file.hash.sha256 threat.indicator.file.hash.sha256 keyword Detects execution or download of known malware payloads (e.g., ransomware binaries, webshells).
Outbound Network Traffic destination.ip threat.indicator.ip ip Detects outbound network connections to active adversary command-and-control (C2) servers.
Inbound Perimeter Traffic source.ip threat.indicator.ip ip Flags inbound scanning, exploitation attempts, or brute-force campaigns from known bulletproof hosting providers.
DNS Name Resolution dns.question.name threat.indicator.url.domain keyword Detects DNS lookups targeting malicious domains, phishing landing pages, or DGA infrastructure.
Web / Proxy Access url.full threat.indicator.url.full keyword Flags HTTP/HTTPS requests to specific malicious URLs containing staging directories or payload download paths.
Email Security email.sender.address threat.indicator.email.address keyword Identifies spear-phishing campaigns originating from known adversarial email addresses.
Legacy File Artifacts file.hash.md5 threat.indicator.file.hash.md5 keyword Legacy threat feed correlation for older indicator databases lacking SHA256 hashes.
Multi-Field Composite Mappings
Elastic Security supports defining multiple mapping sets within a single Indicator Match rule. For example, an analyst can configure an endpoint file monitoring rule with two alternative mappings:
- Mapping 1: file.hash.sha256 <===> threat.indicator.file.hash.sha256
- Mapping 2: file.hash.md5 <===> threat.indicator.file.hash.md5
Entries joined with AND inside one mapping group must all match, while separate groups are joined with OR , so if either mapping group matches, an alert is generated. Only single-value fields are supported, and pairing fields of incompatible types (for example an IP field with a keyword domain field) will not produce matches. You can even point the indicator index at a value list ( .items-<space-id> ) to match events against an uploaded list of indicators.
Threat Intelligence Integrations & Ingestion Pipelines
Threat indicators enter the Elastic Stack through Elastic Agent integrations managed via Fleet , or through custom ingestion pipelines communicating with threat intelligence platforms (TIPs).
Supported Fleet Threat Intel Integrations
Elastic Security provides prebuilt integrations for industry-standard threat intelligence feeds and protocols:
MISP (Malware Information Sharing Platform) : Ingests MISP events, attributes, and threat levels over REST APIs.
AlienVault OTX : Subscribes to Open Threat Exchange pulses, parsing IP, domain, and hash indicators.
Anomali ThreatStream & Mandiant Advantage : Enterprise integrations streaming commercial high-fidelity threat intelligence.
TAXII (Trusted Automated eXchange of Intelligence Information) : Polls TAXII 2.x servers that publish STIX-formatted indicator collections.
Custom Threat File Ingestion : Ingests flat CSV or NDJSON feeds containing internal SOC blacklists or incident-specific indicators.
Ingestion Pipelines and Normalization
Incoming indicators pass through ingest pipelines that parse vendor-specific structures into ECS-compliant fields. For example, an AlienVault pulse indicator of type IPv4 is mapped to threat.indicator.ip , while the pulse name is mapped to threat.feed.name . The pipeline also populates:
@timestamp : Set to the ingestion timestamp or indicator publication timestamp.
threat.indicator.type : Normalized indicator classification using ECS values such as ipv4-addr , domain-name , url and file .
threat.indicator.marking.tlp : Traffic Light Protocol classification (ECS values such as CLEAR , GREEN , AMBER and RED ).
Expiry handling: many Elastic threat intelligence integrations support IOC expiration , keeping only unexpired indicators in a separate latest-indicators index so rules stop matching stale IOCs.
Alert Metadata Enrichment
The main operational advantage of Indicator Match rules is automatic indicator enrichment . When a match occurs, the alert records which field matched and copies the matching indicator's details into the threat.enrichments array of the alert document: {
- "threat": {
- "enrichments": [
- {
- "matched": {
- "atomic": "198.51.100.42",
- "field": "destination.ip",
- "type": "indicator_match_rule"
- },
- "indicator": {
- "type": "ipv4-addr",
- "ip": "198.51.100.42",
- "confidence": "High",
- "description": "Command and control node reported by the feed",
- "first_seen": "2026-08-15T04:12:00.000Z",
- "last_seen": "2026-09-28T18:22:10.000Z",
- "marking": { "tlp": "AMBER" }
- },
- "feed": { "name": "Example Threat Feed" }
- }
- ]
- }
- }
Two points are often confused:
The MITRE ATT&CK tactic and technique shown on an alert come from the rule's own threat mapping ( kibana.alert.rule.threat ), not from the indicator document.
Enrichment is not limited to indicator match rules. The alert details flyout's Threat intelligence section also queries the threat indices at investigation time. By default it searches the past 30 days for indicators that match fields on any alert, listed as Fields enriched with threat intelligence . The Threat match detected part is populated only for alerts from indicator match rules.
This enrichment saves analysts from copying IP addresses into external portals during triage. The feed, confidence and TLP marking are already on the alert.
Performance Optimization & Indicator Lifecycle Hygiene
Because Indicator Match rules perform cross-index search joins, poorly configured rules can degrade cluster search performance, trigger query timeouts, or flood the SOC with false positives from stale indicators. SIEM analysts must implement strict indicator hygiene.
1. Scoping Source and Indicator Queries
Never leave the Source Query or Indicator Query blank. An unconstrained query forces Elasticsearch to scan millions of documents across all historical indices:
Source Scoping : Constrain source telemetry to specific event categories or protocols (e.g., event.category: "network" and network.direction: "outbound" ). Exclude RFC 1918 private subnets from destination IP matching to prevent accidental internal matches.
Indicator Scoping : Restrict indicators by recency and confidence: threat.indicator.confidence: ("High" or "Medium") and @timestamp > "now-30d/d" (ECS confidence values are capitalized: Not Specified , None , Low , Medium , High ). Stale indicators frequently represent reallocated cloud IPs or recycled domains.
2. Indicator Deduplication
Threat feeds frequently publish the same IOC across multiple pulses or updates. If an indicator index contains 50 identical documents for the same IP address, an Indicator Match rule matching that IP will process redundant join operations. Ingestion pipelines should implement fingerprint processors or leverage Elasticsearch document IDs derived from SHA256(threat.indicator.ip + threat.feed.name) to enforce index-level deduplication.
3. Indicator Expiration & Index Lifecycle Management (ILM)
Threat indicators have a finite half-life. C2 servers are decommissioned, compromised websites are remediated, and dynamic DNS entries change hourly. Managing indicator lifecycles requires:
Turning on IOC expiration in threat intelligence integrations that support it, so expired indicators drop out of the latest-indicators index the rule searches.
Keeping the indicator index query time-bounded (the default @timestamp > "now-30d/d" or a window that suits the feed) and using ILM on logs-ti_* data streams to delete raw indicator history you no longer need.