Log Aggregation
Also called Log Pipeline, Centralized Logging.
Collecting logs from many sources into a central, searchable store.
What it is
Log aggregation is the practice and infrastructure of gathering logs from across an environment into a centralized system where they are parsed, indexed, and made searchable. The end-to-end path from source to store (collection, transport, processing, indexing) is the log pipeline.
Why it matters
Centralization is what makes large-scale investigation and correlation feasible, and storing logs off the originating hosts protects them from tampering or destruction during an incident. The pipeline's capacity, reliability, and field coverage directly bound what defenders can actually detect and hunt.
In practice
An aggregation pipeline ingesting endpoint, firewall, and cloud logs into one store so a single query can trace an attacker across all three.
What to look for
- All key sources arriving in one place.
- Ingestion delays that make searches miss recent events.
- Cost limits that cause sources to be dropped.
Common mistake
Collecting everything without a plan. Decide what you need for detection and investigation first.
Practice it nearby
CyberKit has no tool for this term itself. These are the closest places to practice it.
- Event Log Reader
Read a binary .evtx file or pasted event XML, with logon types, NTSTATUS codes and the Keywords mask decoded.
- Linux Case
A server making outbound connections nobody can explain: read its audit log, journal and scheduled jobs, and say who did what.
In the field
Well-known tools where this shows up on the job. They are listed to show the landscape, not as a recommendation.
-
Splunk Enterprise Security Commercial
A SIEM where these logs are searched with SPL and turned into correlation searches.
-
Microsoft Sentinel Commercial
Microsoft's cloud SIEM, queried with KQL and fed by connectors for these log sources.
-
Elastic Security Commercial
A SIEM built on Elasticsearch, with a detection rules library and timeline investigations.
-
Wazuh Open source
An open source platform that collects, decodes and alerts on host and log data.
Read next
- Log Forwarding: Transmitting logs off their source host to a remote collector.
- Log Enrichment: Adding external context to log events to make them more useful.
- Windows Event Forwarding: Native Windows mechanism to ship event logs to a central collector.