TID-CMM Threat-Informed Detection Capability Maturity Model
HomeModel58 sub-capabilities

All 58 sub-capabilities

Every sub-capability in the model, with all six level descriptors, the evidence that substantiates a claim at level 4 or 5, and its crosswalk to NIST CSF 2.0. Each has a stable anchor, so a specific capability can be cited directly.

Reading the levels. Levels 0 to 2 describe absence, individual habit and partial practice. Levels 3 to 5 are the ones an assessor scores against and the ones that require evidence. The maturity scale.

TI — Threat Intelligence & Adversary Prioritisation

TI.1 Intelligence requirements and PIRs 18.0% of TI standard

Are there documented, prioritised intelligence requirements that state what the organisation needs to know, tied to business risk and to named decisions?

Level 0

No intelligence requirements exist. Collection is undirected.

Level 1

Informal requirements held by one analyst; expressed as topics of interest rather than questions.

Level 2

A written PIR list exists and is reviewed annually, but is generic and not tied to specific decisions.

Level 3

PIRs are decomposed into specific intelligence requirements (SIRs) and essential elements of information (EEIs), each tied to a named decision-maker and a business risk.

Level 4

PIR satisfaction is measured — each requirement has a coverage and confidence rating, gaps are tracked, and collection is retasked on a defined cadence.

Level 5

PIRs are dynamically re-prioritised from operational signal (incidents, hunts, emulation results, sector reporting) with measured time-to-retask.

Evidence that substantiates a claim
  • Signed PIR/SIR register with named decision owners
  • Requirement satisfaction and collection-gap tracker
  • Retasking log with dates
NIST CSF 2.0

ID.RA-03, ID.RA-04, GV.RM-01

TI.2 Threat profile and adversary prioritisation 20.0% of TI essential

Is there a maintained, evidenced threat profile that names the actors, campaigns and behaviours most relevant to this organisation, and ranks them?

Level 0

No threat profile. "Everyone is a target" is the operating assumption.

Level 1

An informal list of headline actors, largely drawn from vendor marketing and news cycles.

Level 2

A documented threat profile exists, refreshed annually, based mainly on sector reporting.

Level 3

Threat profile is built from sector, geography, technology stack, crown-jewel exposure and observed activity; actors are ranked by a documented relevance methodology and mapped to ATT&CK Groups and Campaigns.

Level 4

Profile is re-scored at least quarterly against new reporting and internal telemetry; changes in ranking produce recorded downstream tasking to threat modeling, detection engineering and emulation.

Level 5

Profile is continuously maintained, includes emerging and unattributed behaviour clusters, incorporates supply-chain and insider actors, and drives automated re-prioritisation of the detection backlog.

Evidence that substantiates a claim
  • Threat profile document with ranking methodology and ATT&CK Group/Campaign IDs
  • Quarterly re-score records
  • Tasking records showing profile change to backlog change
NIST CSF 2.0

ID.RA-03, ID.RA-05

TI.3 Technical CTI ingestion and indicator lifecycle 14.0% of TI essential

Are technical indicators ingested, scored, deployed, aged and retired under a defined lifecycle, with measured operational value?

Level 0

No indicator ingestion, or manual copy-paste from emails.

Level 1

Indicators are loaded ad hoc during incidents; nothing is retired.

Level 2

A TIP or equivalent ingests feeds automatically; deduplication and basic scoring exist; retirement is manual and inconsistent.

Level 3

Indicators carry confidence, source, ATT&CK context and expiry; deployment target (block, alert, enrich, hunt) is decided by score, not by default.

Level 4

Indicator hit rates, false-positive rates and feed value are measured per source; low-value feeds are cancelled on the evidence.

Level 5

Lifecycle is fully automated including sunset, with feedback from detection outcomes re-scoring source reliability, and internally derived indicators promoted back to the TIP.

Evidence that substantiates a claim
  • TIP configuration and lifecycle policy
  • Per-feed hit-rate/FP report
  • Feed decommissioning decision record
NIST CSF 2.0

ID.RA-02, DE.AE-07

TI.4 TTP extraction and ATT&CK mapping discipline 18.0% of TI standard

Is finished reporting systematically decomposed into ATT&CK-mapped adversary behaviours with enough procedural detail to build a detection from?

Level 0

Reports are read and filed. No structured extraction.

Level 1

Analysts occasionally note technique IDs in prose.

Level 2

Reports are tagged with ATT&CK technique IDs, mostly at parent-technique level, stored in a searchable repository.

Level 3

Extraction reaches sub-technique and *procedure* level — the specific command line, API call, registry path or protocol behaviour — recorded in a structured schema with source citation and confidence.

Level 4

Extraction quality is reviewed; coverage of the prioritised threat profile by extracted procedures is measured; ambiguous mappings are arbitrated and the rationale recorded.

Level 5

Extraction is partly automated (NLP-assisted with human validation), feeds a behaviour library reused by threat modeling, detection engineering and emulation, and is contributed to community knowledge bases.

Evidence that substantiates a claim
  • Structured TTP/procedure library with citations
  • Mapping quality-review records
  • Behaviour library referenced by detection tickets
NIST CSF 2.0

ID.RA-03, ID.IM-02

TI.5 Intelligence-to-detection tasking 18.0% of TI essential

Does intelligence reliably and measurably produce detection, hunting and emulation work — and can you prove the linkage?

Level 0

No route from intelligence to engineering. The two functions do not interact.

Level 1

Occasional informal requests, typically during a live incident.

Level 2

A defined handoff exists (ticket or email) but is used inconsistently and without SLA.

Level 3

Every prioritised behaviour produces a tracked work item routed to detection engineering, hunting or emulation, with a documented disposition even when the answer is "no action".

Level 4

Time from publication to deployed-and-validated detection is measured per priority tier, trended, and reported; the backlog is triaged against the threat profile ranking.

Level 5

Tasking is automated from the behaviour library, with measured cycle time under an agreed target and automatic escalation when a top-tier behaviour has no validated detection.

Evidence that substantiates a claim
  • Intel-to-detection ticket trail with dispositions
  • Publication-to-validated-detection cycle-time trend
  • Escalation records for uncovered top-tier behaviours
NIST CSF 2.0

ID.RA-06, ID.IM-01, DE.AE-08

TI.6 Dissemination, sharing and community contribution 12.0% of TI comprehensive

Is intelligence delivered in the form each consumer can act on, and does the organisation contribute back to sector and community sharing?

Level 0

No dissemination. Intelligence stays with the person who produced it.

Level 1

Ad hoc emails and chat messages, one format for all audiences.

Level 2

Regular scheduled reporting exists, but is a single product pushed to everyone.

Level 3

Differentiated products by audience — executive risk narrative, SOC-actionable behaviour briefs, engineering-ready procedure detail — with a defined cadence.

Level 4

Consumer feedback is collected and acted on; usefulness is measured; participation in ISAC/ISAO or sector sharing is active and reciprocal.

Level 5

Bidirectional automated sharing (STIX/TAXII or equivalent), original research published, and community detection content contributed under an agreed disclosure policy.

Evidence that substantiates a claim
  • Product catalogue by audience with cadence
  • Consumer feedback and usefulness scores
  • Sharing-community membership and contribution records
NIST CSF 2.0

ID.RA-03, GV.OC-02, RS.CO-02

TM — Threat Modeling & Attack Path Analysis

TM.1 Asset, identity and crown-jewel identification 13.0% of TM essential

Do you know what you are actually protecting — the systems, data, identities and business processes whose compromise would matter most?

Level 0

No asset inventory beyond what infrastructure teams happen to hold.

Level 1

Partial inventories in spreadsheets, stale, no criticality rating.

Level 2

A CMDB or asset inventory exists with ownership and basic criticality, refreshed periodically; identities and cloud resources are covered inconsistently.

Level 3

Crown jewels are formally identified through business impact analysis and include data stores, privileged identity paths, build/CI systems and trust relationships; each has a named owner and an impact statement.

Level 4

Inventory completeness is measured against independent discovery (network, cloud API, identity provider, EDR) and the delta is tracked and closed; criticality is reviewed on change.

Level 5

Asset, identity and exposure inventories are continuously reconciled and automatically feed threat modeling, detection scoping and validation targeting.

Evidence that substantiates a claim
  • Crown-jewel register with business impact statements
  • Discovery-versus-inventory reconciliation report
  • Owner attestation records
NIST CSF 2.0

ID.AM-01, ID.AM-02, ID.AM-05, ID.AM-07

TM.2 System and data-flow threat modeling 16.0% of TM standard

Are systems threat-modelled using a recognised structured method, and does that modelling happen at the right point in the delivery lifecycle?

Level 0

No threat modeling.

Level 1

Occasional whiteboard sessions for high-profile projects, no method, no record.

Level 2

A method is nominated (STRIDE, PASTA, LINDDUN, or equivalent) and used for major projects at design review; outputs are documents.

Level 3

Threat modeling is mandatory for crown-jewel systems and material changes, uses data-flow diagrams with trust boundaries, and outputs are recorded as structured, queryable threats rather than prose.

Level 4

Coverage of the crown-jewel estate by current threat models is measured; model quality is peer-reviewed; findings are tracked to closure with owners and dates.

Level 5

Threat modeling is embedded in the delivery pipeline (threat-model-as-code, diagrams generated from IaC), automatically re-triggered by architectural change, and its output is machine-consumable by the detection backlog.

Evidence that substantiates a claim
  • Threat model repository with trust-boundary DFDs
  • Crown-jewel threat-model coverage metric
  • Threat-model-as-code artefacts and pipeline hooks
NIST CSF 2.0

ID.RA-01, ID.RA-04, PR.PS-06

TM.7 Attack surface enumeration 14.0% of TM essential

Do you continuously know every way in — external exposure, APIs, SaaS tenants, cloud services, identity federation, shadow IT and third-party ingress — so attack trees are rooted in reality rather than in the architecture diagram?

Level 0

No attack surface enumeration. Exposure is whatever the last audit happened to notice.

Level 1

An informal, partial picture held by individuals; discovered assets surprise the team regularly.

Level 2

Periodic external scanning of known ranges and domains; cloud, SaaS and API exposure tracked inconsistently; shadow IT invisible.

Level 3

Enumeration is continuous and deliberate across external services, APIs, cloud resources and identity federation, reconciled against the asset inventory; deltas are triaged and every internet-reachable path to a crown jewel is known and appears as an attack tree root.

Level 4

Independent discovery (external ASM, cloud API inventory, certificate and DNS monitoring, SaaS discovery) is diffed against the declared surface; unknown-asset rate is measured and trended; new exposure automatically triggers threat model review and telemetry onboarding.

Level 5

Attack surface change is handled as a live event — new exposure raises detection and modeling work items in near real time, pre-approved telemetry and baseline detections deploy with the asset, and surface reduction is a reported, incentivised metric.

Evidence that substantiates a claim
  • Attack surface register reconciled against independent discovery
  • Unknown-asset rate metric and trend
  • Change-triggered modeling and onboarding records
NIST CSF 2.0

ID.AM-01, ID.AM-02, ID.AM-04, ID.RA-01, DE.CM-06

TM.3 Attack tree construction 16.0% of TM standard

Are attack trees built for the objectives that matter — decomposing an adversary goal into the alternative branches by which it can be achieved — and are all branches carried through to a detection decision?

Level 0

No attack trees. Threats are described as single-step statements.

Level 1

Occasional informal "how would I break in" discussions, not recorded.

Level 2

Attack trees are drawn for selected scenarios but stay as diagrams; leaves are not mapped to techniques or to controls.

Level 3

Trees are built for prioritised adversary objectives (e.g. "obtain domain dominance", "exfiltrate the customer database", "tamper with the payment file"); every node is mapped to ATT&CK techniques, and every leaf carries a prevent/detect/accept decision.

Level 4

Trees are annotated with feasibility and cost-to-adversary, are reviewed against real incident and emulation outcomes, and drive an explicitly prioritised choke-point strategy — nodes that appear in many trees are treated as high-value detection targets.

Level 5

Attack trees are maintained as structured data (not pictures), versioned, automatically re-evaluated when the estate or the threat profile changes, and used to compute residual risk per objective.

Evidence that substantiates a claim
  • Attack tree library in structured form (YAML/JSON/graph DB)
  • Node-to-ATT&CK mapping and per-leaf control decisions
  • Choke-point analysis showing nodes shared across trees
NIST CSF 2.0

ID.RA-01, ID.RA-04, ID.IM-02

TM.4 Attack path and exposure analysis 15.0% of TM comprehensive

Do you analyse real, computed attack paths through identity, network and cloud relationships in the live estate — not only hypothetical ones?

Level 0

No attack path analysis. Exposure is understood only as a vulnerability list.

Level 1

Path thinking happens only after a red team or pentest report describes one.

Level 2

Point-in-time path analysis is run occasionally with a tool (identity graph, cloud permission analysis, AD path tooling) for specific reviews.

Level 3

Path analysis runs on a defined cadence across identity, cloud entitlement, network reachability and trust relationships; results are ranked by proximity to crown jewels and issued as remediation and detection work.

Level 4

Path exposure is trended as a metric (number and shortest length of viable paths to each crown jewel); choke points are instrumented for detection where remediation is not feasible; reduction is reported.

Level 5

Continuous path computation is integrated with change management and CTEM cycles; new paths raise alerts in near real time and automatically create both a remediation and a detection work item.

Evidence that substantiates a claim
  • Attack path analysis output with paths to crown jewels
  • Trend of viable path count and shortest path length
  • Choke-point instrumentation records
NIST CSF 2.0

ID.RA-01, ID.RA-05, ID.IM-02, PR.AA-05

TM.5 Abuse cases to detection requirements traceability 14.0% of TM standard

Can you trace a specific detection rule back to the threat model or attack tree node that justified it — and identify model nodes with no detection?

Level 0

No traceability. Detections exist for reasons nobody records.

Level 1

Traceability exists in individuals' memory only.

Level 2

Some detection tickets reference a threat model informally in free text.

Level 3

A maintained traceability matrix links threat model / attack tree nodes to detection requirements, to deployed detections, and to validation results, with a unique identifier at each step.

Level 4

Orphaned nodes (modelled but undetected and un-prevented) and orphaned detections (deployed but justified by nothing) are both reported as defects and worked down; coverage of model nodes is a reported metric.

Level 5

Traceability is automated end to end — model node, requirement, rule, test, validation outcome and incident are linked in one queryable graph used for assurance reporting.

Evidence that substantiates a claim
  • Traceability matrix or graph query output
  • Orphaned-node and orphaned-detection reports
  • Assurance report tracing an incident back to a model node
NIST CSF 2.0

ID.IM-01, ID.IM-02, DE.CM-09

TM.6 Model maintenance and change triggers 12.0% of TM comprehensive

Are threat models, attack trees and path analyses kept alive by defined triggers, or do they decay silently after first publication?

Level 0

Models, where they exist, are never updated.

Level 1

Updated only when someone remembers or an auditor asks.

Level 2

A calendar-based review cycle exists (typically annual) and is partially honoured.

Level 3

Defined triggers force review — architecture change, new crown jewel, new prioritised actor, significant incident, major ATT&CK release — and review completion is tracked.

Level 4

Model freshness is measured (age distribution, percentage overdue), overdue models are escalated to owners, and drift between model and reality is sampled and reported.

Level 5

Change detection is automated from CI/CD, cloud control plane and identity change events; affected models are flagged and re-validated with measured turnaround.

Evidence that substantiates a claim
  • Documented change triggers and review completion log
  • Model freshness metric and overdue escalations
  • Automated change-trigger integration
NIST CSF 2.0

ID.IM-03, ID.RA-07, GV.OV-03

DC — Telemetry & Detection Coverage

DC.1 Log source inventory and ownership 14.0% of DC essential

Is there a complete, owned inventory of telemetry sources with their scope, coverage percentage and criticality?

Level 0

No inventory. Nobody can list what is being collected.

Level 1

A partial list held by the platform team, out of date.

Level 2

An inventory exists with source names and destinations, reviewed periodically; deployment coverage per source is estimated.

Level 3

Each source has a named business and technical owner, defined scope (which estate it covers), measured deployment coverage, criticality rating and mapping to ATT&CK data components.

Level 4

Inventory completeness is validated against independent asset discovery; unmonitored assets are reported as a defect class with an owner and a target date.

Level 5

Inventory is continuously reconciled and automatically drives onboarding, alerting on unmonitored crown-jewel assets within a defined time window.

Evidence that substantiates a claim
  • Log source inventory with owners, coverage % and data-component mapping
  • Unmonitored asset report and closure trend
NIST CSF 2.0

ID.AM-01, DE.CM-01, DE.CM-09

DC.2 Telemetry quality, completeness and timeliness 18.0% of DC essential

Do you measure whether the data arriving is complete, correctly parsed, timely and unaltered — and do you alert when it is not?

Level 0

Data quality is unknown. Gaps are discovered during investigations.

Level 1

Occasional manual checks; problems found reactively when a search returns nothing.

Level 2

Basic volume monitoring exists with static thresholds; parsing errors are noticed when someone reports them.

Level 3

Quality is measured on defined dimensions — completeness, field-level fill rate, parsing success, ingestion latency, time-source accuracy, retention conformance — per source, with alerting on deviation.

Level 4

Quality SLOs are agreed with source owners, breaches are ticketed and trended, and known-gap periods are recorded so investigations and coverage claims are adjusted for them.

Level 5

Quality is enforced automatically — schema validation at ingest, synthetic canary events per source to prove the path end to end, self-healing pipelines, and measured mean time to detect a telemetry outage.

Evidence that substantiates a claim
  • Per-source data quality dashboard with SLOs
  • Canary event configuration and results
  • Telemetry outage MTTD metric
NIST CSF 2.0

DE.CM-09, DE.AE-03, PR.PS-04

DC.3 Normalisation and data model discipline 14.0% of DC standard

Is telemetry normalised to a documented, versioned data model so detections are portable and analysts are not re-learning field names per source?

Level 0

Raw, source-specific fields only. Every search is bespoke.

Level 1

Inconsistent ad hoc field extractions built by whoever needed them.

Level 2

A data model is used for the main sources (OCSF, ECS, CIM, ASIM or in-house) but coverage is partial and undocumented.

Level 3

A documented, versioned schema is mandated for onboarding; conformance is checked at onboarding; entity resolution (user, host, process, identity) is defined.

Level 4

Schema conformance is measured continuously across all sources; non-conformant sources are tracked as debt; schema changes go through change control with impact analysis on affected detections.

Level 5

Normalisation is automated and tested, detections are written against the model rather than the source, and the same detection content runs across multiple platforms with proven equivalence.

Evidence that substantiates a claim
  • Versioned schema document and onboarding conformance gate
  • Schema conformance metric per source
  • Cross-platform detection portability proof
NIST CSF 2.0

DE.AE-03, PR.DS-01

DC.4 ATT&CK technique coverage measurement 20.0% of DC standard

Is coverage measured honestly at technique and sub-technique level, grounded in data-component availability and detection validity — not in rule counts?

Level 0

Coverage is not measured.

Level 1

A hand-drawn Navigator layer produced once, based on opinion.

Level 2

Coverage is mapped by tagging existing rules with technique IDs; parent-technique level only; no distinction between "we have a rule" and "it works".

Level 3

Coverage is scored on a defined scale that separates telemetry availability, detection logic presence and detection quality; measured at sub-technique level for the in-scope set defined by the threat profile and platform mix.

Level 4

Coverage scoring requires evidence from validation (see AV domain); the Validated Coverage Score is trended over time; regressions are investigated.

Level 5

Coverage is computed automatically from the detection repository, telemetry health and the latest validation results, refreshed on every ATT&CK release, with automated diff reporting on new and deprecated techniques.

Evidence that substantiates a claim
  • Coverage model definition and scoring scale
  • Navigator layer generated from the detection repository
  • Validated Coverage Score trend and ATT&CK release diff report
NIST CSF 2.0

DE.CM-09, ID.IM-02

DC.5 Coverage breadth across attack surfaces 20.0% of DC essential

Does visibility extend across every surface the prioritised adversaries use — endpoint, identity, cloud control plane, SaaS, network, email, application, container, OT/IoT and third-party — rather than concentrating on endpoint?

Level 0

One or two surfaces instrumented, typically endpoint and perimeter.

Level 1

Additional sources exist but are unmonitored or only searched during incidents.

Level 2

Most traditional surfaces are covered; cloud control plane, SaaS and identity are partial; OT/IoT and CI/CD are absent.

Level 3

Coverage is deliberately scoped per surface against the threat profile, with documented decisions on surfaces deliberately not covered and the risk accepted.

Level 4

Per-surface coverage is measured and reported separately, preventing a strong endpoint programme from masking a blind cloud or identity plane; gaps carry owners and dates.

Level 5

New surfaces are onboarded as part of technology adoption governance — no material new platform reaches production without a telemetry plan and baseline detections.

Evidence that substantiates a claim
  • Per-surface coverage report
  • Accepted-risk records for uncovered surfaces
  • Technology-adoption gate requiring a telemetry plan
NIST CSF 2.0

DE.CM-01, DE.CM-02, DE.CM-03, DE.CM-06, ID.AM-04

DC.6 Visibility gap management 14.0% of DC essential

Are known blind spots recorded, prioritised, costed and driven to closure — or quietly tolerated?

Level 0

Blind spots are not recorded.

Level 1

Known informally; raised in conversation, not tracked.

Level 2

A gap list exists but has no owners, priorities or dates.

Level 3

Gaps are registered with the technique(s) they blind, the crown jewels affected, an owner, a priority derived from the threat profile, and a target date.

Level 4

Gap closure rate and ageing are reported; gaps that cannot be closed are compensated with alternative detection or explicit risk acceptance at the right level.

Level 5

Gaps are generated automatically from coverage and validation results, costed, and fed into budget planning with demonstrated closure of the highest-risk items each cycle.

Evidence that substantiates a claim
  • Visibility gap register with owners and dates
  • Gap ageing and closure-rate trend
  • Risk acceptance records for tolerated gaps
NIST CSF 2.0

ID.RA-06, ID.IM-01, ID.IM-03

DE — Detection Engineering

DE.1 Detection lifecycle and intake 10.0% of DE essential

Is there a defined lifecycle from requirement through design, build, test, release, monitor and retire — with a controlled intake?

Level 0

No lifecycle. Rules appear when someone has an idea or a vendor ships content.

Level 1

Informal build-and-deploy by individuals; no stages, no record.

Level 2

A documented process exists covering build and deploy; test and retire stages are weak or skipped under pressure.

Level 3

A full lifecycle is defined and enforced, with a single intake queue accepting requests from intelligence, threat modeling, hunting, incidents, emulation and audit — each item carrying a source and a priority.

Level 4

Stage transition criteria are explicit and gated; lifecycle metrics (queue depth, lead time, stage ageing, rejection reasons) are measured and reviewed.

Level 5

The lifecycle is automated end to end with policy-as-code gates; lead time from intake to validated production is measured against a target and continuously reduced.

Evidence that substantiates a claim
  • Documented lifecycle with stage gates
  • Intake queue showing source attribution per item
  • Lead-time and queue-depth trends
NIST CSF 2.0

DE.CM-09, ID.IM-01

DE.2 Detection-as-code 12.0% of DE standard

Is detection content managed as code — versioned, peer-reviewed, and deployed through an automated pipeline?

Level 0

Rules are edited directly in the console. No history beyond the tool's audit log.

Level 1

Occasional manual exports kept in a shared folder as backup.

Level 2

Content is stored in version control but deployed manually; commits are not reviewed.

Level 3

All detection content lives in version control with mandatory peer review, branch protection, meaningful commit history and a documented release process.

Level 4

CI validates syntax, schema, metadata completeness and test results before merge; deployment is automated with rollback; production drift from the repository is detected and alerted.

Level 5

Full GitOps — the repository is the single source of truth, environments are reproducible, deployments are automated with progressive rollout, and drift is auto-remediated.

Evidence that substantiates a claim
  • Repository with branch protection and review history
  • CI pipeline definition and passing runs
  • Drift detection alerts and rollback records
NIST CSF 2.0

PR.PS-01, PR.PS-06, DE.CM-09

DE.3 Detection standards, metadata and documentation 10.0% of DE essential

Does every detection carry the metadata needed to operate, audit and improve it — and is a shared standard enforced?

Level 0

No standard. Rule names are the only documentation.

Level 1

Some rules have descriptions; quality varies by author.

Level 2

A template exists; completion is voluntary and partial.

Level 3

A mandatory schema is enforced — unique ID, author, owner, ATT&CK technique and sub-technique, data sources required, logic rationale, known false positives, severity and risk score, triage guidance, response playbook link, validation reference, and version.

Level 4

Metadata completeness and accuracy are measured; incomplete content cannot pass CI; analyst-facing triage guidance is reviewed for usability by the people who use it at 3am.

Level 5

Metadata is machine-consumable and powers automated coverage reporting, response routing, validation targeting and impact analysis when a log source degrades.

Evidence that substantiates a claim
  • Enforced detection schema (e.g. Sigma-compatible) and CI validation rule
  • Metadata completeness metric
  • Automated report built from detection metadata
NIST CSF 2.0

DE.AE-02, DE.CM-09, RS.MA-02

DE.4 Testing and pre-deployment validation 13.0% of DE standard

Is every detection proven to fire on true positive input and stay quiet on benign input, before it reaches production?

Level 0

No testing. Rules are enabled and observed.

Level 1

Author eyeballs a historical search and calls it tested.

Level 2

Manual testing against sample events for some rules; results not retained.

Level 3

Every detection has a positive test (a reproducible execution or synthetic event that must trigger it) and a negative test set of benign activity that must not; results are recorded against the rule version.

Level 4

Tests run automatically in CI against a representative dataset or lab range; regression tests re-run on every change and on data model changes; test coverage of the detection portfolio is measured.

Level 5

Tests are generated from the emulation library, run continuously against production-like telemetry, and any detection without a passing test in the current period is automatically flagged as unverified in coverage reporting.

Evidence that substantiates a claim
  • Test definitions stored with the detection content
  • CI test run history and coverage-of-portfolio metric
  • Unverified-detection report
NIST CSF 2.0

ID.IM-02, DE.CM-09, PR.PS-06

DE.5 Tuning, precision and false-positive management 10.0% of DE essential

Is alert precision measured per detection and improved deliberately, rather than by disabling noisy rules?

Level 0

No feedback loop. Noisy rules are muted or ignored by analysts.

Level 1

Tuning happens reactively when analysts complain loudly enough.

Level 2

Tuning requests are logged and actioned; changes are made in the console without a record of rationale.

Level 3

Every detection has measured true-positive/false-positive outcomes captured at case closure; precision is calculated per rule; tuning changes are version-controlled with a stated rationale and expected effect.

Level 4

Precision and volume thresholds are agreed; rules breaching them enter a formal remediation path with a deadline, ending in fix, demote-to-hunt, or retire; the effect of each change is measured after the fact.

Level 5

Tuning is partly automated with statistical baselining and allow-list governance; suppression is time-boxed and expires by default; precision is trended per rule and per domain with alerting on degradation.

Evidence that substantiates a claim
  • Per-rule precision and volume report
  • Tuning change records with rationale and post-change effect
  • Expiring suppression policy and audit
NIST CSF 2.0

DE.AE-08, ID.IM-01, RS.AN-08

DE.6 Detection health and silent-failure monitoring 10.0% of DE essential

Would you know if a detection stopped working — not because it was deleted, but because its data stopped arriving or its schema changed?

Level 0

No health monitoring. Silent failure is discovered during an incident, or never.

Level 1

Occasional manual review of whether rules have fired recently.

Level 2

Basic "rule has not fired in N days" reporting exists, treated as informational.

Level 3

Health is monitored on multiple signals — data source availability for each rule's required components, execution errors, schema drift, scheduling failures, and unexpected volume change — with defined thresholds.

Level 4

Health failures raise operational tickets with SLAs; the percentage of the portfolio in a healthy state is a reported KPI; dependency mapping shows which detections a given log source outage disables.

Level 5

Health monitoring is closed-loop with canary events proving the full path from generation to alert; failures auto-open incidents, and coverage reporting automatically discounts unhealthy detections.

Evidence that substantiates a claim
  • Detection health dashboard with dependency mapping
  • Portfolio-health KPI trend
  • Canary-to-alert proof and auto-ticketing configuration
NIST CSF 2.0

DE.CM-09, PR.PS-04, DE.AE-03

DE.7 Versioning, deprecation and retirement 8.0% of DE standard

Is content retired deliberately when it no longer earns its place, with a record of why?

Level 0

Nothing is ever retired. The rule set only grows.

Level 1

Rules are occasionally disabled without record.

Level 2

Retirement happens during periodic clean-ups, driven by performance not by value.

Level 3

Retirement criteria are defined (superseded, permanently unsupported telemetry, technique no longer relevant, unfixable precision) and each retirement is recorded with rationale and approval.

Level 4

The portfolio is reviewed on a cadence against the threat profile; retirement volume and reasons are reported; retired content is archived and recoverable with its history.

Level 5

Deprecation is automated against ATT&CK changes, telemetry decommissioning and threat profile shifts, with impact analysis run before removal and coverage recomputed after.

Evidence that substantiates a claim
  • Retirement criteria and decision log
  • Portfolio review records and retirement statistics
  • Automated deprecation impact analysis
NIST CSF 2.0

ID.IM-03, PR.PS-06

DE.8 Portfolio composition and detection strategy 12.0% of DE standard

Is the detection portfolio deliberately balanced across the pyramid of pain — or is it a pile of indicator matches with a few behavioural rules on top?

Level 0

No concept of portfolio. Content is whatever the tool shipped with.

Level 1

Predominantly signature and indicator matching; behavioural detection is incidental.

Level 2

A mix exists but is unplanned; nobody can state the balance or defend it.

Level 3

The portfolio is explicitly classified — atomic indicator, tool artefact, behavioural/TTP, anomaly, correlation, deception — with a documented target mix, and behavioural detection is prioritised for the top-tier threat profile.

Level 4

Composition is measured and reported against target; resilience to adversary evasion is assessed (would this survive a renamed binary, a new C2 domain, a different LOLBIN?); brittle detections are identified and reworked.

Level 5

Detection strategy is derived from attack-tree choke points and cost-to-adversary analysis; the portfolio is optimised to raise adversary cost, and this is demonstrated through emulation results rather than asserted.

Evidence that substantiates a claim
  • Portfolio classification with target and actual mix
  • Evasion-resilience assessment
  • Choke-point-driven detection strategy document
NIST CSF 2.0

DE.CM-09, ID.IM-02, PR.IR-01

DE.9 Detection content sourcing and provenance 8.0% of DE essential

Do you have a deliberate strategy for where detection ideas come from, and is the provenance of every deployed detection recorded?

Level 0

Detection content is whatever the platform shipped with. Nobody can say where a rule came from.

Level 1

Content is copied ad hoc from blog posts and vendor reports when someone happens to read one.

Level 2

Named sources are used routinely — vendor content subscriptions, community rule repositories — but adoption is uncritical and provenance is not recorded.

Level 3

A documented sourcing strategy spans annual threat reports (for example Red Canary, CrowdStrike, Mandiant, Verizon DBIR), vendor and government advisories, community rule repositories (SigmaHQ, Elastic, Splunk Security Content, YARA collections), intelligence platforms (MISP, OpenCTI) and in-house research; every deployed detection records its source, licence and adoption date.

Level 4

Content is evaluated before adoption against the organisation's own threat profile and telemetry — not enabled wholesale — and the value of each source is measured by the true positives and validated coverage it actually produced.

Level 5

Sourcing is automated and bidirectional: upstream repositories are tracked for updates and deprecations with impact analysis, sector campaign reporting triggers targeted content review within a defined window, and internally developed detections are contributed back.

Evidence that substantiates a claim
  • Documented sourcing strategy naming the report, repository and intel-platform sources in use
  • Provenance, licence and adoption date recorded per detection
  • Per-source value report (true positives, validated coverage contributed)
  • Upstream change tracking with impact analysis
NIST CSF 2.0

ID.RA-02, ID.RA-03, GV.SC-07, DE.CM-09

DE.10 Detection modality breadth 7.0% of DE standard

Does detection span the modalities the adversary can be caught in — event analytics, file and memory content, network, identity behaviour, integrity and deception — rather than relying on one?

Level 0

A single modality, almost always log or event analytics in a SIEM.

Level 1

A second modality exists incidentally because a product provides it, but nobody plans across them.

Level 2

Two or three modalities are in use and configured, but chosen by tooling rather than by what the prioritised behaviours require.

Level 3

Modalities are selected deliberately per behaviour — event and process analytics, file and memory content matching (for example YARA), network signature and protocol analysis, identity and entitlement behaviour, configuration and integrity drift, and deception — with the choice recorded and justified against the threat profile.

Level 4

Modality coverage is measured per prioritised scenario, and gaps are closed with the modality that fits rather than the tool already owned; where commercial endpoint tooling is absent, open-source equivalents are deliberately deployed to reach the same behaviours.

Level 5

Modalities are composed rather than parallel — a single scenario is detected across several modalities that corroborate each other, raising both confidence and the cost of evasion, and the composition is validated end to end.

Evidence that substantiates a claim
  • Modality map per prioritised scenario with justification
  • Deployed content in more than one modality (for example Sigma plus YARA plus network signatures)
  • Evidence of corroboration across modalities in a real or emulated case
NIST CSF 2.0

DE.CM-01, DE.CM-02, DE.CM-04, DE.CM-09, PR.DS-06

AV — Adversarial Validation & Emulation

AV.1 Atomic testing and control verification 13.0% of AV essential

Are individual techniques executed safely and repeatably to verify that telemetry, detection and alerting actually fire?

Level 0

No technique-level testing.

Level 1

Occasional manual tests by a curious engineer, undocumented.

Level 2

A test library (e.g. Atomic Red Team or in-house) is used sporadically against a lab; results are informal.

Level 3

Atomic tests are run on a defined cadence against a representative production-like environment, mapped to ATT&CK sub-techniques, with recorded outcomes at each stage — telemetry generated, event ingested, detection fired, alert raised.

Level 4

Test coverage of the in-scope technique set is measured; failures create tracked defects; re-test after fix is mandatory; results feed coverage scoring directly.

Level 5

Atomic testing is continuous and automated with safe-execution guardrails and change control, results stream into coverage dashboards in near real time, and untested techniques are automatically reported as unproven.

Evidence that substantiates a claim
  • Test library mapped to sub-technique IDs
  • Per-stage outcome records (telemetry/ingest/detect/alert)
  • Defect and re-test records
NIST CSF 2.0

ID.IM-02, DE.CM-09, PR.PS-06

AV.2 Breach and attack simulation automation 12.0% of AV standard

Is there automated, scheduled simulation providing continuous assurance across prevention and detection layers?

Level 0

No automated simulation capability.

Level 1

A trial or proof of concept was run once.

Level 2

A BAS tool is deployed against a limited scope, run manually and irregularly.

Level 3

Simulation runs on a defined schedule across representative segments, covering prevention, detection and alerting layers, with scenarios selected from the prioritised threat profile rather than the vendor default set.

Level 4

Results are trended, control drift (a previously passing test that now fails) is alerted on, and simulation scope covers all critical segments and cloud/identity planes as well as endpoint.

Level 5

Simulation is integrated into change management — infrastructure or control changes trigger targeted re-simulation — and results are an input to control investment decisions.

Evidence that substantiates a claim
  • Simulation schedule, scope and scenario provenance
  • Control drift alerts and trend
  • Change-triggered simulation records
NIST CSF 2.0

ID.IM-02, PR.PS-06, DE.CM-09

AV.3 Threat-actor emulation plans 15.0% of AV comprehensive

Do you emulate the full behaviour chains of the specific adversaries in your threat profile, in sequence, rather than isolated techniques?

Level 0

No emulation. Testing, where it exists, is technique-by-technique only.

Level 1

A single generic scenario borrowed from a public plan, run once.

Level 2

Public emulation plans are executed occasionally with limited tailoring to the environment.

Level 3

Emulation plans are authored for the top-ranked actors in the threat profile, sequencing techniques into realistic operations against realistic objectives, tailored to the organisation's platforms and crown jewels.

Level 4

Plans are refreshed as actor tradecraft evolves; coverage of the prioritised actor set by current emulation plans is measured; detection outcomes are recorded per step in the chain, showing where in the kill chain detection actually occurs.

Level 5

Emulation is derived automatically from the behaviour library and attack trees, includes evasion variants of previously detected behaviours to test resilience, and produces a measured "adversary dwell time before detection" per scenario.

Evidence that substantiates a claim
  • Emulation plan library referencing ATT&CK Group/Campaign IDs
  • Per-step detection outcome records showing earliest detection point
  • Evasion-variant test results
NIST CSF 2.0

ID.IM-02, ID.RA-03, DE.CM-09

AV.4 Purple team programme 13.0% of AV comprehensive

Is there a structured, recurring collaboration in which offensive execution and defensive engineering work the same exercise together and fix gaps live?

Level 0

No purple teaming. Offence and defence do not work together.

Level 1

Occasional informal collaboration after a red team engagement.

Level 2

Purple team exercises happen once or twice a year, ad hoc in scope, with a report at the end.

Level 3

A defined programme with a regular cadence, scenarios drawn from the threat profile, agreed rules of engagement, and detection engineers present during execution making fixes in the session.

Level 4

Every exercise produces measured outcomes per technique (prevented / detected-and-alerted / detected-not-alerted / logged-only / invisible), a tracked backlog, and a mandatory re-test that confirms closure.

Level 5

Purple teaming is continuous rather than episodic, integrated with the detection pipeline so improvements are shipped within the exercise window, and its findings measurably improve time-to-detect over successive cycles.

Evidence that substantiates a claim
  • Programme charter, cadence and rules of engagement
  • Per-technique outcome matrix and re-test confirmations
  • Time-to-detect improvement trend across cycles
NIST CSF 2.0

ID.IM-02, ID.IM-01, RS.MA-01

AV.5 Penetration testing integration 12.0% of AV standard

Are penetration test findings systematically converted into detection requirements — not only into vulnerability remediation tickets?

Level 0

Penetration testing is not performed, or reports never reach the detection team.

Level 1

Tests are run for compliance; the detection team occasionally hears about the results.

Level 2

Reports are shared with the SOC after the fact; a few detections may be built informally.

Level 3

Every engagement has a defined detection-feedback stage — the tester's activity timeline is reconciled against SOC telemetry and alerts to determine what was seen, and each unseen action becomes a detection requirement.

Level 4

The "detection rate" of each engagement is measured (percentage of tester actions that produced telemetry, a detection, and an alert), trended across engagements, and improvement is a stated objective of the testing programme.

Level 5

Testers deliver machine-readable activity timelines that are automatically diffed against SIEM data; detection gaps are auto-created; scoping of subsequent tests deliberately targets previously blind areas.

Evidence that substantiates a claim
  • Tester activity timeline reconciled against SOC telemetry
  • Engagement detection-rate metric and trend
  • Detection requirements traced to specific test actions
NIST CSF 2.0

ID.IM-02, ID.RA-01, PR.PS-06

AV.6 Red teaming and independent assurance 12.0% of AV comprehensive

Is the detection and response capability tested by objective-based, intelligence-led adversarial engagements under realistic constraints?

Level 0

No red teaming.

Level 1

A one-off engagement, scoped as an extended penetration test.

Level 2

Periodic red team engagements with limited objectives and heavy scope restrictions; the blue team is usually informed.

Level 3

Objective-based, intelligence-led engagements against crown-jewel objectives, with a genuinely uninformed blue team, control group, and formal rules of engagement and legal cover.

Level 4

Engagements follow a recognised framework where applicable (TIBER-EU, CBEST, CORIE, AASE, iCAST) or an equivalent internal standard; detection and response performance is measured against defined objectives; findings drive a tracked remediation plan with executive visibility.

Level 5

A continuous or high-frequency adversarial assurance capability exists; results are compared across cycles to demonstrate improving detection depth and reducing adversary freedom of movement; findings feed threat models and attack trees, not only detections.

Evidence that substantiates a claim
  • Intelligence-led engagement scope and rules of engagement
  • Objective-by-objective detection and response performance record
  • Cross-cycle comparison showing improvement
NIST CSF 2.0

ID.IM-02, GV.OV-02, RS.MA-01

AV.7 Findings-to-closure loop 13.0% of AV standard

Do validation findings reliably become closed detection or control changes, confirmed by re-test — and is the loop's speed measured?

Level 0

Findings are not tracked. Reports are the deliverable.

Level 1

Findings are noted in a document; closure is unverified.

Level 2

Findings enter a tracker; closure is claimed by the assignee without re-test.

Level 3

Every finding has an owner, a severity derived from threat-profile relevance and crown-jewel proximity, a target date, and a mandatory re-test before it can be closed.

Level 4

Closure rate, ageing and re-test pass rate are reported; overdue findings escalate; recurrence of previously closed findings is treated as a systemic defect and investigated.

Level 5

The loop is automated — validation results create work items, deployment triggers re-validation, and mean time from finding to validated closure is a headline KPI under active reduction.

Evidence that substantiates a claim
  • Findings register with re-test evidence per closure
  • Ageing, closure-rate and recurrence reports
  • Mean-time-to-validated-closure trend
NIST CSF 2.0

ID.IM-01, ID.IM-03, RS.MA-05

AV.8 Control efficacy scoring 10.0% of AV comprehensive

Are validation results expressed as a defensible efficacy score per technique across the prevent / detect / alert / respond chain, and used in reporting?

Level 0

No efficacy scoring. Controls are described as present or absent.

Level 1

Subjective assessment of "good" or "weak" coverage by opinion.

Level 2

Pass/fail per test, aggregated informally.

Level 3

A defined scale scores each in-scope technique separately for prevention, telemetry, detection, alerting and response, based on recorded validation evidence with a stated recency window.

Level 4

Efficacy scores expire — a result older than the defined window is downgraded to unproven; scores drive the Validated Coverage Score and appear in domain reporting; disagreements are arbitrated by evidence.

Level 5

Efficacy scoring is automated from validation pipelines, feeds risk quantification and investment cases, and is used to demonstrate risk reduction per pound or dollar spent.

Evidence that substantiates a claim
  • Efficacy scoring scale definition with recency rules
  • Per-technique efficacy matrix
  • Investment case referencing efficacy-derived risk reduction
NIST CSF 2.0

ID.IM-02, GV.RM-06, DE.CM-09

AA — Analytics, Automation & Hunting

AA.1 Triage enrichment and context automation 13.0% of AA essential

Does an alert arrive with the context an analyst needs, automatically, or does triage begin with twenty minutes of manual lookups?

Level 0

No enrichment. Analysts pivot manually across consoles.

Level 1

A few manual lookup shortcuts maintained by individual analysts.

Level 2

Basic automated enrichment for some alert types (reputation, geolocation, asset name).

Level 3

Enrichment is defined per detection type and covers asset criticality and owner, identity role and privilege, recent related activity, vulnerability and exposure state, threat intelligence context and prior case history.

Level 4

Enrichment coverage and its effect on triage time are measured; enrichment failures are monitored; the enrichment set is reviewed against what analysts actually use.

Level 5

Enrichment is adaptive — driven by detection metadata and case type, includes automated preliminary verdicts with confidence, and demonstrably reduces mean time to triage.

Evidence that substantiates a claim
  • Enrichment specification per detection class
  • Triage-time effect measurement
  • Enrichment failure monitoring
NIST CSF 2.0

DE.AE-02, DE.AE-07, RS.AN-03

AA.2 Correlation and attack-chain assembly 14.0% of AA standard

Are related alerts assembled into a single narrative of adversary progress, or triaged as isolated events?

Level 0

Alerts are handled individually with no relationship awareness.

Level 1

Analysts manually notice patterns from experience.

Level 2

Basic correlation by entity (host, user) within a time window.

Level 3

Correlation assembles alerts into incidents along entity and temporal relationships, annotated with ATT&CK tactic progression so an analyst can see how far along the chain the adversary is.

Level 4

Risk-based alerting aggregates weak signals into scored entities; the balance between raw alert volume and assembled incidents is measured; correlation quality (false grouping and missed grouping) is reviewed.

Level 5

Graph-based correlation spans identity, endpoint, cloud and network, reconstructs full attack paths against the estate's real topology, and predicts likely next steps from attack-tree data to prompt pre-emptive containment.

Evidence that substantiates a claim
  • Correlation logic documentation with tactic progression
  • Alert-to-incident aggregation ratio and quality review
  • Graph correlation output showing a reconstructed path
NIST CSF 2.0

DE.AE-02, DE.AE-03, DE.AE-04, DE.AE-06

AA.3 Response automation and orchestration 12.0% of AA standard

Is automation applied to response actions with appropriate safeguards, and is its coverage and value measured?

Level 0

All response is manual.

Level 1

A few scripts maintained by individuals; no governance.

Level 2

A SOAR platform exists with playbooks for a small number of high-volume alert types; mostly enrichment rather than action.

Level 3

Playbooks cover the highest-volume and highest-severity detection types, include automated containment for defined scenarios with explicit approval gates, and are version-controlled and tested.

Level 4

Automation coverage of alert volume is measured, along with time saved and error rate; playbook failures are monitored and remediated; blast-radius controls and rollback procedures exist and are tested.

Level 5

Automation decisions are risk-adaptive — confidence and asset criticality determine whether an action is automatic or approval-gated — and every detection ships with a linked response action by default.

Evidence that substantiates a claim
  • Version-controlled playbook repository with tests
  • Automation coverage and time-saved metrics
  • Rollback and blast-radius test records
NIST CSF 2.0

RS.MA-01, RS.MI-01, RS.MI-02, PR.IR-01

AA.4 Advanced analytics governance 11.0% of AA comprehensive

Where machine learning, UEBA or statistical analytics are used, are they governed, explainable and validated like any other detection?

Level 0

No advanced analytics, or vendor black boxes running unmonitored.

Level 1

Vendor ML features enabled with default settings and no evaluation.

Level 2

Some analytics tuned by trial and error; behaviour is not understood by the team operating it.

Level 3

Each analytic has a documented purpose, the behaviour it targets mapped to ATT&CK, its input features, training or baselining approach, expected output, and a named owner.

Level 4

Analytics are evaluated on precision, recall and drift with a defined re-baselining cadence; outputs are explainable enough for an analyst to justify an action; failure modes and adversarial manipulation risks are documented.

Level 5

Analytics are lifecycle-managed as models — versioned, monitored for drift and poisoning, validated by emulation like signature-based content, and retired when they stop earning their place.

Evidence that substantiates a claim
  • Analytic register with owners, features and ATT&CK mapping
  • Precision/recall/drift evaluation records
  • Model lifecycle and adversarial-risk documentation
NIST CSF 2.0

DE.AE-02, DE.AE-03, GV.SC-04, ID.RA-09

AA.5 Threat hunting programme 15.0% of AA standard

Is hunting hypothesis-driven, threat-informed and productive of new detection — or is it browsing?

Level 0

No hunting capability exists in any form.

Level 1

Occasional unstructured exploration when analysts have spare time.

Level 2

Scheduled hunts with loose scope; findings recorded inconsistently; little output beyond "nothing found".

Level 3

Hunts are hypothesis-driven, derived from the threat profile, threat models, attack trees and validation gaps; each has a documented hypothesis, data scope, method, result and a required output — a new detection, a tuning change, a visibility gap, or an evidenced negative result.

Level 4

Hunt outcomes are measured — coverage of hypotheses against prioritised techniques, conversion rate to deployed detections, findings per hunt — and negative results are retained so the same ground is not re-covered blindly.

Level 5

Hunting is continuous, partly automated (recurring hunts promoted to scheduled analytics), integrated with emulation so hunts are validated against known-good ground truth, and is a primary source of the detection backlog.

Evidence that substantiates a claim
  • Hunt library with hypotheses, methods and outcomes
  • Hunt-to-detection conversion metric
  • Promoted-hunt-to-analytic records
NIST CSF 2.0

DE.AE-02, DE.CM-09, ID.RA-01, ID.IM-02

AA.7 Deception and adversary engagement 13.0% of AA standard

Are deception assets — honeytokens, canary credentials, decoy hosts and services, tripwire data — deliberately placed at attack-tree choke points, so that touching them is a high-fidelity signal an adversary cannot avoid without abandoning the objective?

Level 0

No deception capability of any kind.

Level 1

An unofficial honeypot someone once stood up; nobody monitors it and nobody would notice it firing.

Level 2

A small set of deception assets deployed opportunistically — some canary files or a default honeypot — alerting exists but placement is unrelated to any threat model.

Level 3

Deception is placed deliberately at attack-tree choke points and along modelled paths to crown jewels — canary credentials where credential theft is expected, decoy shares where discovery is expected, honeytokens inside the data an adversary would steal; every asset has an owner, a high-severity alert, and a response playbook, because a deception alert is close to zero false positive.

Level 4

Deception coverage of modelled choke points is measured; assets are refreshed so they age like the estate around them; breadcrumbs lead credibly toward the decoys rather than leaving them to be stumbled upon; triggers are exercised in purple team scenarios and the alert path is proven end to end; alert noise is measured and kept negligible, and legitimate-touch incidents are investigated as placement defects.

Level 5

Deception is adaptive — placement is recomputed as attack trees and the estate change, interaction telemetry feeds intelligence and emulation, and measured adversary cost (time wasted, tradecraft revealed, early eviction) is reported as a programme outcome.

Evidence that substantiates a claim
  • Deception asset register mapped to attack-tree choke points
  • Choke-point coverage metric and refresh records
  • Purple-team validation of trigger-to-alert path
  • Measured alert noise rate, including periods with no trips
NIST CSF 2.0

DE.CM-01, DE.AE-02, ID.RA-01

AA.6 Case management and knowledge capture 11.0% of AA essential

Is the knowledge generated by every investigation captured in a form that improves the next one?

Level 0

Investigations are tracked in email, chat or spreadsheets.

Level 1

A ticketing system is used, with free-text notes of variable quality.

Level 2

A case management platform exists with basic categorisation; quality depends on the analyst.

Level 3

Cases carry a mandatory structure — ATT&CK classification, verdict, root cause, affected assets and identities, actions taken, and the detection(s) that fired or should have — enabling analysis across cases.

Level 4

Case data is analysed for patterns (which detections produce value, which alert types waste time, which techniques recur) and this analysis directly drives the detection backlog and tuning priorities.

Level 5

Case knowledge is a managed asset feeding a reusable investigation knowledge base, automated triage guidance, and analyst onboarding, with measured effect on time to competence and time to resolve.

Evidence that substantiates a claim
  • Mandatory case schema and completion metric
  • Cross-case analysis driving backlog items
  • Knowledge base usage and effect on resolution time
NIST CSF 2.0

RS.MA-02, RS.AN-03, RS.AN-08, ID.IM-04

AA.8 Agentic and AI-assisted operations 11.0% of AA standard

Where AI assistants or autonomous agents take part in detection, triage, hunting or response, are they governed, bounded, auditable and measured?

Level 0

No AI or agentic assistance, or unmanaged personal use of assistants with operational data.

Level 1

Individual analysts use general-purpose assistants informally; no policy, no record of what was pasted into them.

Level 2

An approved assistant is available for defined tasks such as summarisation or query drafting, with a data-handling policy, but its output is unmeasured.

Level 3

Agent roles are defined with an explicit task scope, the data they may see, the actions they may take, and the human approval points; agent-authored detection content enters the same lifecycle, testing and evidence requirements as human-authored content.

Level 4

Agent output quality is measured against human baselines (triage accuracy, false-verdict rate, detection quality), agent actions are fully audited and attributable, authority is bounded by asset criticality and confidence, and rollback is tested.

Level 5

Agents operate inside the closed loop with measured cycle-time benefit and no loss of assurance — their work is validated by emulation like any other detection, their identities and tool access are modelled as attack paths, and prompt-injection resistance is explicitly tested using untrusted content in the telemetry they read.

Evidence that substantiates a claim
  • Agent role definitions with task scope, data scope, authority and approval points
  • Audit trail attributing agent actions and decisions
  • Quality measurement against a human baseline
  • Prompt-injection test results using adversary-controlled log content
NIST CSF 2.0

GV.RR-02, GV.SC-04, ID.RA-09, DE.AE-02, RS.MA-01, PR.AA-05

IR — Incident Response & Recovery

IR.1 Response plan, playbooks and readiness 18.0% of IR essential

Are there current, tested response procedures covering the scenarios the threat profile says are most likely?

Level 0

No documented incident response plan.

Level 1

A generic plan exists, out of date, unfamiliar to the people who would use it.

Level 2

A maintained plan with defined roles and escalation, plus playbooks for a few common scenarios.

Level 3

Scenario playbooks are derived from the prioritised threat profile and attack trees — ransomware, business email compromise, cloud identity compromise, supply chain, insider, destructive attack, extortion without encryption — each with decision points, authority levels and communication requirements.

Level 4

Playbook coverage of prioritised scenarios is measured; playbooks are updated after every real incident and every exercise; out-of-hours and degraded-infrastructure operation is explicitly addressed and tested.

Level 5

Playbooks are living, partly executable (linked to orchestration), version-controlled, and validated in the same cycle as detection content, with measured readiness per scenario.

Evidence that substantiates a claim
  • Scenario playbook set traced to threat profile
  • Post-incident and post-exercise update records
  • Out-of-band operating procedure test
NIST CSF 2.0

RS.MA-01, ID.IM-04, PR.IR-03, RC.RP-01

IR.2 Detection-to-response handoff and SLAs 17.0% of IR essential

Is the path from alert to responder defined, measured and reliable at all hours?

Level 0

No defined handoff. Alerts are picked up when noticed.

Level 1

Informal handoff by chat message; coverage depends on who is awake.

Level 2

Defined triage tiers and escalation paths; response times are not measured.

Level 3

Severity-based SLAs exist for acknowledgement, triage and escalation, with defined coverage hours, on-call rotation and escalation-of-last-resort.

Level 4

SLA attainment is measured per severity and reported; breaches are analysed for cause; queue ageing and abandonment are monitored; detection severity is calibrated against actual incident outcomes.

Level 5

Handoff is automated with dynamic routing by detection type and asset criticality; time to acknowledge and time to contain are trended and actively reduced; capacity is modelled against alert volume forecasts.

Evidence that substantiates a claim
  • Severity/SLA matrix with coverage model
  • SLA attainment and queue ageing reports
  • Severity calibration analysis
NIST CSF 2.0

DE.AE-08, RS.MA-01, RS.MA-02, RS.MA-03

IR.3 Forensic readiness and evidence handling 15.0% of IR standard

Can you acquire and defensibly preserve the evidence needed to answer what happened — including in cloud and SaaS?

Level 0

No forensic capability. Evidence is destroyed by remediation.

Level 1

Ad hoc collection using whatever tools are to hand; no chain of custody.

Level 2

Documented collection procedures for endpoints; retention adequate for common cases; cloud and SaaS evidence is uncertain.

Level 3

Forensic readiness is planned — retention aligned to realistic dwell times, remote acquisition capability, memory capture, cloud and SaaS evidence sources identified and pre-authorised, chain of custody maintained, and legal/HR/regulatory requirements built in.

Level 4

Readiness is tested (can you actually acquire from that cloud workload, that SaaS tenant, that OT segment, on a Sunday?); acquisition times are measured; gaps in evidential coverage are registered and closed.

Level 5

Evidence acquisition is automated on incident declaration, forensic data is preserved before containment destroys it, and readiness is validated in every major exercise and red team engagement.

Evidence that substantiates a claim
  • Forensic readiness plan covering cloud and SaaS
  • Acquisition test results and timings
  • Automated preservation-on-declaration configuration
NIST CSF 2.0

RS.AN-03, RS.AN-06, RS.AN-07, PR.DS-01

IR.4 Containment, eradication and recovery 17.0% of IR standard

Can you contain and recover at the speed and scale a real intrusion demands, and have you proven it?

Level 0

No defined containment capability; response is improvised.

Level 1

Manual containment by individual administrators, slow and inconsistent.

Level 2

Containment options exist for endpoints (isolate, block hash) with defined authority; identity and cloud containment are manual and slow.

Level 3

Containment is defined across all planes — endpoint isolation, identity disablement and session/token revocation, network segmentation, cloud role and key revocation, email clawback, third-party access suspension — with authority, prerequisites and business impact documented for each.

Level 4

Containment and recovery times are measured in exercises and real incidents; mass-scale actions are tested; recovery capability is validated against destructive scenarios including backup integrity and immutability testing.

Level 5

Containment is largely automated with risk-adaptive gating, tested at scale on a defined cadence, and recovery objectives are demonstrated rather than asserted, including for identity infrastructure and cloud control planes.

Evidence that substantiates a claim
  • Containment action catalogue by plane with authority levels
  • Timed containment and recovery exercise results
  • Backup immutability and restoration test evidence
NIST CSF 2.0

RS.MI-01, RS.MI-02, RC.RP-01, RC.RP-05, PR.DS-11

IR.5 Exercising and crisis management 16.0% of IR standard

Are response and crisis capabilities exercised realistically, including at executive level, with findings tracked?

Level 0

No exercises of any kind are conducted.

Level 1

An occasional informal walkthrough of the plan.

Level 2

Annual tabletop exercise, generic scenario, limited participation.

Level 3

A programme of exercises at varying intensity — tabletop, functional, technical simulation, and executive crisis — using scenarios drawn from the threat profile and involving legal, communications, business owners and relevant third parties.

Level 4

Every exercise generates tracked findings with owners and dates; exercise realism increases over time; participation and performance are measured; regulatory notification and disclosure decision-making is exercised under time pressure.

Level 5

Exercises are unannounced where appropriate, integrated with red team engagements so the exercise is a real detection event, and improvement across cycles is demonstrated with objective measures.

Evidence that substantiates a claim
  • Multi-year exercise programme and scenario provenance
  • Findings register with closure
  • Evidence of exercises integrated with red team activity
NIST CSF 2.0

ID.IM-02, PR.AT-01, RS.CO-02, RC.CO-03

IR.6 Post-incident review to detection backlog 17.0% of IR essential

Does every incident measurably improve detection — and is the "why did we not see this sooner?" question answered structurally every time?

Level 0

No post-incident review.

Level 1

Informal debriefs after major incidents only; nothing recorded.

Level 2

Reviews are held and documented for significant incidents; actions are recorded but rarely closed.

Level 3

Every incident above a defined threshold gets a blameless review that explicitly reconstructs the timeline, identifies the earliest point at which detection was possible, and produces detection, telemetry and control actions with owners.

Level 4

Action closure is tracked and reported; the gap between adversary first action and first detection is measured per incident and trended; recurring root causes are escalated as systemic issues.

Level 5

Reviews feed threat models, attack trees, emulation plans and the detection backlog automatically; "would we detect this now?" is answered by re-emulating the incident and proving it, with the result recorded against the review.

Evidence that substantiates a claim
  • Blameless review records with earliest-detection-point analysis
  • Action closure and time-to-first-detection trends
  • Re-emulation proof that the incident is now detected
NIST CSF 2.0

ID.IM-01, ID.IM-04, RC.RP-06, RS.AN-08

GV — Governance, Metrics & Continuous Improvement

GV.1 Strategy, mandate and funding 15.0% of GV essential

Does the detection capability have an articulated strategy, an explicit mandate and funding tied to the risks it is meant to reduce?

Level 0

No strategy. The capability exists as a by-product of tool purchases.

Level 1

Direction is set informally by whoever leads the function; funding is reactive.

Level 2

A written plan exists, largely a list of tools and headcount for the year.

Level 3

A multi-year strategy states target maturity per domain, is explicitly derived from the threat profile and business risk appetite, and has executive sponsorship and committed funding.

Level 4

Strategy progress is reviewed against measured maturity at least twice a year; investment decisions cite validation evidence and coverage gaps; trade-offs are documented.

Level 5

Strategy is dynamically adjusted from threat landscape change and measured risk reduction, with funding decisions demonstrably driven by validated efficacy data rather than vendor cycles.

Evidence that substantiates a claim
  • Signed multi-year strategy with target maturity per domain
  • Investment cases citing coverage and validation data
  • Review minutes showing strategy adjustment
NIST CSF 2.0

GV.OC-01, GV.RM-01, GV.RM-03, GV.RR-03

GV.2 Roles, skills and capability development 15.0% of GV standard

Are the roles the model requires actually defined and staffed, with a deliberate path to build the skills the work needs?

Level 0

No defined roles; whoever is available does the work.

Level 1

Roles exist in name; responsibilities overlap and gaps are covered informally.

Level 2

Job descriptions exist for core SOC roles; detection engineering, threat modeling and emulation are collateral duties.

Level 3

Distinct roles are defined and staffed for intelligence, detection engineering, hunting, emulation/purple team and response, with documented responsibilities and a competency framework.

Level 4

Skills are assessed against the framework, gaps drive a training plan with budget, and key-person dependency is measured and reduced; succession and cross-training are deliberate.

Level 5

Capability development is continuous — internal ranges, rotation between offensive and defensive roles, published research — and retention and competency are measured as leading indicators of capability.

Evidence that substantiates a claim
  • Role definitions and competency framework
  • Skills assessment and funded training plan
  • Key-person dependency analysis
NIST CSF 2.0

GV.RR-02, GV.RR-04, PR.AT-01, PR.AT-02

GV.3 Metrics and performance measurement 18.0% of GV essential

Are the metrics used to run and report the capability meaningful measures of detection effectiveness, or activity counts?

Level 0

No metrics beyond what tools display by default.

Level 1

Activity counts reported — alerts handled, tickets closed, threats blocked.

Level 2

Operational metrics exist (volumes, MTTD, MTTR) with inconsistent definitions and no target.

Level 3

A defined metric set covers effectiveness (Validated Coverage Score, detection precision, time from adversary action to detection), efficiency (triage time, automation rate), and programme health (backlog ageing, gap closure), each with a written definition, owner and target.

Level 4

Metrics are trended, reviewed in a formal forum, and acted on; the metric set is periodically challenged for gaming and perverse incentives; definitions are stable enough for period-on-period comparison.

Level 5

Metrics link measured detection capability to business risk reduction and are used in prioritisation and investment; anti-gaming controls are explicit and metrics are independently verifiable from raw evidence.

Evidence that substantiates a claim
  • Metric catalogue with definitions, owners and targets
  • Trended reporting pack and review minutes
  • Anti-gaming review record
NIST CSF 2.0

GV.OV-01, GV.OV-02, GV.OV-03, ID.IM-03

GV.4 Risk and compliance alignment 14.0% of GV standard

Is detection capability expressed in the organisation's risk language and mapped to the obligations it must satisfy — without letting compliance drive the design?

Level 0

No connection between detection capability and risk management or compliance.

Level 1

Compliance obligations are met by assertion; detection is not represented in the risk register.

Level 2

Detection appears in the risk register as a generic control; regulatory obligations are tracked separately.

Level 3

Detection capability gaps appear as named risks with owners and treatment plans; obligations (NIS2, DORA, sector regulation, contractual) are mapped to specific model sub-capabilities; crosswalks to NIST CSF 2.0 and ISO 27001 are maintained.

Level 4

Risk assessments cite measured coverage and validation evidence rather than control existence; residual risk per crown jewel is expressed with reference to the attack trees and validated efficacy scores.

Level 5

Detection risk is quantified and integrated with enterprise risk quantification; compliance evidence is a by-product of the operating model rather than a separate exercise.

Evidence that substantiates a claim
  • Risk register entries citing coverage and validation data
  • Obligation-to-sub-capability mapping
  • Automatically generated compliance evidence
NIST CSF 2.0

GV.RM-02, GV.RM-04, GV.OC-03, ID.RA-05, ID.RA-06

GV.5 Executive and board reporting 13.0% of GV standard

Do decision-makers receive an honest, comparable picture of what the organisation can and cannot detect?

Level 0

No reporting above the security team.

Level 1

Occasional narrative updates, usually after an incident.

Level 2

Regular reporting of activity volumes and tool status.

Level 3

Reporting states maturity by domain, validated coverage against the prioritised threat profile, known blind spots, and the risks accepted as a result — in business language, with the assumptions stated.

Level 4

Reporting is comparable period on period, includes trend and forecast, distinguishes clearly between what has been tested and what is assumed, and explicitly reports capability that has degraded.

Level 5

Reporting supports investment decisions with modelled risk reduction per option, is independently assured, and includes benchmarking against sector peers where credible data exists.

Evidence that substantiates a claim
  • Executive reporting pack showing tested versus assumed capability
  • Period-on-period comparability statement
  • Independent assurance or benchmarking record
NIST CSF 2.0

GV.OV-01, GV.OV-02, GV.RR-01, RS.CO-03

GV.6 Continuous improvement cadence 13.0% of GV standard

Is improvement a managed, funded, scheduled activity with measured outcomes?

Level 0

Improvement happens only after a serious incident.

Level 1

Individuals improve things when time allows.

Level 2

An improvement backlog exists but competes unsuccessfully with operational work.

Level 3

A defined cadence exists — regular retrospectives, a prioritised improvement backlog with protected capacity, and reassessment against this model at least annually.

Level 4

Improvement outcomes are measured against the maturity baseline; reassessment is partly independent to counter self-assessment optimism; regression is investigated as seriously as stagnation.

Level 5

Improvement is continuous and data-driven, with capacity formally allocated, cycle times measured, and demonstrable maturity progression across multiple assessment cycles.

Evidence that substantiates a claim
  • Improvement backlog with protected capacity allocation
  • Successive TID-CMM assessment results showing progression
  • Independent or peer-reviewed reassessment record
NIST CSF 2.0

ID.IM-01, ID.IM-03, GV.OV-03

GV.7 Third-party and supply-chain detection 12.0% of GV comprehensive

Does detection extend to the third parties, managed services and software supply chain through which adversaries reach you?

Level 0

Third-party activity is outside the detection scope entirely.

Level 1

Third-party access exists but is not distinguished in telemetry.

Level 2

Third-party accounts are identifiable in logs; managed security providers report to defined SLAs that are not verified.

Level 3

Third-party and vendor access paths are modelled as attack paths, monitored with specific detections, and outsourced detection responsibilities are explicitly divided in a documented responsibility matrix.

Level 4

Provider performance is verified independently — including by emulation against provider-monitored scope — rather than accepted from their reporting; software supply chain and CI/CD telemetry is covered; fourth-party dependency risk is considered.

Level 5

Supply-chain compromise scenarios are emulated end to end, detection responsibilities are contractually specified with testable service levels, and provider detection efficacy is measured as part of the coverage score.

Evidence that substantiates a claim
  • Responsibility matrix for outsourced detection
  • Emulation results against provider-monitored scope
  • Supply-chain scenario emulation records
NIST CSF 2.0

GV.SC-04, GV.SC-07, GV.SC-10, ID.AM-04, DE.CM-06