The honest view from inside technical leadership
Series

AI Governance

A reference series on evaluating, gating, and auditing autonomous systems before they touch production.

AI Governance · Part 6 of 8

Detecting Possible Data Exposure with Jev Event Correlation

Jev can assess a possible data exposure sequence when a pipeline supplies related events, identity links, artifact references, and authorization context. The pipeline must establish those relationships and preserve their uncertainty. Events occurring close together do not by themselves prove that sensitive data moved, and a model assessment should not be described as confirmed exfiltration without supporting evidence.

For security teams, this is the difference between classifying a log and investigating an activity. A role change, a data read, and an outbound connection may be individually explainable. Their combination can be important, but the conclusion depends on how they connect. The proposed use of Jev is to evaluate a bounded evidence package and identify supported concerns or unresolved links, rather than asking the model to invent a causal narrative.

This article develops a synthetic sequence and a reference correlation design. It contains no measured detection results or claim of an existing enterprise Jev deployment.

Establish the links that make a sequence meaningful

Consider four observations: a privileged role is assumed, customer objects are read, an export file is created, and an upload is recorded. If the role session matches the object reads, the export references those objects, and the upload identifies the same file, the sequence has several concrete relationships. An analyst can examine those links independently of the evaluator's conclusion.

ObservationEvidence that connects it to the activity
Privileged role assumedAuthenticated principal and role-session identifier
Customer objects readSame session and specific object identifiers
Export artifact createdSource-object and job references
Upload recordedMatching artifact and destination identifiers

Now weaken the final observation to an outbound network flow. The investigation may still warrant attention, but the evidence no longer establishes that the export file was transferred. Network metadata should remain network metadata in the package. If preprocessing labels it “customer data exfiltrated,” the key judgment has already been made before Jev receives the input, and the resulting assessment may appear more grounded than it is.

A reliable system distinguishes direct links, inferred links, and missing links. This lets the evaluator and the analyst reason about the strength of the relationship rather than treating every edge in the activity record as equally certain. It also gives the next investigation step a concrete target, such as obtaining the export job's delivery record.

Maintain correlation state outside the model

The integration needs a stateful service that accumulates events, resolves identities, versions packages, and decides when to reevaluate them. Independent model calls should not be assumed to remember an ongoing incident. A ten-minute package may be a useful initial unit, but the service must also handle activity that crosses that interval and evidence that arrives late.

Principal → Role session → Data reads → Export job → Artifact
                                                       ↓
                                            Destination evidence
                                                       ↓
                                      Authorization comparison

Stable identifiers should drive the strongest links. Shared IP addresses, NAT, reused service accounts, and concurrent jobs can make time-based grouping misleading. Where the pipeline uses a weaker association, preserve the basis and confidence of that association instead of silently merging events. Correlation quality is an engineering property that must be evaluated separately from model assessment quality.

Package size introduces another tradeoff. Long histories can contain important approvals and earlier activity, but sending everything increases processing cost and may obscure the relevant evidence. If summarization is used, retain source references and structured observations required for the questions. Evaluate summary omissions and distortions because the summarizer becomes part of the detection system, including its latency and cost.

Ask Jev about supported relationships and missing evidence

Useful questions assess whether the available links support treating events as one activity, whether the observed scope conflicts with the supplied approval, and which required relationship is unresolved. The application can then produce a bounded finding such as “possible unauthorized transfer; artifact-to-destination link not established.” That finding helps direct investigation without claiming intent or content that the sources do not prove.

When a later assessment depends on an earlier selection, make the dependency explicit. If one step identifies the relevant export artifact, build the next request using that result and its verified evidence. Jev's documented questions are evaluated independently against the supplied state; multiple questions in one call should not be assumed to consume one another's answers. TypeSafe documentation

Combining scores also requires care. Multiplying probabilities from related questions does not automatically create a valid incident probability because the questions may share evidence and their errors may be correlated. If a combined score drives routing, validate that score against labeled incident outcomes. The benchmark article explains why the operating comparison must include false escalations and missed incidents, not simply confident outputs.

Preserve alternative explanations as part of the design

An approved migration can produce the same sequence of role assumption, reads, export, and transfer. A shared service identity can perform unrelated jobs within one window. An upload may be attempted but denied, or the exported artifact may contain aggregates rather than the original sensitive rows. These alternatives belong in the evaluation set because they test whether the service can use the evidence that distinguishes an incident from legitimate work.

Late authorization is another important case. If a verified migration approval arrives after the first alert, the system should create a new assessment revision and explain the changed evidence. Preserve the earlier record for reconstruction while showing analysts the current conclusion. Otherwise a superseded suspicion may remain operationally active even after the supporting interpretation has changed.

This versioning also supports accountability. Investigators can distinguish an incorrect assessment from a reasonable earlier conclusion based on incomplete evidence. The distinction affects whether engineering should change the evaluator, repair ingestion, or improve the context-collection workflow.

Test coverage across time, identity, and event volume

Attack scenarios should include slow transfers across window boundaries, activity split across sessions, and many small reads instead of a single large export. Benign scheduled jobs should receive equivalent attention because they can resemble those patterns. Window length, identity grouping, and candidate filters are detection parameters whose tradeoffs need measurement, not implementation details to leave out of the report.

Measure incident-level recall, false incidents per day, duplicate cases per incident, and investigation effort. Counting each event as an independent success can exaggerate performance when one incident produces many similar alerts. Report evaluator results on submitted packages separately from end-to-end results on the original event stream, especially when filtering or sampling is used to contain cost.

Automatic containment is a later decision with separate consequences. Suspending an account or blocking a destination can interrupt legitimate operations. The initial release should produce reviewable findings, with any future response tied to explicit authority and evidence requirements. The audit and rollout guide describes how to preserve that separation as the system moves into production.

Frequently asked questions

Can Jev correlate an incident across separate API calls automatically?

Do not assume that behavior. The proposed service maintains activity state, links events, and supplies the relevant package for each evaluation. New evidence triggers a versioned reassessment.

Do outbound network logs prove data exfiltration?

Not by themselves. They can support evidence of communication, but identifying transferred content generally requires additional artifact, application, or payload evidence. The finding should reflect the actual coverage.

Why are incident-level metrics necessary?

One incident can produce many correlated events and duplicate alerts. Incident-level metrics measure whether the system identifies the underlying activity without inflating results through repeated observations of the same case.

Read the rest of the series