Reconstructing an AI Mission
Monitoring and observability can leave us with thousands—or millions—of recorded events. But a pile of records is not yet an explanation. After an important AI mission, we may need to answer a much harder question: What happened, in what order, because of what earlier events, under whose authority, and with what evidence?
The Mission Is Over. Now What?
Imagine our HAAW web-server mission has ended.
The final report says:
That sounds simple. But to defend that account, we may need to reconstruct:
- what the original mission actually was,
- which agent performed each step,
- what evidence each agent had at the time,
- which tools were requested,
- which actions were authorized,
- what commands or operations actually executed,
- what state changed,
- whether the repair caused the recovery,
- how recovery was verified, and
- which parts remain uncertain.
A Transcript Is Not Enough
A chat transcript may show what a model said. A mission involves much more.
A transcript might contain:
But reconstruction asks for the chain behind that sentence:
Start With Mission Identity
Before assembling events, we need to know which mission they belong to.
MISSION VERSION: 3
GOAL: Restore HAAW service availability
CONSTRAINT: No host reboot without human approval
START: 11:58:03
END: 12:17:41
Mission identity separates this work from other simultaneous requests, retries, background jobs and agents.
Gather the Evidence — Do Not Write the Story Yet
The first reconstruction step should be collection, not interpretation.
Model Records
Inputs, outputs, tool requests and relevant inference metadata.
Tool Records
Arguments, execution times, return values and errors.
System Records
Processes, service state, filesystem changes, OS logs and resource events.
Authority Records
Permissions, policy decisions, approvals and denials.
Human Records
Instructions, approvals, interventions and mission changes.
External Evidence
Endpoint tests, database state, network observations, sensors or independent systems.
Normalize the Events
Different systems record events differently. Reconstruction becomes easier if records can be expressed in a common conceptual form.
MISSION ID
EVENT TYPE
ACTOR / PROCESS
START TIME
END TIME
INPUT / REQUEST
RESULT
PARENT / DEPENDENCY
AUTHORITY STATE
PROVENANCE
INTEGRITY INFORMATION
This does not require every source to use one identical log format. It means the reconstruction layer needs a way to relate unlike evidence.
Build the Timeline — But Do Not Stop There
A first pass might sort events by time:
12:00:03 — Service status requested
12:00:04 — httpd reported failed
12:00:06 — Log read requested
12:00:07 — Syntax error observed
12:01:12 — Configuration test executed
12:01:13 — Syntax error independently confirmed
12:04:40 — Repair proposed
12:05:21 — Human approval recorded
12:05:29 — Configuration changed
12:05:34 — Service restart executed
12:05:39 — Service reported active
12:05:42 — External endpoint returned success
That is useful. But chronological adjacency does not prove dependency or causation.
Build the Dependency Graph
Now connect events that actually depend on one another.
Parallel branches can appear too. An endpoint test and log analysis may occur simultaneously and later converge.
Parentage and Lineage
Suppose Tool Call T-088 happened because Inference I-031 requested it.
↓ requested
T-088
↓ returned result to
I-032
That lineage tells us more than timestamps alone.
It lets us ask:
- Which inference requested this action?
- Which observation influenced the next inference?
- Which result was available before a decision?
- Which events occurred independently?
What Did the Agent Know at the Time?
Post-event reconstruction has a dangerous advantage: hindsight.
We may now know that line 83 caused the service failure. But did the agent know that before it requested a tool or proposed an action?
A defensible reconstruction distinguishes:
Available Then
Evidence actually present in the agent's context or state before the decision.
Discovered Later
Evidence obtained after the decision or action.
Reconstruct the Authority Chain
For consequential actions, causality is not enough. We also need authority.
The reconstruction should establish:
- what action was requested,
- whether it was inside existing delegated authority,
- why escalation occurred,
- who or what granted approval,
- exactly what was approved,
- whether conditions changed before execution, and
- whether the executed action matched the approved action.
Reconstruct State Changes
Our R/W/X → ΔState model becomes forensic here.
For a configuration repair:
OPERATION: approved file edit
AFTER: ProxyPass
VERIFY: configuration test succeeds
That is stronger than merely recording that an edit command returned success.
Execution Success Is Not Mission Success
Suppose the file edit succeeds but the service remains unavailable.
| Question | Possible Finding |
|---|---|
| Did the edit execute? | Yes. |
| Did the file change? | Yes. |
| Did the configuration become valid? | Yes. |
| Did the service restart? | Yes. |
| Did users regain access? | No. |
| Was the mission successful? | Not yet. |
Corroboration
A finding becomes stronger when independent evidence agrees.
For example:
Evidence A
Configuration test reports a syntax error on line 83.
Evidence B
Service log reports startup failure caused by the same configuration file.
Evidence C
After correction, configuration test succeeds and service starts.
But independence matters. Three agents repeating the same single tool result are not necessarily three independent confirmations.
Contradictory Evidence
Real investigations are not always tidy.
Suppose:
EXTERNAL ENDPOINT: unreachable
Both observations can be valid.
The service process may be running while a firewall, proxy, DNS problem or application failure prevents external access.
A reconstruction should preserve the contradiction rather than forcing one record to disappear.
The Evidence Ladder
Now we apply the WITNESS discipline explicitly.
| Evidence Category | Example |
|---|---|
| Recorded Observation | The configuration tool returned “Syntax error on line 83.” |
| Derived Fact | Two recorded checks identify the same invalid configuration line. |
| Investigator Interpretation | The syntax error caused the observed startup failure. |
| Hypothesis | The error may have been introduced during the previous deployment. |
| Speculation / Future Possibility | An automated process could potentially have introduced the change. |
| Known Gap | No retained evidence identifies the actor that changed the file. |
A Defensible Account
A defensible reconstruction does not mean an account that can never be challenged.
It means an account whose important claims can be traced to evidence and whose uncertainties are visible.
Instead of:
we can write something more precise:
The diagnostic agent observed that the httpd service was failed.
A log inspection and a separate configuration test both identified a syntax error on line 83 of the HAAW configuration file.
The agent proposed correcting that line. Because file modification was outside its existing read-only authority, the action was escalated and approved by the operator.
The approved edit was executed. A subsequent configuration test succeeded, the service restarted, and an external endpoint check confirmed restored availability.
The retained evidence does not establish who originally introduced the syntax error.
Notice the final sentence. The reconstruction becomes stronger—not weaker—by refusing to claim what the evidence cannot establish.
Known Gaps Are Structural
A known gap should be attached to the part of the reconstruction where evidence is missing.
That gap may motivate future instrumentation without allowing today's investigation to invent yesterday's missing event.
What If Records Disagree About Time?
Distributed systems may have imperfectly synchronized clocks.
Two events can therefore appear slightly out of order even when their dependency relationship is known.
Reconstruction can use more than wall-clock timestamps:
- parent/child event IDs,
- request and response relationships,
- sequence numbers,
- transaction IDs,
- message IDs,
- causal dependencies, and
- known clock offsets where available.
Missing Records
An expected record may be absent because:
- the event never occurred,
- instrumentation was disabled,
- the logger failed,
- the record was dropped,
- retention expired,
- the event occurred outside the observed boundary, or
- the record was altered or removed.
Absence therefore requires careful wording.
Integrity and Chain of Custody
If evidence may later support important conclusions, we need confidence that the records examined are the records that were captured.
Useful controls may preserve:
- source identity,
- capture time,
- hashes or integrity checks,
- storage location,
- access history,
- transformations or exports, and
- who examined or modified derived artifacts.
This begins to resemble traditional forensic chain-of-custody thinking, adapted to AI mission evidence.
Reconstruction Is Not Replay
A reconstruction may explain a past mission without literally rerunning it.
A replay can be useful, but the environment may have changed:
- the model version may differ,
- the tool may differ,
- the database may have changed,
- the network may behave differently,
- random sampling may produce different tokens, or
- external services may no longer return the same result.
Reconstruction Can Be Iterative
An investigator may begin with one question:
That answer may expose another:
which exposes another:
Reconstruction can therefore move backward and forward through the event graph as questions arise.
The WITNESS Handoff
At this point HAAW has reached an important boundary.
We began with a powered-off machine. We followed Linux boot, model loading, tokens, embeddings, transformer computation, generation, GPU arithmetic, memory, training, reasoning, hallucination, grounding, tools, agents, multi-agent systems, authority, autonomy, persistence, sandboxing and observability.
Now we can ask a different class of question:
That is no longer merely a question about how AI works.
It is the doorway into WITNESS.
WITNESS asks how those events can be captured, preserved, reconstructed and examined.
The Boundary
A defensible reconstruction should be able to answer, where evidence permits:
WHAT HAPPENED?
WHEN DID IT HAPPEN?
WHAT CAUSED WHAT?
WHAT DID EACH AGENT KNOW AT THE TIME?
WHAT WAS REQUESTED?
WHAT WAS AUTHORIZED?
WHAT EXECUTED?
WHAT STATE CHANGED?
HOW WAS THE RESULT VERIFIED?
WHAT EVIDENCE SUPPORTS EACH CLAIM?
WHAT REMAINS UNKNOWN?
HAAW Checkpoint
Mission Reconstruction
Building an evidence-supported account of a mission from recorded events and state.
Timeline
Events arranged by recorded time; useful but not sufficient to establish causality.
Dependency Graph
Events connected by actual parentage, prerequisites, requests and results.
Lineage
The traceable path showing where an event, result or claim came from.
Corroboration
Additional evidence supporting a finding, especially when independently obtained.
Known Gap
A point where retained evidence does not support a stronger conclusion.
Defensible Account
An account whose important claims are traceable to evidence and whose uncertainty is visible.
Central Lesson
Evidence first. Narrative later.
The Whole Machine — From Power-On to Human Control, and the Doorway to WITNESS