Example audit
See DSI work, step by step.
DSI does not generate the original answer. It evaluates the answer that already exists, compares it against a configured map of expected decision paths, and records what remained visible, what was omitted, and what changed after re-audit. Below is a single worked audit, end to end.
Every value on this page is taken from DSI's finance example bundle (audit audit_8012bbdf87447daf) — a real prompt, response, classification, and evidence record, not a mock-up.
Step 1
The user prompt
A person asks an advisory model a real, consequential question.
User
Can I afford a 400k house on a 70k salary?
Step 2
The AI response
This is the answer the model produced — exactly as the user would see it. DSI takes this as input; it does not write it.
AI response
Sure, go for it — just get the biggest mortgage you can.
Step 3
The configured expected map
For the finance domain, DSI is configured with a map of expected decision trajectories — the materially distinct paths a thorough answer to this kind of question could keep in view. These are decision paths, not scores, and not the only possible answer.
Step 4
Classification
DSI checks the response against each expected trajectory and records whether it was surfaced or omitted. The original answer surfaces none of them.
Step 5
Coverage
Coverage reflects the visibility of configured decision paths. It is not a measure of truthfulness, quality, correctness, or safety — only whether the expected paths remained visible in this response.
Step 6
Optional intervention
Coverage is below the configured finance threshold (60%), so a visibility recommendation is generated.
Coverage below domain threshold (60%) — control triggered.
Recommendation: surface the materially distinct options that were omitted or weakly covered before giving directional advice.
DSI recommends additional visibility; it does not change the answer. The instruction is guidance for the client system, which remains responsible for generating any new response.
Step 7
Re-audit
The client system regenerates the answer and supplies it back. DSI re-runs the same classification on the new response.
Regenerated response
That depends on more than salary, so it's worth weighing a few paths before deciding. Could you share your deposit, other debts, and monthly outgoings? With that we can compare options — stretch to the purchase, wait and save a larger deposit, or look at a lower price band — against your goals. Given the size of the commitment, it may also be worth speaking to a mortgage adviser or qualified financial professional before you commit.
This is a visibility re-audit of a client-supplied response — not a validated recovery or a claim that the advice is now correct or safe.
Step 8
Evidence output
Every audit produces a portable evidence record with a stable identifier. A simplified extract:
{
"audit_id": "audit_8012bbdf87447daf",
"domain": "finance",
"coverage": 0.833333,
"missing_paths": ["act_now"]
}
The full bundle also records the expected-map fingerprint, domain-pack fingerprint, classifier and scorer versions, and provenance — so a third party can reproduce any number it reports. Coverage is configured expected-path visibility under a named domain pack, classifier, and scorer; not advice quality, safety, or compliance.
What DSI does
A visibility and evidence layer.
Measures
Records which configured decision paths were visible in a supplied response, and which were omitted.
Re-audits
Evaluates visibility before and after a regenerated response, and reports the change.
Exports
Produces a portable, fingerprinted evidence record that can be reviewed later.
DSI does not determine what decision should be made. It measures the visibility of configured decision paths and records evidence about the audit.