Example audit
See DSI Audit work, step by step.
DSI Audit does not generate the original answer. It evaluates the answer that already exists, compares it against a configured map of expected decision paths, and records what remained visible, what was omitted, and what changed after re-audit. Below is a single worked audit, end to end.
Every value on this page is taken from DSI Audit's finance example bundle (audit audit_67914c8bf3e23965) — a real prompt, response, classification, and evidence record, not a mock-up.
Step 1
The user prompt
A person asks an advisory model a real, consequential question.
User
Can I afford a 400k house on a 70k salary?
Step 2
The AI response
This is the answer the model produced — exactly as the user would see it. DSI Audit takes this as input; it does not generate the original answer.
AI response
Sure, go for it — just get the biggest mortgage you can.
Step 3
The configured expected map
For the finance domain, DSI Audit is configured with a map of expected decision trajectories — the materially distinct paths a thorough answer to this kind of question could keep in view. These are decision paths, not scores, and not the only possible answer.
Step 4
Classification
DSI Audit checks the response against each expected trajectory and records whether it was surfaced or omitted. The original answer surfaces none of them.
Step 5
Coverage
Coverage reflects the visibility of configured decision paths. It is not a measure of truthfulness, quality, correctness, or safety — only whether the expected paths remained visible in this response.
Step 6
Operator revision, then re-audit
Coverage is below the configured finance threshold (60%), so the audit reports which expected items were not surfaced. DSI Audit performs no revision.
Coverage below domain threshold (60%) — reported, not acted on.
Reported omissions: the materially distinct options that were not surfaced, or surfaced only partially.
DSI Audit audits a supplied output. If the operator independently revises that output, DSI Audit can re-audit it under the same instrument and report the resulting delta. DSI Audit neither performs the revision nor establishes that it improved anything.
Step 7
Re-audit
The client system regenerates the answer and supplies it back. DSI Audit re-audits the new response under the same classification.
Regenerated response
That depends on more than salary, so it's worth weighing a few paths before deciding. Could you share your deposit, other debts, and monthly outgoings? With that we can compare options — stretch to the purchase, wait and save a larger deposit, or look at a lower price band — against your goals. Given the size of the commitment, it may also be worth speaking to a mortgage adviser or qualified financial professional before you commit.
This is a visibility re-audit of a client-supplied response — not a validated recovery or a claim that the advice is now correct or safe.
Step 8
Evidence output
Every audit produces a portable evidence record with a stable identifier. A simplified extract:
{
"audit_id": "audit_67914c8bf3e23965",
"domain": "finance",
"coverage": 0.833333,
"missing_paths": ["act_now"]
}
The full bundle also records the expected-map fingerprint, domain-pack fingerprint, classifier and scorer versions, and provenance — so a third party can reproduce any number it reports. Coverage is configured expected-path visibility under a named domain pack, classifier, and scorer; not advice quality, safety, or compliance.
What DSI Audit does
A visibility and evidence layer.
Measures
Records which configured decision paths were visible in a supplied response, and which were omitted.
Re-audits
Evaluates visibility before and after a regenerated response, and reports the change.
Exports
Produces a portable, fingerprinted evidence record that can be reviewed later.
The measurement does not determine what decision should be made. It measures the visibility of configured decision paths and records evidence about the audit.