Use Cases
Scenario · an AI agent completes an eval assignment (shipped today)
Section titled “Scenario · an AI agent completes an eval assignment (shipped today)”This is the lane that is live in production at api.defendablecloud.com — the Defendable Run, executed by the rulebook engine. The primitive is: Inputs → Evidence → Execution → Checks → Verdict → Approval → Receipt.
| Step | What happens | Where |
|---|---|---|
| 1 | A Flight Sheet declares the rulebook for the lane (required output schema, math checks, evidence checks, policy DSL rules, penalty bands). 50 sheets loaded. | GET /flight-sheets |
| 2 | The agent’s work is filed against a Run as a structured submission plus evidence (uploads are best-effort to Tigris). | POST /runs, /runs/{id}/submission, /runs/{id}/evidence |
| 3 | The deterministic executor runs: structure check, schema/type checks, math re-derivation of every calculation from its own inputs + formula via a safe AST evaluator, evidence presence, and the policy DSL gates. No model is called on the receipt path. | app/executor.py, app/eval.py |
| 4 | Every check passes or raises a flag with a tier (low/mid/high). Score = % of declared rules satisfied — not a quality opinion. | /runs/{id}/checks, /runs/{id}/flags |
| 5 | Flags roll up to a verdict tier: honey (pass · no/low flags), jelly (risk · mid flag), propolis (fail · high flag). | /runs/{id}/verdict |
| 6 | A human approves. The engine refuses to issue a receipt without approval. | /runs/{id}/approve |
| 7 | A receipt is minted into the per-org hash chain: DCR-{org_seq}-{hex8}, with parent_hash linking to the prior receipt and receipt_sha256 over canonical JSON. The chain lives in Postgres; JSON+PDF artifact upload to Tigris is best-effort and never blocks the receipt. | /runs/{id}/receipt, app/ledger.py |
| 8 | Anyone can verify the chain: /ledger/verify recomputes each hash, checks sequential org_seq, and checks parent links. Tamper a stored payload and it flips ok:false and pinpoints the receipt. A share link (/share/{token} + /pdf + /download) lets a buyer’s DD confirm it independently. | /ledger/verify, /share/{token} |
That is the real moat today: math you can recompute, gates you can read aloud, a hash chain you can verify yourself. “We are math and code.”
🐝 Inputs · checks · verdict · receipt. To the shed.