# Deployment Trace Evaluation

**SKU:** CAIN-A75-054  
**Development:** #54 Deployment-driven agent benchmarks  
**Product status:** DELIVERABLE  
**Engine:** `trace_bench` (`cain_a75_engines/tracebench/engine.py`)  
**Profile:** `support_trace_suite`  
**Generated:** 2026-11-13T03:32:40Z UTC

## Result

VERIFIED: consent and tenant approval, redaction scan, frozen suite hash, complete runs and deltas recomputed; 22/22 trace-suite failure cases as expected

- **support_trace_suite**: VERIFIED
- **honest_trace_suite**: SOUND
- **email_left_in_test**: UNSOUND
- **card_number_left_in_test**: UNSOUND
- **api_key_left_in_test**: UNSOUND
- **aws_key_left_in_test**: UNSOUND
- **phone_left_in_test**: UNSOUND
- **trace_without_consent**: UNSOUND
- **consent_after_freeze**: UNSOUND
- **tenant_not_approved**: UNSOUND
- **test_moved_to_other_tenant**: UNSOUND
- **test_without_source_trace**: UNSOUND
- **suite_edited_silently**: UNSOUND
- **agent_froze_its_own_suite**: UNSOUND
- **agent_edited_the_suite**: UNSOUND
- **edit_after_freeze**: UNSOUND
- **run_skipped_a_test**: UNSOUND
- **run_on_other_suite**: UNSOUND
- **delta_misreported**: UNSOUND
- **claim_overstates**: UNSOUND
- **unknown_claim**: UNSOUND
- **wrong_schema**: UNSOUND
- **garbage**: UNSOUND

## Limits of this run

Reviews the suite and run record. The redaction scan is pattern-based; it does not re-execute the agent or judge test quality. The run is Ed25519-signed; pin the issuer key out of band.

This is a bounded run on a sample. It is not an assessment of any production system, not a
certification, and not a signed attestation. The accompanying `manifest.json` records SHA-256
hashes so a recipient can detect a changed file. The manifest is not a signature and not an
attestation; it does not prove who produced the artifact.

## What this is not

- Not a vendor integration, partnership or endorsement.
- Not legal, tax, clinical, insurance or safety advice.
- Not a third-party audit, SOC 2 report, ISO certification or patent filing.
- Not a production write action: no downstream tool was called.

Prices and packaging are proposals. Built by a three-person team.
