Every decision has a trail.
Explore 50 frozen prompts, three repeats, and 450 real model calls. This is a report generated from the saved responses. It does not run new inference or make purchases.
Run jev-20260919-50x3-v1 · September 19, 2026, Pacific time
Provider-reported usage cost fell 33.2%. Current Jev pricing is provider usage + 3%. End-to-end p95 rose from 12.47s to 20.07s (61% slower). Pass rates measure frozen formatting and field checks, not general model quality. A separate live billing verification accrued $0.000032. The 150 saved Jev calls calculate to $0.005151 at the agreed rate; the full benchmark has not been rerun at this rate.
Measured results · Protocol · Jev pricing calculation · Download historical receipts
Follow one prompt through the system
Select any of the 50 prompts.
1. The frozen task
2. Jev’s answers → deterministic policy
Actual Jev response and policy decision
3. Frontier control
Individual grader checks
3. Jev treatment
Individual grader checks
4. Saved usage and agreed Jev pricing
Provider usage is recorded. The Jev price column applies provider usage + 3% to that saved usage, rounded to micro-dollars; it is a calculation, not a new transaction. Answer-model prices are not calculated here. Original transaction amounts remain in the full responses and receipt download.
| Arm / stage | Model | Provider usage | Jev price · calculated | Vaaya transaction ID |
|---|
Full saved provider responses
5. The live metered-price verification
This actual dashboard capture shows one separate Jev billing verification at provider usage + 3%: $0.000032 in metered usage. It is excluded from the 450-call benchmark. Fractional usage accumulates for settlement, with no per-call cent minimum.
Inspect the actual billing response · Open the pricing-verification filter (requires the calling account).
Historical benchmark charges and original dashboard
The original run recorded $1.64 for treatment versus $0.18 for control under the former Jev charge, and failed its lower-bill acceptance rule. Some answer calls returned zero-cent charges through MPP. These historical receipts are unchanged and do not describe current Jev pricing.
View the original historical dashboard capture.
The account sidebar is excluded. Open the original run filter. The dashboard shows the latest 100 matching rows; the downloadable log contains all 450 calls.