RunsJev Calibration
Jev System One Threshold Calibration
Compare AI semantic judgment probabilities against human review decisions to tune thresholds and uncertainty bands.
Review Agreement:96.5%
Advisory Check Governance (docs/pr-qa-pipeline.md §3)
The Jev QA check remains advisory until empirical agreement with human reviews reaches ≥99% across 250+ runs. Human sign-off from Chief/founder or QA channel remains the sole PASS signal for PR merges.
Semantic Questions & Threshold Distribution (4)
Evaluated across 5 recorded checkpoints| Question Identifier | Parent Flow | Evaluations | Avg Probability | Current Threshold | Uncertain Rate | Pass Rate | Tuning Status |
|---|---|---|---|---|---|---|---|
| page_fully_rendered | storefront.home | 2 | 0.98 | > 0.9 | 0 (0%) | 100% | Calibrated |
| primary_action | storefront.pdp | 1 | 0.96 | > 0.85 | 0 (0%) | 100% | Calibrated |
| cart_drawer_rendering | storefront.add_to_cart | 1 | 0.95 | > 0.85 | 0 (0%) | 100% | Calibrated |
| shipping_address_form_layout | storefront.checkout_cod | 1 | 0.74 | > 0.8 | 1 (100%) | 0% | Calibrated |