docs(decision): record the far-unknown calibration and the gate status
The far-unknown claim in the verdict said 0.2-0.7% on 602 crops. That was the audit's variant matcher on the add/ photos; the shipped lane at the shipped lines was 3.61% on the Wikimedia sets. Both are now stated, with the sweep that chose 4.0/4 and the live-endpoint result: 44 named, 42 correct, 95.5% precision against 53/48/90.6% before. Gate status is recorded per gate rather than as a blanket claim: G2 and G3's far half pass offline, G8 passes, and G1/G4/G5/G6/G7 are not yet measured on held-out data because Tier 2 does not exist. The Wikimedia manifests and results are committed; the 59 MB of images are not, because collect_shelf_images.py fetches them from the source URLs the manifests record.
This commit is contained in:
parent
07de2bd37d
commit
4bdad66bbe
7 changed files with 1264 additions and 2 deletions
|
|
@ -0,0 +1,24 @@
|
|||
{
|
||||
"endpoint": "/v1/recognize",
|
||||
"image": "add/image6.jpg",
|
||||
"catalog": "stock-lopia-clean",
|
||||
"gates": "LOCAL_ACCEPT=4.0 TEXT_MIN_SHARED=4",
|
||||
"detections": 111,
|
||||
"named": 44,
|
||||
"matched": 44,
|
||||
"correct": 42,
|
||||
"wrong": 2,
|
||||
"precision": 0.955,
|
||||
"wrong_detail": [
|
||||
"sku_l07 vs unknown",
|
||||
"sku_l03 vs unknown"
|
||||
],
|
||||
"previous": {
|
||||
"gates": "2.0/2",
|
||||
"named": 53,
|
||||
"correct": 48,
|
||||
"wrong": 5,
|
||||
"precision": 0.906
|
||||
},
|
||||
"note": "Live still endpoint, box-IoU matched to the corrected labels. The stricter gates trade 9 names for 3 wrong labels."
|
||||
}
|
||||
File diff suppressed because one or more lines are too long
Loading…
Add table
Add a link
Reference in a new issue