Commit graph

6 commits

Author SHA1 Message Date
kiyo9w
c00b00499f test(server): verify the shipped configuration end to end
Still endpoint: 111 detections, 44 named, 42 correct, 95.5% precision.
Stream, 20 s pan 12: 83 tracks labelled, 0 label changes, 0 unexplained, 19/27
facings named at 82% precision, 0 wrong, 0 unenrolled false accepts.
2026-09-29 04:41:52 +09:00
kiyo9w
a716f5aab1 test(server): final smoke with the calibrated gates live
Still endpoint: 111 detections, 44 named, 42 correct, 95.5% precision, 2 wrong
(both unknown facings the local lane matches geometrically).

Stream, 20 s pan 12: 62 tracks labelled, 0 label changes, 0 unexplained, 17/27
facings named at 84% precision, 0 wrong, 0 unenrolled false accepts.

Both recordings committed under server-smoke/ and stream-gated/.
2026-09-29 04:32:38 +09:00
kiyo9w
4bdad66bbe docs(decision): record the far-unknown calibration and the gate status
The far-unknown claim in the verdict said 0.2-0.7% on 602 crops. That was the
audit's variant matcher on the add/ photos; the shipped lane at the shipped
lines was 3.61% on the Wikimedia sets. Both are now stated, with the sweep that
chose 4.0/4 and the live-endpoint result: 44 named, 42 correct, 95.5% precision
against 53/48/90.6% before.

Gate status is recorded per gate rather than as a blanket claim: G2 and G3's
far half pass offline, G8 passes, and G1/G4/G5/G6/G7 are not yet measured on
held-out data because Tier 2 does not exist.

The Wikimedia manifests and results are committed; the 59 MB of images are not,
because collect_shelf_images.py fetches them from the source URLs the manifests
record.
2026-09-29 04:11:00 +09:00
kiyo9w
d13ce94123 test(server): final smoke with every catalog correction live
/v1/recognize: 111 detections, 53 named in 2.38 s, no view-suffixed ids, no
missing product info. l06 now names all 4 of its facings - it was 1/4 at live
resolution before the current package was enrolled, which is the F-12 fix
visible in the product.

/v1/stream, 20 s pan: 82 tracks labelled, 0 label changes, 0 unexplained. The
label-memory fixes hold under a pan.
2026-09-29 03:41:05 +09:00
kiyo9w
8754738dc1 docs(decision): refresh every number the corrected labels moved
Five blocks still printed pre-correction figures. Each was re-run through the
evaluator and replaced with what it actually outputs now:

- The lane comparison: local 75% at 91% against Van 64% at 38% (full), and
  59% at 93% against 66% at 39% (live). At live resolution Van now answers more
  facings correctly and is wrong on 67 of them to the local lane's 3 - stated
  plainly rather than left as a win on both axes.
- The accept sweep: 75/67/67/62% end-to-end at 91/91/93/95% precision, with the
  evaluator's own column definitions spelled out, since my first re-derivation
  used the wrong denominator.
- The G1 stream claim: four pan replays give 63-70% coverage at 76-84%
  precision, not 75% at 100%.
- The upscale paragraph: the guard is intact, but sku_l09.jpg is now a
  1000x1000 packshot, so the current run no longer exercises it.
- catalog_hash and the pyramid floor: the hash covers view bytes, not just
  names, and every view is now above the 800 px floor.

Also refreshes the server smoke against the renamed catalog: 53 named in 2.58 s,
no view-suffixed ids, no missing product info. l12 is not among them - it has
no enrolled view, which is the documented gap.
2026-09-29 03:18:30 +09:00
kiyo9w
74e9afed7d test(server): record the real-endpoint smoke after the size gate
/v1/recognize on add/image6.jpg against stock-lopia-clean: 111 detections,
53 named, every one carrying product_name and price, no view-suffixed ids.
sku_l10 answers 9 facings, which it could not do before it was enrolled.

The live WebSocket path was exercised too: 217 frames, 77 tracks labelled,
0 unexplained label changes, l09 and l10 in the final summary.
2026-09-29 03:06:28 +09:00