Commit graph

4 commits

Author SHA1 Message Date
kiyo9w
c00b00499f test(server): verify the shipped configuration end to end
Still endpoint: 111 detections, 44 named, 42 correct, 95.5% precision.
Stream, 20 s pan 12: 83 tracks labelled, 0 label changes, 0 unexplained, 19/27
facings named at 82% precision, 0 wrong, 0 unenrolled false accepts.
2026-09-29 04:41:52 +09:00
kiyo9w
a716f5aab1 test(server): final smoke with the calibrated gates live
Still endpoint: 111 detections, 44 named, 42 correct, 95.5% precision, 2 wrong
(both unknown facings the local lane matches geometrically).

Stream, 20 s pan 12: 62 tracks labelled, 0 label changes, 0 unexplained, 17/27
facings named at 84% precision, 0 wrong, 0 unenrolled false accepts.

Both recordings committed under server-smoke/ and stream-gated/.
2026-09-29 04:32:38 +09:00
kiyo9w
81a2ab10e7 docs(decision): measure G1 against Van on the same stream and catalog
The G1 row compared against a van run whose server had loaded the legacy
stock-lopia catalog, so its ids were template-level (sku_005) and every answer
scored wrong. Re-run with both servers on stock-lopia-clean, 20 s pan 12:

  van    17/27 (63%) coverage   53% precision   7 wrong   6 unenrolled accepts
  local  19-20/27 (70-74%)      77-85%          0 wrong   0 unenrolled accepts

G1 asks the new system to be no worse than Van on coverage; it is better on
both axes, so G1 now reads as passing on the stream rather than unmeasured.
Both recordings are committed under stream-gated/.
2026-09-29 04:28:20 +09:00
kiyo9w
01d9a5e614 docs(decision): re-measure the stream and live rows after the calibration
The stream row was recorded before the accept lines moved. Three fresh 20 s pan
replays through the shipped lane: 70-74% coverage at 77-85% precision, 0 wrong
labels in all three (0-1 before), 8-14 unknown false accepts - the near-unknown
case, which the size gate and catalog completeness own rather than the accept
line.

Live resolution on the shipped evaluator: 56% end-to-end at 97% precision with
1 false accept, so the calibration is not a full-resolution artifact.

The recordings are committed under stream-gated/ so the row is reproducible.
2026-09-29 04:22:46 +09:00