forked from vnguyen/product-recognition-demo

History

kiyo9w 81a2ab10e7 docs(decision): measure G1 against Van on the same stream and catalog The G1 row compared against a van run whose server had loaded the legacy stock-lopia catalog, so its ids were template-level (sku_005) and every answer scored wrong. Re-run with both servers on stock-lopia-clean, 20 s pan 12: van 17/27 (63%) coverage 53% precision 7 wrong 6 unenrolled accepts local 19-20/27 (70-74%) 77-85% 0 wrong 0 unenrolled accepts G1 asks the new system to be no worse than Van on coverage; it is better on both axes, so G1 now reads as passing on the stream rather than unmeasured. Both recordings are committed under stream-gated/.		2026-09-29 04:28:20 +09:00
..
evaluations/2026-09-29-session	docs(decision): measure G1 against Van on the same stream and catalog	2026-09-29 04:28:20 +09:00
external-eval	test(tier3): run the production pipeline over both reusable clips	2026-09-29 03:39:33 +09:00
external-shelves	chore(eval): reconcile the distractor sets and refresh the sweep numbers	2026-09-29 04:17:54 +09:00
packshots	feat(enroll): report views with no recorded source	2026-09-29 03:35:41 +09:00
README.md	Enroll from a repo data dir; read packshots in every orientation	2026-09-29 02:33:47 +09:00

README.md

Recognition data

Everything the identity work needs to be reproducible: sourced packshots, evaluation runs, and the audits that produced them. Nothing here is ephemeral; a run that matters is written here, not to a temp directory.

`packshots/source/`

Front packshots as downloaded, before enrollment. ATTRIBUTION.json records the source URL, the product as printed, and the manufacturer for each. ocr-reads.json holds the OCR text each image produced, so a name/OCR refusal can be re-checked without re-running Vision.

rebuild_catalog.py reads this directory and writes a catalog:

.venv/bin/python code/rebuild_catalog.py --source data/packshots/source \
    --output stock-lopia-clean --csv stock-lopia/stock.csv --min-views 1 --replace

`evaluations/`

One directory per session. Each holds the raw artifacts a claim was computed from, so a number in DECISION.md can be traced back to the run that produced it.

Directory	Contents
`stream/`	WebSocket track dumps from `stream_client.py`, scored by `score_stream.py`.
`still/`	`/v1/recognize` responses for the still-image path.
`catalog-audit/`	`rebuild_catalog.py --json` reports.
`scratch/`	Intermediate images (rotations, crops) kept because they document a finding.

Scoring a stream dump:

.venv/bin/python code/score_stream.py data/evaluations/<session>/stream/<file>.json \
    --labels eval/labels/image6.json --stock-dir stock-lopia-clean