5eb4bdf6c8
The Wikimedia collector truncated the whole basename at 60 characters, so 13 files lost their extension and cv2 could not read them by name - the distractor sets were quietly scoring 13 images fewer than they held. It now truncates the stem and keeps the extension, and the files on disk are renamed to match. The search terms also pull in .djvu volumes whose page 1 Commons serves as a JPEG thumbnail. Twelve book scans were in the sets; they contributed 0 false accepts, and they are not shelves, so the collector filters them and the manifests no longer list them. With all 2650 crops readable the sweep is re-measured end to end: 3.09% at the old lines, 0.30% at the shipped 4.0/4, image6 44 shown / 42 correct / 95.5%. The accept sweep table and the verdict's far-unknown sentence now carry those numbers instead of the pre-calibration ones. Also: the fetched images are gitignored (manifests and results are not), the l10/l11 shelf-tag crops that back the catalog corrections are committed, and a stale pre-gate eval.json and a duplicate of eval/labels/image6.json are gone. |
||
|---|---|---|
| .. | ||
| evaluations/2026-09-29-session | ||
| external-eval | ||
| external-shelves | ||
| packshots | ||
| README.md | ||
Recognition data
Everything the identity work needs to be reproducible: sourced packshots, evaluation runs, and the audits that produced them. Nothing here is ephemeral; a run that matters is written here, not to a temp directory.
packshots/source/
Front packshots as downloaded, before enrollment. ATTRIBUTION.json records the
source URL, the product as printed, and the manufacturer for each. ocr-reads.json
holds the OCR text each image produced, so a name/OCR refusal can be re-checked
without re-running Vision.
rebuild_catalog.py reads this directory and writes a catalog:
.venv/bin/python code/rebuild_catalog.py --source data/packshots/source \
--output stock-lopia-clean --csv stock-lopia/stock.csv --min-views 1 --replace
evaluations/
One directory per session. Each holds the raw artifacts a claim was computed from, so a number in DECISION.md can be traced back to the run that produced it.
| Directory | Contents |
|---|---|
stream/ |
WebSocket track dumps from stream_client.py, scored by score_stream.py. |
still/ |
/v1/recognize responses for the still-image path. |
catalog-audit/ |
rebuild_catalog.py --json reports. |
scratch/ |
Intermediate images (rotations, crops) kept because they document a finding. |
Scoring a stream dump:
.venv/bin/python code/score_stream.py data/evaluations/<session>/stream/<file>.json \
--labels eval/labels/image6.json --stock-dir stock-lopia-clean