fix(labels): the tare facings are sku_l12, not unknown
Facings #46-48 carried the note 'possibly what stock.csv calls l12'. The l12 reconciliation settled it: the shelf tag under them reads ユーラス 野菜を おいしく食べる旨タレ (380g) at ¥299, the price the l12 row carries, and the row has been renamed to match. Leaving them unknown understated the catalog and overstated precision. Counts move from 61 in-catalog / 48 unknown to 64 / 45. The enrollment ceiling falls 87% -> 83% because l12's three facings now count as in-catalog with no enrolled view - an honest catalog gap, not a recognition regression. Also records the Tier-3 source search: two reusable clips (CC BY 3.0 Wikimedia 1920x1080 supermarket pan; CC BY YouTube 360p mayonnaise-bay pan), 11 rejected candidates, and the LOPIA walk that carries the standard YouTube licence and was therefore not downloaded. Both clips are labelled tier3_proxy_candidate, never Tier 3: that still needs the operator's own recorded walks.
This commit is contained in:
kiyo9w
parent
1e62554944
commit
22db40eb93
2 changed files with 298 additions and 9 deletions
289
recognization/data/external-eval/tier3-sources/manifest.json
Normal file
289
recognization/data/external-eval/tier3-sources/manifest.json
Normal file
|
|
@ -0,0 +1,289 @@
|
|||
{
|
||||
"directory": "data/external-eval/tier3-sources",
|
||||
"purpose": "Public video/image-sequence sources that can exercise the live recognition path (continuous camera pan over Japanese supermarket mayonnaise/sauce aisles).",
|
||||
"tier_label": "tier3_proxy_candidate",
|
||||
"tier_label_note": "Nothing here is Tier 3. DECISION.md defines Tier 3 as FrameRecorder walks (code/record.py) of the same LOPIA aisles with Tier-2-style labels, replayed through code/eval_live.py. These are independent-source proxies: continuous camera pans over comparable Japanese retail shelving, not the Tier-2/Tier-3 protocol.",
|
||||
"catalog_reference": "stock-lopia/stock.csv (12 SKUs, sku_l01..sku_l12)",
|
||||
"collected": "2026-09-29",
|
||||
"collector": "Tier3Sources subagent",
|
||||
"media": [
|
||||
{
|
||||
"file": "media/kat-in-japan-mayonnaise-aisle-pan-694-720.mp4",
|
||||
"sku": null,
|
||||
"sku_candidates": [
|
||||
"sku_l01"
|
||||
],
|
||||
"sku_confidence": "unconfirmed_visual_resemblance_only",
|
||||
"product": "Japanese supermarket mayonnaise/dressing shelf bay: a dense run of squeeze bottles and jars in the standard Japanese mayonnaise-shelf format. Brand identity is NOT legible at 640x360, so no Kewpie/Ajinomoto attribution is claimed.",
|
||||
"source_page": "https://www.youtube.com/watch?v=HM2vrp7aE04",
|
||||
"source_title": "Japanese Supermarket--Tour--Living In Japan--Grocery Shopping In Japan--Preparing for Thanksgiving",
|
||||
"source_author": "Kat In Japan",
|
||||
"media_url": "https://www.youtube.com/watch?v=HM2vrp7aE04",
|
||||
"source_license": "Creative Commons Attribution (reuse allowed)",
|
||||
"license_url": "https://www.youtube.com/t/creative_commons",
|
||||
"license_status": "redistributable",
|
||||
"license_evidence": "yt-dlp metadata field license = 'Creative Commons Attribution license (reuse allowed)'",
|
||||
"width": 640,
|
||||
"height": 360,
|
||||
"duration_seconds": 26.0,
|
||||
"useful_timestamps": [
|
||||
{
|
||||
"t": 0.0,
|
||||
"note": "Shelf pan begins; the mayonnaise/dressing bay enters frame on the left-hand side."
|
||||
},
|
||||
{
|
||||
"t": 9.0,
|
||||
"note": "Closest approach to the bay; bottle bodies largest in frame. A white-bodied squeeze bottle with a red cap and a red/yellow label block is present and resembles the enrolled sku_l01 (Kewpie Egg Care 305g) silhouette, but the label text is not resolvable, so this is a resemblance note only."
|
||||
},
|
||||
{
|
||||
"t": 15.0,
|
||||
"note": "Camera continues along the same bay; a second row of bottles plus adjacent dressing bottles."
|
||||
},
|
||||
{
|
||||
"t": 21.0,
|
||||
"note": "Pan reaches the end of the mayonnaise bay before moving on."
|
||||
}
|
||||
],
|
||||
"view_type": "shelf_pan_left_bay",
|
||||
"camera_motion": "continuous handheld pan along the shelf, no cuts inside the clip",
|
||||
"trim": "source 00:11:34-00:12:00 (694-720 s) of a 1254.6 s upload",
|
||||
"sha256": "6fb69daee59d17fb245a86816315bd7667f608f346754aa47591a3959df25cf5",
|
||||
"notes": "Only 360p was obtainable: the 1080p rendition of this upload is behind a YouTube bot gate (yt-dlp 'Sign in to confirm you're not a bot'), so the saved clip is a re-encode of the 360p stream. VERIFIED in the saved pixels: a continuous, uncut camera pan along a Japanese mayonnaise/dressing shelf bay, with the shelf format, bottle geometry and shelf-tag layout of the target category. NOT VERIFIED: brand and SKU identity. Tight 4x crops of the bottle faces at 9 s and 15 s do not resolve label text, so no Kewpie/Ajinomoto claim is made and no catalog SKU is asserted. Treat this as a motion/pan proxy for the live path, not a SKU-identity proxy. Frames inspected at 3 s, 9 s, 15 s, 21 s, 25 s (left-bay 3x zoom crops), 9 s and 15 s (4x tight bottle crops), and 2 s, 8 s, 14 s, 20 s, 25 s (full frame)."
|
||||
},
|
||||
{
|
||||
"file": "media/hanzomon-supermarket-pan-132-152.mp4",
|
||||
"sku": null,
|
||||
"sku_candidates": [],
|
||||
"sku_confidence": "no_catalog_sku_confirmed",
|
||||
"product": "Japanese supermarket interior: general grocery and condiment shelving, no catalog SKU confirmed",
|
||||
"source_page": "https://commons.wikimedia.org/wiki/File:Daily_Life_in_Tokyo_in_2013_%E2%80%93_Supermarket_in_Hanzomon_Station_Area.webm",
|
||||
"source_title": "Daily Life in Tokyo in 2013 - Supermarket in Hanzomon Station Area",
|
||||
"source_author": "Arkascha",
|
||||
"media_url": "https://upload.wikimedia.org/wikipedia/commons/2/24/Daily_Life_in_Tokyo_in_2013_%E2%80%93_Supermarket_in_Hanzomon_Station_Area.webm",
|
||||
"source_license": "CC BY 3.0",
|
||||
"license_url": "https://creativecommons.org/licenses/by/3.0",
|
||||
"license_status": "redistributable",
|
||||
"license_evidence": "Wikimedia Commons imageinfo extmetadata: LicenseShortName 'CC BY 3.0', LicenseUrl https://creativecommons.org/licenses/by/3.0, AttributionRequired true, DateTimeOriginal 2013-07-30",
|
||||
"width": 1920,
|
||||
"height": 1080,
|
||||
"duration_seconds": 20.02,
|
||||
"useful_timestamps": [
|
||||
{
|
||||
"t": 1.0,
|
||||
"note": "Camera moving along shelving; packaged goods fill the frame at full 1080p detail."
|
||||
},
|
||||
{
|
||||
"t": 9.0,
|
||||
"note": "Mid-aisle shelving with legible package text at native resolution."
|
||||
},
|
||||
{
|
||||
"t": 17.0,
|
||||
"note": "Pan continues past the shelf run; store lighting and shelf geometry stable."
|
||||
}
|
||||
],
|
||||
"view_type": "aisle_pan",
|
||||
"camera_motion": "continuous handheld walk-and-pan, no cuts inside the clip",
|
||||
"trim": "source 00:02:12-00:02:32 (132-152 s) of a 195.8 s upload",
|
||||
"sha256": "31edbd020bc1119ba38cf2a624ff3ed129f0ac6844da3701643dc0c4693b6f57",
|
||||
"notes": "Highest-resolution reusable source found (native 1920x1080, CC BY 3.0, Wikimedia Commons). Continuous pan and enough resolution to detect products, but no catalog SKU was confirmed in the inspected frames, so it is a resolution/motion proxy rather than a SKU-identity proxy. Frames inspected at 1 s, 9 s, 17 s (full frame) plus a 25-tile contact sheet over the whole 195.8 s upload."
|
||||
}
|
||||
],
|
||||
"rejected_candidates": [
|
||||
{
|
||||
"source_page": "https://www.youtube.com/watch?v=eSFPom2NJjU",
|
||||
"source_title": "LOPIA Kyoto Yodobashi Night Walk 4K HDR",
|
||||
"source_author": "Wander Strolls",
|
||||
"media_url": "https://www.youtube.com/watch?v=eSFPom2NJjU",
|
||||
"source_license": "Standard YouTube license (no reuse grant)",
|
||||
"license_status": "restricted-research",
|
||||
"width": null,
|
||||
"height": null,
|
||||
"duration_seconds": 1954,
|
||||
"reason": "Closest match to the preferred target (an actual LOPIA store walk, 4K HDR, night visit) but it carries the standard YouTube license, not a Creative Commons grant, so no media was downloaded. Metadata retrieval was additionally blocked by a YouTube bot gate ('Sign in to confirm you're not a bot'). Recorded as a candidate only: if the operator obtains permission, the aisle pan timestamps would need to be located from the source page directly.",
|
||||
"candidate_skus": []
|
||||
},
|
||||
{
|
||||
"source_page": "https://archive.org/details/RichPavHerroFlomJapanAwalkthroughasupermarket",
|
||||
"source_title": "Herro Flom Japan: A walk through a supermarket",
|
||||
"source_author": "Rich Pav",
|
||||
"media_url": "https://archive.org/download/RichPavHerroFlomJapanAwalkthroughasupermarket/supermarket.050812_1633.00.ogv",
|
||||
"source_license": "CC BY-NC-SA 2.5",
|
||||
"license_url": "http://creativecommons.org/licenses/by-nc-sa/2.5/",
|
||||
"license_status": "restricted-research",
|
||||
"width": 400,
|
||||
"height": 304,
|
||||
"duration_seconds": 362.84,
|
||||
"reason": "Genuine Japanese supermarket walk with a clear reuse license, but the best available rendition is 400x304 (the MP4 derivative is 320x240). Far below the resolution needed to detect products, and the NC clause restricts redistribution. No media downloaded.",
|
||||
"candidate_skus": []
|
||||
},
|
||||
{
|
||||
"source_page": "https://archive.org/details/RichPavAWalkThroughaSupermarketinJapan",
|
||||
"source_title": "A Walk Through a Supermarket in Japan",
|
||||
"source_author": "Rich Pav",
|
||||
"media_url": "https://archive.org/download/RichPavAWalkThroughaSupermarketinJapan/herroflomjapan_050817.ogv",
|
||||
"source_license": "CC BY-NC-SA 2.5",
|
||||
"license_url": "http://creativecommons.org/licenses/by-nc-sa/2.5/",
|
||||
"license_status": "restricted-research",
|
||||
"width": 400,
|
||||
"height": 304,
|
||||
"duration_seconds": 365.29,
|
||||
"reason": "Same series and same limitation as the item above: 400x304 maximum, NC clause, and the uploader's own description ('Crooked, jiggly video') indicates unstable framing. No media downloaded.",
|
||||
"candidate_skus": []
|
||||
},
|
||||
{
|
||||
"source_page": "https://www.youtube.com/watch?v=Em9BT3DaKYc",
|
||||
"source_title": "4K Tour of Grocery Store in Japan (1)",
|
||||
"source_author": "Trendy Explorer",
|
||||
"media_url": "https://www.youtube.com/watch?v=Em9BT3DaKYc",
|
||||
"source_license": "Creative Commons Attribution (reuse allowed)",
|
||||
"license_status": "redistributable",
|
||||
"width": 640,
|
||||
"height": 360,
|
||||
"duration_seconds": 1665.9,
|
||||
"reason": "Reusable license and a long continuous store walk, but the inspected contact sheets cover produce, meat, seafood and snack aisles; no mayonnaise or sauce bay was located, so it cannot exercise the target SKUs. Not saved.",
|
||||
"candidate_skus": []
|
||||
},
|
||||
{
|
||||
"source_page": "https://www.youtube.com/watch?v=3s8KiF5UCwA",
|
||||
"source_title": "4K Tour of Grocery Store in Japan (2)",
|
||||
"source_author": "Trendy Explorer",
|
||||
"media_url": "https://www.youtube.com/watch?v=3s8KiF5UCwA",
|
||||
"source_license": "Creative Commons Attribution (reuse allowed)",
|
||||
"license_status": "redistributable",
|
||||
"width": 640,
|
||||
"height": 360,
|
||||
"duration_seconds": 752.55,
|
||||
"reason": "Reusable license, but the same series and the same outcome: no mayonnaise/sauce shelf identified in the inspected frames. Not saved.",
|
||||
"candidate_skus": []
|
||||
},
|
||||
{
|
||||
"source_page": "https://www.youtube.com/watch?v=G9GnFJzQqaU",
|
||||
"source_title": "PEEK INSIDE A JAPANESE SUPERMARKET-SUPER CLEAN AND VERY ORGANIZED",
|
||||
"source_author": "WOW THAT'S JAPAN 2",
|
||||
"media_url": "https://www.youtube.com/watch?v=G9GnFJzQqaU",
|
||||
"source_license": "Creative Commons Attribution (reuse allowed)",
|
||||
"license_status": "redistributable",
|
||||
"width": 640,
|
||||
"height": 360,
|
||||
"duration_seconds": 325.8,
|
||||
"reason": "Reusable license and a clean store interior, but the walk covers produce, bakery and general aisles without a mayonnaise/sauce bay. Not saved.",
|
||||
"candidate_skus": []
|
||||
},
|
||||
{
|
||||
"source_page": "https://www.youtube.com/watch?v=uauJTcfQL7U",
|
||||
"source_title": "Cheap Japanese Groceries in Tokyo! Hidden Maruyasu Supermarket Tour",
|
||||
"source_author": "Tomodachi Ken in Japan",
|
||||
"media_url": "https://www.youtube.com/watch?v=uauJTcfQL7U",
|
||||
"source_license": "Creative Commons Attribution (reuse allowed)",
|
||||
"license_status": "redistributable",
|
||||
"width": 640,
|
||||
"height": 360,
|
||||
"duration_seconds": 734.03,
|
||||
"reason": "Reusable license, but the tour is dominated by produce, deli and dry goods; no mayonnaise/sauce shelf located in the inspected frames. Not saved.",
|
||||
"candidate_skus": []
|
||||
},
|
||||
{
|
||||
"source_page": "https://www.youtube.com/watch?v=Lrmlt8InrQ0",
|
||||
"source_title": "Shopping at Japan's Cheapest Supermarket! 6,000 Yen Gyomu Super Grocery Haul & Tour",
|
||||
"source_author": "Tomodachi Ken in Japan",
|
||||
"media_url": "https://www.youtube.com/watch?v=Lrmlt8InrQ0",
|
||||
"source_license": "Creative Commons Attribution (reuse allowed)",
|
||||
"license_status": "redistributable",
|
||||
"width": 640,
|
||||
"height": 360,
|
||||
"duration_seconds": 1934.0,
|
||||
"reason": "Reusable license and a long walk, but the inspected segments show frozen, dry and snack aisles; no mayonnaise/sauce bay confirmed. Not saved.",
|
||||
"candidate_skus": []
|
||||
},
|
||||
{
|
||||
"source_page": "https://www.youtube.com/watch?v=kaXDaYkkQd0",
|
||||
"source_title": "CHEAPEST Supermarket in Tokyo? OK Store JAPAN PRICES You MUST SEE!",
|
||||
"source_author": "Tomodachi Ken in Japan",
|
||||
"media_url": "https://www.youtube.com/watch?v=kaXDaYkkQd0",
|
||||
"source_license": "Creative Commons Attribution (reuse allowed)",
|
||||
"license_status": "redistributable",
|
||||
"width": 640,
|
||||
"height": 360,
|
||||
"duration_seconds": 660.2,
|
||||
"reason": "Reusable license, but the walk is price-tag oriented and no mayonnaise/sauce shelf was located. Not saved.",
|
||||
"candidate_skus": []
|
||||
},
|
||||
{
|
||||
"source_page": "https://www.youtube.com/watch?v=fOukUeu1asM",
|
||||
"source_title": "Aeon Supermarket in Saitama 2020",
|
||||
"source_author": "Luke's Adventures",
|
||||
"media_url": "https://www.youtube.com/watch?v=fOukUeu1asM",
|
||||
"source_license": "Creative Commons Attribution (reuse allowed)",
|
||||
"license_status": "redistributable",
|
||||
"width": 640,
|
||||
"height": 360,
|
||||
"duration_seconds": 188.6,
|
||||
"reason": "Reusable license, but only 188 s long and the inspected frames show general aisles with no mayonnaise/sauce bay. Not saved.",
|
||||
"candidate_skus": []
|
||||
},
|
||||
{
|
||||
"source_page": "https://www.youtube.com/watch?v=HM2vrp7aE04",
|
||||
"source_title": "Japanese Supermarket--Tour--Living In Japan--Grocery Shopping In Japan--Preparing for Thanksgiving",
|
||||
"source_author": "Kat In Japan",
|
||||
"media_url": "https://www.youtube.com/watch?v=HM2vrp7aE04",
|
||||
"source_license": "Creative Commons Attribution (reuse allowed)",
|
||||
"license_status": "redistributable",
|
||||
"width": 640,
|
||||
"height": 360,
|
||||
"duration_seconds": 1254.57,
|
||||
"reason": "Not rejected as a source: this is the parent upload of the saved mayonnaise-aisle clip. Listed here only to record that the full 1254.6 s walk was NOT stored (the task requires trimming to the useful section) and that its 1080p rendition is behind a YouTube bot gate, so only the 360p stream was usable.",
|
||||
"candidate_skus": [
|
||||
"sku_l01"
|
||||
]
|
||||
}
|
||||
],
|
||||
"search_log": [
|
||||
{
|
||||
"source": "Internet Archive advancedsearch (mediatype:movies, licenseurl:*)",
|
||||
"queries": [
|
||||
"(supermarket OR grocery) AND (aisle OR walk) AND (japan OR japanese)",
|
||||
"title:(supermarket) AND mediatype:movies AND licenseurl:*"
|
||||
],
|
||||
"outcome": "Two CC BY-NC-SA Japanese supermarket walks (Rich Pav, 2005); both capped at 400x304. No other Japanese supermarket walk with a reuse license."
|
||||
},
|
||||
{
|
||||
"source": "Wikimedia Commons API (list=search, list=categorymembers)",
|
||||
"queries": [
|
||||
"srsearch=supermarket aisle Japan mayonnaise",
|
||||
"srsearch=filemime:video/webm supermarket OR grocery OR shopping",
|
||||
"Category:Supermarkets in Japan",
|
||||
"Category:Interiors of supermarkets in Japan",
|
||||
"Category:Supermarket shelves in Japan",
|
||||
"Category:Mayonnaise from Japan",
|
||||
"Category:Supermarkets in Tokyo"
|
||||
],
|
||||
"outcome": "One usable video: 'Daily Life in Tokyo in 2013 - Supermarket in Hanzomon Station Area' (CC BY 3.0, 1920x1080). The mayonnaise categories are almost entirely plated-food photographs, not shelf scenes."
|
||||
},
|
||||
{
|
||||
"source": "YouTube search with Creative Commons filter (sp=EgIwAQ%253D%253D)",
|
||||
"queries": [
|
||||
"japanese supermarket walk",
|
||||
"japanese supermarket aisle sauce",
|
||||
"japanese grocery store walk 4k",
|
||||
"supermarket shelf products japan",
|
||||
"japan supermarket shopping vlog",
|
||||
"supermarket walk Japan mayonnaise",
|
||||
"スーパー 店内 マヨネーズ 売り場"
|
||||
],
|
||||
"outcome": "Nine CC-BY Japanese supermarket tours identified and license-verified via yt-dlp. Only 'Kat In Japan' contained a mayonnaise/dressing shelf bay with a continuous pan; its brand identity is not resolvable at the obtainable 360p, so no Kewpie/Ajinomoto attribution is asserted. No CC-licensed LOPIA aisle walk exists in the index; the one LOPIA store walk found is standard-license."
|
||||
},
|
||||
{
|
||||
"source": "Flickr public feed API",
|
||||
"queries": [
|
||||
"tags=supermarket,japan"
|
||||
],
|
||||
"outcome": "Feed returns stills only (no video), and the returned items are produce/seafood displays. No mayonnaise shelf sequences."
|
||||
}
|
||||
],
|
||||
"coverage_gaps": [
|
||||
"No LOPIA aisle footage with a reuse license was found. The preferred target (LOPIA mayonnaise/sauce aisle) is only available under the standard YouTube license.",
|
||||
"No reusable source gives per-SKU identity for the stock-lopia catalog. The mayonnaise-aisle clip confirms the category and shelf format but not brand or SKU; the Hanzomon clip confirms neither.",
|
||||
"No reusable source reaches the resolution needed to read Japanese package text at shelf distance: the best is 1920x1080 (Hanzomon) but its frames do not contain the target category, and the clip that does contain a mayonnaise bay is 640x360.",
|
||||
"Tier-3 replay still requires the operator's own FrameRecorder walks (code/record.py) of the LOPIA aisles; nothing here substitutes for that."
|
||||
]
|
||||
}
|
||||
|
|
@ -624,11 +624,11 @@
|
|||
1359,
|
||||
972
|
||||
],
|
||||
"label": "unknown",
|
||||
"label": "sku_l12",
|
||||
"match": 0.0,
|
||||
"index": 46,
|
||||
"note": "ユーラス 野菜をおいしく食べる旨たれ 380g; possibly what stock.csv calls l12",
|
||||
"source": "visual-audit-2026-09-28",
|
||||
"note": "ユーラス 野菜をおいしく食べる旨たれ 380g; possibly what stock.csv calls l12 | Relabelled to sku_l12: the shelf tag under these facings reads ユーラス 野菜をおいしく食べる旨タレ (380g) at ¥299, the price the l12 row carries, and the row was renamed to match (data/external-eval/l12-reconciliation/manifest.json).",
|
||||
"source": "l12-reconciliation-2026-09-29",
|
||||
"v1_label": "unknown"
|
||||
},
|
||||
{
|
||||
|
|
@ -638,11 +638,11 @@
|
|||
1440,
|
||||
973
|
||||
],
|
||||
"label": "unknown",
|
||||
"label": "sku_l12",
|
||||
"match": 0.0,
|
||||
"index": 47,
|
||||
"note": "same tare bottle",
|
||||
"source": "visual-audit-2026-09-28",
|
||||
"note": "same tare bottle | Relabelled to sku_l12: the shelf tag under these facings reads ユーラス 野菜をおいしく食べる旨タレ (380g) at ¥299, the price the l12 row carries, and the row was renamed to match (data/external-eval/l12-reconciliation/manifest.json).",
|
||||
"source": "l12-reconciliation-2026-09-29",
|
||||
"v1_label": "unknown"
|
||||
},
|
||||
{
|
||||
|
|
@ -652,11 +652,11 @@
|
|||
1500,
|
||||
973
|
||||
],
|
||||
"label": "unknown",
|
||||
"label": "sku_l12",
|
||||
"match": 0.0,
|
||||
"index": 48,
|
||||
"note": "same tare bottle, partial",
|
||||
"source": "visual-audit-2026-09-28",
|
||||
"note": "same tare bottle, partial | Relabelled to sku_l12: the shelf tag under these facings reads ユーラス 野菜をおいしく食べる旨タレ (380g) at ¥299, the price the l12 row carries, and the row was renamed to match (data/external-eval/l12-reconciliation/manifest.json).",
|
||||
"source": "l12-reconciliation-2026-09-29",
|
||||
"v1_label": "unknown"
|
||||
},
|
||||
{
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue