chore(eval): reconcile the distractor sets and refresh the sweep numbers
The Wikimedia collector truncated the whole basename at 60 characters, so 13 files lost their extension and cv2 could not read them by name - the distractor sets were quietly scoring 13 images fewer than they held. It now truncates the stem and keeps the extension, and the files on disk are renamed to match. The search terms also pull in .djvu volumes whose page 1 Commons serves as a JPEG thumbnail. Twelve book scans were in the sets; they contributed 0 false accepts, and they are not shelves, so the collector filters them and the manifests no longer list them. With all 2650 crops readable the sweep is re-measured end to end: 3.09% at the old lines, 0.30% at the shipped 4.0/4, image6 44 shown / 42 correct / 95.5%. The accept sweep table and the verdict's far-unknown sentence now carry those numbers instead of the pre-calibration ones. Also: the fetched images are gitignored (manifests and results are not), the l10/l11 shelf-tag crops that back the catalog corrections are committed, and a stale pre-gate eval.json and a duplicate of eval/labels/image6.json are gone.
This commit is contained in:
kiyo9w
parent
4bdad66bbe
commit
5eb4bdf6c8
19 changed files with 646 additions and 253 deletions
|
|
@ -2,115 +2,129 @@
|
|||
"dataset": "wikimedia-commons-2",
|
||||
"catalog": "stock-lopia-clean",
|
||||
"note": "Unrelated shelves: every accept is a false accept by construction.",
|
||||
"images": 15,
|
||||
"detections": 421,
|
||||
"images": 17,
|
||||
"detections": 462,
|
||||
"false_accepts": 1,
|
||||
"false_accept_rate": 0.0024,
|
||||
"false_accept_rate": 0.0022,
|
||||
"rows": [
|
||||
{
|
||||
"file": "000_1920px-2011年4月の牛乳_(5588310773).jpg",
|
||||
"title": "File:2011年4月の牛乳 (5588310773).jpg",
|
||||
"detections": 78,
|
||||
"false_accepts": 1,
|
||||
"ms": 2983
|
||||
"ms": 3504
|
||||
},
|
||||
{
|
||||
"file": "001_Candy_in_Japan_2005_(5256472).jpg",
|
||||
"title": "File:Candy in Japan 2005 (5256472).jpg",
|
||||
"detections": 12,
|
||||
"false_accepts": 0,
|
||||
"ms": 387
|
||||
"ms": 408
|
||||
},
|
||||
{
|
||||
"file": "004_page1-960px-History_of_the_Toledo_Police_Department.djvu.jpg",
|
||||
"title": "File:History of the Toledo Police Department.djvu",
|
||||
"detections": 24,
|
||||
"file": "002_1920px-Empty_shelves_in_Tokyo_area_as_people_get_ready_for_t.jpg",
|
||||
"title": "File:Empty shelves in Tokyo area as people get ready for typhoon Hagibis - Oct 11 2019 330pm.jpeg",
|
||||
"detections": 8,
|
||||
"false_accepts": 0,
|
||||
"ms": 246
|
||||
"ms": 101
|
||||
},
|
||||
{
|
||||
"file": "003_1920px-HK_SW_上環_Sheung_Wan_德輔道西_88_Des_Voeux_Road_West_shop_.jpg",
|
||||
"title": "File:HK SW 上環 Sheung Wan 德輔道西 88 Des Voeux Road West shop 惠康超級市場 Wellcome Supermarket goods August 2020 SS2 27.jpg",
|
||||
"detections": 10,
|
||||
"false_accepts": 0,
|
||||
"ms": 1560
|
||||
},
|
||||
{
|
||||
"file": "005_1920px-Illuminated_wooden_shelf_with_many_glass_jars_contain.jpg",
|
||||
"title": "File:Illuminated wooden shelf with many glass jars containing cookies for sale in Tokyo.jpg",
|
||||
"detections": 41,
|
||||
"false_accepts": 0,
|
||||
"ms": 2946
|
||||
},
|
||||
{
|
||||
"file": "007_Japan_earthquake_store_shelves.jpg",
|
||||
"title": "File:Japan earthquake store shelves.jpg",
|
||||
"detections": 4,
|
||||
"false_accepts": 0,
|
||||
"ms": 97
|
||||
"ms": 298
|
||||
},
|
||||
{
|
||||
"file": "009_Milk_(2655574568).jpg",
|
||||
"title": "File:Milk (2655574568).jpg",
|
||||
"detections": 58,
|
||||
"false_accepts": 0,
|
||||
"ms": 1379
|
||||
"ms": 2802
|
||||
},
|
||||
{
|
||||
"file": "010_Natsuge-mikado_okashi.jpg",
|
||||
"title": "File:Natsuge-mikado okashi.jpg",
|
||||
"detections": 7,
|
||||
"false_accepts": 0,
|
||||
"ms": 259
|
||||
"ms": 704
|
||||
},
|
||||
{
|
||||
"file": "012_1920px-Supermarket_in_2006_(646332846).jpg",
|
||||
"title": "File:Supermarket in 2006 (646332846).jpg",
|
||||
"detections": 129,
|
||||
"false_accepts": 0,
|
||||
"ms": 2672
|
||||
},
|
||||
{
|
||||
"file": "013_page1-1280px-Tangled_Hair.djvu.jpg",
|
||||
"title": "File:Tangled Hair.djvu",
|
||||
"detections": 0,
|
||||
"false_accepts": 0,
|
||||
"ms": 20
|
||||
"ms": 6707
|
||||
},
|
||||
{
|
||||
"file": "014_1920px-「ペヤング」予想通りの大売れ！_(18634213682).jpg",
|
||||
"title": "File:「ペヤング」予想通りの大売れ！ (18634213682).jpg",
|
||||
"detections": 27,
|
||||
"false_accepts": 0,
|
||||
"ms": 324
|
||||
"ms": 762
|
||||
},
|
||||
{
|
||||
"file": "015_1920px-お客様各位_2008_国内産バター_(2429997079).jpg",
|
||||
"title": "File:お客様各位 2008 国内産バター (2429997079).jpg",
|
||||
"detections": 14,
|
||||
"false_accepts": 0,
|
||||
"ms": 529
|
||||
"ms": 1499
|
||||
},
|
||||
{
|
||||
"file": "016_1920px-パン売り場_手動ドア式_2016_(28574754416).jpg",
|
||||
"title": "File:パン売り場 手動ドア式 2016 (28574754416).jpg",
|
||||
"detections": 21,
|
||||
"false_accepts": 0,
|
||||
"ms": 543
|
||||
"ms": 1842
|
||||
},
|
||||
{
|
||||
"file": "017_1920px-プラレール_2015_(22339689873).jpg",
|
||||
"title": "File:プラレール 2015 (22339689873).jpg",
|
||||
"detections": 12,
|
||||
"false_accepts": 0,
|
||||
"ms": 254
|
||||
"ms": 864
|
||||
},
|
||||
{
|
||||
"file": "018_一家族様一本限り_(5588902836).jpg",
|
||||
"title": "File:一家族様一本限り (5588902836).jpg",
|
||||
"detections": 27,
|
||||
"false_accepts": 0,
|
||||
"ms": 1385
|
||||
"ms": 3880
|
||||
},
|
||||
{
|
||||
"file": "019_1920px-洗濯洗剤_(10852819193).jpg",
|
||||
"title": "File:洗濯洗剤 (10852819193).jpg",
|
||||
"detections": 8,
|
||||
"false_accepts": 0,
|
||||
"ms": 158
|
||||
"ms": 704
|
||||
},
|
||||
{
|
||||
"file": "020_1920px-申し訳ございませんが_ごめんなさい_お魚本日の調理は終了いたしました。_どうぞよろしくお願いします_(11.jpg",
|
||||
"title": "File:申し訳ございませんが ごめんなさい お魚本日の調理は終了いたしました。 どうぞよろしくお願いします (11331761984).jpg",
|
||||
"detections": 6,
|
||||
"false_accepts": 0,
|
||||
"ms": 957
|
||||
},
|
||||
{
|
||||
"file": "021_1920px-要冷蔵_(4513315790).jpg",
|
||||
"title": "File:要冷蔵 (4513315790).jpg",
|
||||
"detections": 0,
|
||||
"false_accepts": 0,
|
||||
"ms": 21
|
||||
"ms": 190
|
||||
}
|
||||
]
|
||||
}
|
||||
Loading…
Add table
Add a link
Reference in a new issue