Fire/Smoke v20260410 — SK 獨立測試報告
模型: MobileNetV3-Large (v20260410) · SK 場域資料獨立驗證
涵蓋所有 SK tasks（train + val + test）共 3,877 張 · 73 個 tasks
SK mAP
0.4580
AP Smoke
0.9160
AP Fire
0.0000
SK Samples
3,877
SK Tasks
73
Full Test mAP
0.9892
對照
Threshold 調整前後對比（Smoke）
| Threshold | Precision | Recall | F1 | FP | FN | FPR | |
|---|---|---|---|---|---|---|---|
| 原始 (全資料集) | 0.320 | 95.8% | 61.5% | 0.7491 | 66 | 949 | 4.7% |
| SK 最佳化 (FPR≤5%) | 0.320 | 95.8% | 61.5% | 0.7491 | 66 | 949 | 4.7% |
SK vs 全資料集 mAP 對比
Full Test Set
0.9892
→
SK Only
0.4580
差距
-0.5313
SK 資料分佈
| 類型 | 數量 | 佔比 |
|---|---|---|
| Smoke only | 2,464 | 63.6% |
| Fire only | 0 | 0.0% |
| Smoke + Fire | 0 | 0.0% |
| Negative | 1,413 | 36.4% |
| Total | 3,877 | 100% |
Per-Label 指標
| Label | AP | Threshold | Precision | Recall | F1 | TP | FP | FN | TN |
|---|---|---|---|---|---|---|---|---|---|
| smoke | 0.9160 | 0.320 | 0.9583 | 0.6149 | 0.7491 | 1,515 | 66 | 949 | 1,347 |
| fire | 0.0000 | 0.057 | 0.0000 | 0.0000 | 0.0000 | 0 | 81 | 0 | 3,796 |
PR Curve (SK data)
混淆矩陣
smoke (threshold=0.320)
Pred Neg
Pred Pos
True Neg
1,347
34.7%
66
1.7%
True Pos
949
24.5%
1,515
39.1%
P=0.9583 R=0.6149 F1=0.7491 AP=0.9160
fire (threshold=0.057)
Pred Neg
Pred Pos
True Neg
3,796
97.9%
81
2.1%
True Pos
0
0.0%
0
0.0%
P=0.0000 R=0.0000 F1=0.0000 AP=0.0000
Per-Task 準確度（按平均準度排序，低→高）
| Task Name | Split | Frames | Acc Smoke | Acc Fire | Avg Acc |
|---|---|---|---|---|---|
| 東海SK-CH06-test3-AI | test | 7 | 0.0% | 42.9% | 21.4% |
| SK-東海AI-CH-12.mp4 | test | 25 | 60.0% | 24.0% | 42.0% |
| 東海SK-CH06-test2-AI | test | 7 | 0.0% | 85.7% | 42.9% |
| SK-東海AI-CH13-1.mp4 | test | 24 | 8.3% | 91.7% | 50.0% |
| SK-東海AI-CH07-1.mp4 | test | 25 | 8.0% | 92.0% | 50.0% |
| 東海SK-CH02-AI-加強4_val | val | 22 | 0.0% | 100.0% | 50.0% |
| 大甲SK-CH14-AI-test | test | 23 | 4.3% | 100.0% | 52.2% |
| 東海SK-CH06-test-AI | test | 7 | 71.4% | 42.9% | 57.1% |
| SK大甲_15_20241202104500.mp4 | val | 91 | 35.2% | 84.6% | 59.9% |
| 東海SK-CH14-AI-test | test | 14 | 28.6% | 92.9% | 60.7% |
| 東海SK-[CH04] 2026-03-15 10.30.00(Val).mp4 | val | 54 | 24.1% | 100.0% | 62.0% |
| 東海SK-[CH01] 2026-03-11 13.51.00(Val).mp4 | val | 48 | 25.0% | 100.0% | 62.5% |
| 東海SK-CH11-test2-AI | test | 7 | 85.7% | 42.9% | 64.3% |
| 東海SK-[CH02] 2026-03-13 13.40.00(Test).mp4 | test | 30 | 40.0% | 100.0% | 70.0% |
| 東海SK-[CH16] 2026-03-13 13.40.00(Test).mp4 | test | 37 | 40.5% | 100.0% | 70.3% |
| 東海SK-[CH01] 2026-03-13 14.19.00(Train).mp4 | train | 26 | 42.3% | 100.0% | 71.2% |
| 東海SK-CH11-test-AI | test | 7 | 57.1% | 85.7% | 71.4% |
| 東海SK-[CH07] 2026-03-13 12.46.00(Test).mp4 | test | 30 | 43.3% | 100.0% | 71.7% |
| 東海SK-[CH04] 2026-03-14 09.30.00(1)(test).mp4 | test | 52 | 46.2% | 100.0% | 73.1% |
| 東海SK-[CH02] 2026-03-13 10.42.00(Train).mp4 | train | 33 | 48.5% | 100.0% | 74.2% |
| 東海SK-[CH03] 2026-03-13 14.19.00(Train).mp4 | train | 43 | 53.5% | 100.0% | 76.7% |
| 東海SK-[CH16] 2026-03-13 14.34.00(Train).mp4 | train | 37 | 54.1% | 100.0% | 77.0% |
| SK-東海AI-CH05-1.mp4 | test | 24 | 54.2% | 100.0% | 77.1% |
| 東海SK-[CH01] 2026-03-11 13.51.00(Train).mp4 | train | 96 | 54.2% | 100.0% | 77.1% |
| 東海SK-[CH01] 2026-03-11 16.45.00(Train).mp4 | train | 100 | 55.0% | 100.0% | 77.5% |
| SK[CH03] 2024-11-16 10.30.00 | test | 67 | 55.2% | 100.0% | 77.6% |
| 東海SK-[CH16] 2026-03-13 10.42.00(Val).mp4 | val | 54 | 55.6% | 100.0% | 77.8% |
| 東海SK-[CH13] 2026-03-12 09.22.00(Val).mp4 | val | 57 | 57.9% | 100.0% | 78.9% |
| 東海SK-[CH13] 2026-03-13 12.46.00(Train).mp4 | train | 57 | 63.2% | 100.0% | 81.6% |
| 東海SK-[CH01] 2026-03-11 12.38.00(Train).mp4 | train | 60 | 63.3% | 100.0% | 81.7% |
| 大甲-SK_15_20250924095800.mp4 | train | 128 | 72.7% | 93.8% | 83.2% |
| 東海SK-[CH02] 2026-03-13 14.34.00(Train).mp4 | train | 51 | 66.7% | 100.0% | 83.3% |
| 東海-SK[CH02] 2025-01-15 09.24.00.mp4 | test | 28 | 67.9% | 100.0% | 83.9% |
| 東海-SK[CH03] 2025-07-14 07.35.00.mp4 | test | 38 | 68.4% | 100.0% | 84.2% |
| 東海SK-[CH02] 2025-12-04 12.29.00.mp4 | train | 29 | 69.0% | 100.0% | 84.5% |
| 東海SK-[CH01] 2026-03-15 15.59.00(Train).mp4 | train | 31 | 71.0% | 100.0% | 85.5% |
| SK-大甲-CH16-AI | test | 25 | 88.0% | 84.0% | 86.0% |
| 東海SK-[CH01] 2026-02-10 16.33.00.mp4 | val | 161 | 72.0% | 100.0% | 86.0% |
| 東海SK-[CH02] 2026-02-10 16.33.00（黑煙在46分）-1.mp4 | test | 18 | 72.2% | 100.0% | 86.1% |
| 東海SK-[CH13] 2026-03-11 12.38.00(Train).mp4 | train | 66 | 75.8% | 98.5% | 87.1% |
| SK-CH04-3爐 1140401 0800 | test | 63 | 74.6% | 100.0% | 87.3% |
| 東海-SK[CH03] 2024-11-15 11.22.30.mp4 | train | 8 | 75.0% | 100.0% | 87.5% |
| SK[CH02] 2025-01-23 08.08.00 | val | 90 | 75.6% | 100.0% | 87.8% |
| 東海-SK[CH09] 2025-07-22 10.50.00.mp4 | test | 54 | 75.9% | 100.0% | 88.0% |
| 東海SK-[CH04] 2026-03-15 15.59.00(Train).mp4 | train | 21 | 76.2% | 100.0% | 88.1% |
| 東海SK-[CH01] 2026-03-15 10.30.00(Train).mp4 | train | 34 | 76.5% | 100.0% | 88.2% |
| 東海SK-[CH13] 2026-03-11 10.14.00(Train).mp4 | train | 30 | 76.7% | 100.0% | 88.3% |
| 東海SK-[CH01] 2026-03-11 08.18.01(Train).mp4 | train | 39 | 76.9% | 100.0% | 88.5% |
| SK大甲_15_20250912092540.mp4 | test | 33 | 78.8% | 100.0% | 89.4% |
| 東海SK-[CH04] 2026-03-13 16.03.00(Train).mp4 | train | 33 | 81.8% | 100.0% | 90.9% |
| SK大甲_15_20250912091830.mp4 | train | 39 | 82.1% | 100.0% | 91.0% |
| SK大甲_16_20250626115400.mp4 | train | 140 | 82.1% | 100.0% | 91.1% |
| 東海SK-[CH01] 2026-03-11 16.04.00(Train) 有黑煙警報（警報1分鐘，黑煙5分鐘）.mp4 | train | 98 | 84.7% | 100.0% | 92.3% |
| SK東海-[CH09] 2025-06-04 10.27.00.mp4 | test | 60 | 98.3% | 86.7% | 92.5% |
| SK大甲_16_20250626131700.mp4 | val | 157 | 86.6% | 100.0% | 93.3% |
| 東海SK-[CH16] 2026-02-10 16.33.00-cut.mp4 | test | 32 | 87.5% | 100.0% | 93.8% |
| 大甲-SK_14_20250626115400.mp4 | train | 87 | 88.5% | 100.0% | 94.3% |
| 東海SK-[CH04] 2026-02-10 12.13.00-cut.mp4 | test | 53 | 96.2% | 92.5% | 94.3% |
| 東海SK-[CH04] 2026-02-10 16.33.00-cut.mp4 | test | 110 | 89.1% | 100.0% | 94.5% |
| SK-[CH16] 2025-12-04 12.29.00.mp4 | test | 31 | 90.3% | 100.0% | 95.2% |
| 東海-SK[CH04] 2025-01-23 11.39.00.mp4 | train | 36 | 91.7% | 100.0% | 95.8% |
| WV+SK_東海[CH01] 2025-07-22 10.50.00 | test | 64 | 93.8% | 100.0% | 96.9% |
| 東海SK-[CH01] 2026-03-11 10.14.00(Train).mp4 | train | 37 | 94.6% | 100.0% | 97.3% |
| 東海SK-[CH03] 2026-02-10 16.33.00.mp4 | test | 44 | 95.5% | 100.0% | 97.7% |
| SK大甲_15_20250709141600.mp4 | train | 173 | 96.0% | 100.0% | 98.0% |
| 東海SK-CH03-AI加強-train | train | 160 | 100.0% | 97.5% | 98.8% |
| SK-大甲CH17-2-AI | train | 49 | 98.0% | 100.0% | 99.0% |
| 東海-SK[CH04] 2025-01-22 16.35.00.mp4 | train | 52 | 98.1% | 100.0% | 99.0% |
| 東海SK-CH07-AI加強-val | val | 77 | 100.0% | 100.0% | 100.0% |
| 東海SK-CH07-AI加強-train | train | 160 | 100.0% | 100.0% | 100.0% |
| 東海SK-CH02-AI-加強3_train | train | 22 | 100.0% | 100.0% | 100.0% |
| 東海SK-CH02-AI-加強2_train | train | 22 | 100.0% | 100.0% | 100.0% |
| 東海-SK[CH01] 2024-10-27 08.52.00.mp4 | train | 30 | 100.0% | 100.0% | 100.0% |
Grad-CAM 熱區圖 — smoke
原圖
Grad-CAM
TP
smoke:93% fire:1%
GT: s=1 f=0
SK大甲_15_20250709141600.mp4
原圖
Grad-CAM
TP
smoke:96% fire:0%
GT: s=1 f=0
SK大甲_15_20250709141600.mp4
原圖
Grad-CAM
TP
smoke:48% fire:1%
GT: s=1 f=0
東海SK-[CH01] 2026-03-11 16.45.0
原圖
Grad-CAM
TP
smoke:75% fire:2%
GT: s=1 f=0
東海SK-CH03-AI加強-train
原圖
Grad-CAM
TP
smoke:93% fire:0%
GT: s=1 f=0
SK大甲_15_20250709141600.mp4
原圖
Grad-CAM
TP
smoke:100% fire:0%
GT: s=1 f=0
東海SK-CH07-AI加強-train
原圖
Grad-CAM
TP
smoke:94% fire:1%
GT: s=1 f=0
SK大甲_15_20250709141600.mp4
原圖
Grad-CAM
TP
smoke:100% fire:0%
GT: s=1 f=0
東海SK-CH07-AI加強-train
原圖
Grad-CAM
TP
smoke:100% fire:0%
GT: s=1 f=0
東海SK-CH07-AI加強-train
原圖
Grad-CAM
TP
smoke:100% fire:0%
GT: s=1 f=0
東海SK-CH07-AI加強-train
原圖
Grad-CAM
TP
smoke:93% fire:1%
GT: s=1 f=0
東海SK-[CH04] 2026-03-13 16.03.0
原圖
Grad-CAM
TP
smoke:94% fire:1%
GT: s=1 f=0
東海SK-[CH04] 2026-03-13 16.03.0
原圖
Grad-CAM
FP
smoke:33% fire:2%
GT: s=0 f=0
SK大甲_16_20250626131700.mp4
原圖
Grad-CAM
FP
smoke:35% fire:1%
GT: s=0 f=0
東海SK-[CH01] 2026-03-11 16.04.0
原圖
Grad-CAM
FP
smoke:44% fire:2%
GT: s=0 f=0
東海SK-[CH01] 2026-03-15 15.59.0
原圖
Grad-CAM
FP
smoke:38% fire:1%
GT: s=0 f=0
東海SK-[CH01] 2026-02-10 16.33.0
原圖
Grad-CAM
FP
smoke:93% fire:0%
GT: s=0 f=0
SK大甲_15_20250709141600.mp4
原圖
Grad-CAM
FP
smoke:34% fire:1%
GT: s=0 f=0
SK大甲_16_20250626131700.mp4
原圖
Grad-CAM
FP
smoke:39% fire:1%
GT: s=0 f=0
東海SK-[CH01] 2026-02-10 16.33.0
原圖
Grad-CAM
FP
smoke:36% fire:1%
GT: s=0 f=0
SK大甲_16_20250626131700.mp4
原圖
Grad-CAM
FP
smoke:34% fire:2%
GT: s=0 f=0
東海SK-[CH01] 2026-02-10 16.33.0
原圖
Grad-CAM
FP
smoke:34% fire:1%
GT: s=0 f=0
WV+SK_東海[CH01] 2025-07-22 10.5
原圖
Grad-CAM
FP
smoke:38% fire:1%
GT: s=0 f=0
東海SK-[CH01] 2026-02-10 16.33.0
原圖
Grad-CAM
FP
smoke:33% fire:2%
GT: s=0 f=0
東海SK-[CH02] 2026-03-13 14.34.0
原圖
Grad-CAM
FN
smoke:2% fire:0%
GT: s=1 f=0
東海SK-[CH16] 2026-03-13 13.40.0
原圖
Grad-CAM
FN
smoke:23% fire:0%
GT: s=1 f=0
東海-SK[CH03] 2025-07-14 07.35.0
原圖
Grad-CAM
FN
smoke:16% fire:0%
GT: s=1 f=0
東海SK-[CH04] 2026-03-15 15.59.0
原圖
Grad-CAM
FN
smoke:14% fire:1%
GT: s=1 f=0
東海SK-CH02-AI-加強4_val
原圖
Grad-CAM
FN
smoke:3% fire:1%
GT: s=1 f=0
東海SK-[CH04] 2026-03-15 10.30.0
原圖
Grad-CAM
FN
smoke:2% fire:7%
GT: s=1 f=0
SK-東海AI-CH07-1.mp4
原圖
Grad-CAM
FN
smoke:28% fire:1%
GT: s=1 f=0
東海SK-[CH01] 2026-03-11 08.18.0
原圖
Grad-CAM
FN
smoke:1% fire:2%
GT: s=1 f=0
SK大甲_15_20241202104500.mp4
原圖
Grad-CAM
FN
smoke:5% fire:0%
GT: s=1 f=0
東海SK-CH14-AI-test
原圖
Grad-CAM
FN
smoke:17% fire:1%
GT: s=1 f=0
東海SK-[CH01] 2026-03-11 08.18.0
原圖
Grad-CAM
FN
smoke:2% fire:1%
GT: s=1 f=0
東海SK-[CH13] 2026-03-12 09.22.0
原圖
Grad-CAM
FN
smoke:17% fire:1%
GT: s=1 f=0
SK大甲_15_20250912092540.mp4
原圖
Grad-CAM
TN
smoke:19% fire:2%
GT: s=0 f=0
東海SK-[CH01] 2026-02-10 16.33.0
原圖
Grad-CAM
TN
smoke:5% fire:1%
GT: s=0 f=0
SK大甲_16_20250626115400.mp4
原圖
Grad-CAM
TN
smoke:1% fire:0%
GT: s=0 f=0
東海-SK[CH03] 2025-07-14 07.35.0
原圖
Grad-CAM
TN
smoke:25% fire:1%
GT: s=0 f=0
SK大甲_16_20250626131700.mp4
原圖
Grad-CAM
TN
smoke:5% fire:3%
GT: s=0 f=0
SK大甲_16_20250626115400.mp4
原圖
Grad-CAM
TN
smoke:20% fire:5%
GT: s=0 f=0
SK[CH02] 2025-01-23 08.08.00
原圖
Grad-CAM
TN
smoke:13% fire:3%
GT: s=0 f=0
SK[CH02] 2025-01-23 08.08.00
原圖
Grad-CAM
TN
smoke:1% fire:0%
GT: s=0 f=0
SK[CH03] 2024-11-16 10.30.00
原圖
Grad-CAM
TN
smoke:2% fire:0%
GT: s=0 f=0
東海-SK[CH03] 2025-07-14 07.35.0
原圖
Grad-CAM
TN
smoke:19% fire:1%
GT: s=0 f=0
SK大甲_16_20250626131700.mp4
原圖
Grad-CAM
TN
smoke:27% fire:1%
GT: s=0 f=0
SK大甲_16_20250626131700.mp4
原圖
Grad-CAM
TN
smoke:5% fire:1%
GT: s=0 f=0
東海SK-[CH16] 2026-03-13 10.42.0
Grad-CAM 熱區圖 — fire
原圖
Grad-CAM
FP
smoke:13% fire:8%
GT: s=1 f=0
東海SK-CH06-test3-AI
原圖
Grad-CAM
FP
smoke:74% fire:6%
GT: s=1 f=0
SK東海-[CH09] 2025-06-04 10.27.0
原圖
Grad-CAM
FP
smoke:71% fire:8%
GT: s=1 f=0
SK東海-[CH09] 2025-06-04 10.27.0
原圖
Grad-CAM
FP
smoke:9% fire:8%
GT: s=1 f=0
SK大甲_15_20241202104500.mp4
原圖
Grad-CAM
FP
smoke:47% fire:13%
GT: s=1 f=0
SK-東海AI-CH-12.mp4
原圖
Grad-CAM
FP
smoke:54% fire:9%
GT: s=1 f=0
SK-東海AI-CH-12.mp4
原圖
Grad-CAM
FP
smoke:61% fire:11%
GT: s=1 f=0
大甲-SK_15_20250924095800.mp4
原圖
Grad-CAM
FP
smoke:12% fire:6%
GT: s=1 f=0
SK-東海AI-CH13-1.mp4
原圖
Grad-CAM
FP
smoke:35% fire:11%
GT: s=1 f=0
SK-東海AI-CH-12.mp4
原圖
Grad-CAM
FP
smoke:77% fire:12%
GT: s=1 f=0
SK東海-[CH09] 2025-06-04 10.27.0
原圖
Grad-CAM
FP
smoke:21% fire:6%
GT: s=1 f=0
SK大甲_15_20241202104500.mp4
原圖
Grad-CAM
FP
smoke:29% fire:12%
GT: s=1 f=0
SK大甲_15_20241202104500.mp4
原圖
Grad-CAM
TN
smoke:94% fire:1%
GT: s=1 f=0
WV+SK_東海[CH01] 2025-07-22 10.5
原圖
Grad-CAM
TN
smoke:3% fire:1%
GT: s=0 f=0
東海SK-[CH02] 2025-12-04 12.29.0
原圖
Grad-CAM
TN
smoke:2% fire:0%
GT: s=0 f=0
SK-[CH16] 2025-12-04 12.29.00.
原圖
Grad-CAM
TN
smoke:64% fire:2%
GT: s=1 f=0
東海SK-[CH04] 2026-02-10 12.13.0
原圖
Grad-CAM
TN
smoke:28% fire:1%
GT: s=0 f=0
SK大甲_16_20250626131700.mp4
原圖
Grad-CAM
TN
smoke:19% fire:2%
GT: s=0 f=0
東海SK-[CH01] 2026-02-10 16.33.0
原圖
Grad-CAM
TN
smoke:2% fire:1%
GT: s=0 f=0
東海SK-[CH04] 2026-03-15 10.30.0
原圖
Grad-CAM
TN
smoke:5% fire:1%
GT: s=1 f=0
東海SK-[CH16] 2026-03-13 13.40.0
原圖
Grad-CAM
TN
smoke:100% fire:0%
GT: s=1 f=0
東海SK-CH07-AI加強-train
原圖
Grad-CAM
TN
smoke:1% fire:0%
GT: s=0 f=0
SK[CH03] 2024-11-16 10.30.00
原圖
Grad-CAM
TN
smoke:44% fire:3%
GT: s=1 f=0
大甲-SK_15_20250924095800.mp4
原圖
Grad-CAM
TN
smoke:36% fire:1%
GT: s=1 f=0
東海SK-[CH01] 2026-03-11 16.45.0