Document

Ego-view Accident Video Classification Evaluation

This is our accident video classification benchmark. In the benchmarking stage, six state-of-the-art methods are evaluated from different video frame sampling methods, frame mixup strategy, input frame length, and the adaptation for long-tailed accident distribution; we calculate the top1, top5, top10, Precision, Recall, and F1_score values.

NOTE: You can submit your metric values via the provided form. Furthermore, we would highly appreciate for your contribution with clear links to relevant articles and code for more in-depth analysis.

the result please submit here:

ID	Method	Year	mixup	top1	top5	top10	Precision	Recall	F1_score	Runtime	Environment	Code	Paper

ID	Method	Year	Code	size	mixup	top1	top5	top10	Precision	Recall	F1_score	Runtime	Environment
1	3D ResNets-50	2018	Code	8x112	no-mixup	19.23 %	46.33 %	61.15 %	0.18 %	0.19 %	0.13 %	...	GeForce RTX 3090
2	3D ResNets-50	2018	Code	8x112	mixup0.8	27.73 %	61.50 %	75.79 %	0.24 %	0.28 %	0.20 %	...	GeForce RTX 3090
3	3D ResNets-50	2018	Code	16x112	no-mixup	19.34 %	45.99 %	59.08 %	0.17 %	0.19 %	0.13 %	...	GeForce RTX 3090
4	3D ResNets-50	2018	Code	16x112	mixup0.8	29.04 %	58.59 %	71.88 %	0.28 %	0.29 %	0.20 %	...	GeForce RTX 3090
5	Timesformer	2021	Code	8x224	no-mixup	35.87 %	70.41 %	80.31 %	0.34 %	0.36 %	0.31 %	...	GeForce RTX 3090
6	Timesformer	2021	Code	8x224	mixup0.8	34.74 %	68.45 %	79.41 %	0.35 %	0.35 %	0.28 %	...	GeForce RTX 3090
7	Timesformer	2021	Code	16x224	no-mixup	35.55 %	70.59 %	81.22 %	0.35 %	0.36 %	0.30 %	...	GeForce RTX 3090
8	Timesformer	2021	Code	16x224	mixup0.8	34.27 %	68.02 %	79.82 %	0.37 %	0.34 %	0.28 %	...	GeForce RTX 3090
9	TokenShift Transformer	2021	Code	8x224	no-mixup	33.10 %	67.58 %	79.58 %	0.32 %	0.35 %	0.28 %	...	GeForce RTX 3090
10	TokenShift Transformer	2021	Code	8x224	mixup0.8	33.97 %	66.02 %	77.68 %	0.30 %	0.34 %	0.27 %	...	GeForce RTX 3090
11	TokenShift Transformer	2021	Code	16x224	no-mixup	33.88 %	71.79 %	82.33 %	0.33 %	0.34 %	0.30 %	...	GeForce RTX 3090
12	TokenShift Transformer	2021	Code	16x224	mixup0.8	34.63 %	68.18 %	79.87 %	0.32 %	0.35 %	0.28 %	...	GeForce RTX 3090
13	ActionCLIP	2021	Code	8x224	no-mixup	38.92 %	71.14 %	81.90 %	0.41 %	0.39 %	0.38 %	...	GeForce RTX 3090
14	ActionCLIP	2021	Code	16x224	no-mixup	38.78 %	74.17 %	85.68 %	0.39 %	0.39 %	0.38 %	...	GeForce RTX 3090
15	Efficient Prompt	2022	Code	8x224	no-mixup	32.08 %	69.54 %	83.04 %	0.30 %	0.32 %	0.30 %	...	GeForce RTX 3090
16	Efficient Prompt	2022	Code	8x224	mixup0.8	27.90 %	65.16 %	82.21 %	0.20 %	0.28 %	0.20 %	...	GeForce RTX 3090
17	Efficient Prompt	2022	Code	16x224	no-mixup	29.14 %	67.93 %	81.19 %	0.25 %	0.29 %	0.27 %	...	GeForce RTX 3090
18	Efficient Prompt	2022	Code	16x224	mixup0.8	31.14 %	66.35 %	79.57 %	0.29 %	0.31 %	0.08 %	...	GeForce RTX 3090
19	X-CLIP	2022	Code	8x224	no-mixup	39.17 %	73.84 %	83.69 %	0.39 %	0.39 %	0.36 %	...	GeForce RTX 3090
20	X-CLIP	2022	Code	8x224	mixup0.8	41.39 %	76.61 %	89.53 %	0.41 %	0.41 %	0.37 %	...	GeForce RTX 3090
21	X-CLIP	2022	Code	16x224	no-mixup	37.53 %	75.28 %	87.60 %	0.36 %	0.38 %	0.21 %	...	GeForce RTX 3090
22	X-CLIP	2022	Code	16x224	mixup0.8	37.15 %	73.55 %	85.17 %	0.39 %	0.37 %	0.32 %	...	GeForce RTX 3090