release the K400 pre-trained models and logs

lijie2160 · Mar 26, 2021 · d51dba7 · d51dba7
1 parent 67e9c0c
commit d51dba7
Show file tree

Hide file tree

Showing 138 changed files with 140 additions and 26 deletions.
diff --git a/.gitignore b/.gitignore
@@ -0,0 +1,122 @@
+# Byte-compiled / optimized / DLL files
+*/__pycache__
+__pycache__/
+*.py[cod]
+*$py.class
+
+# C extensions
+*.so
+
+# Distribution / packaging
+.Python
+env/
+build/
+develop-eggs/
+dist/
+downloads/
+eggs/
+.eggs/
+lib/
+lib64/
+parts/
+sdist/
+var/
+wheels/
+*.egg-info/
+.installed.cfg
+*.egg
+
+# PyInstaller
+#  Usually these files are written by a python script from a template
+#  before PyInstaller builds the exe, so as to inject date/other infos into it.
+*.manifest
+*.spec
+
+# Installer logs
+pip-log.txt
+pip-delete-this-directory.txt
+
+# Unit test / coverage reports
+htmlcov/
+.tox/
+.coverage
+.coverage.*
+.cache
+nosetests.xml
+coverage.xml
+*.cover
+.hypothesis/
+
+# Translations
+*.mo
+*.pot
+
+# Django stuff:
+# *.log
+local_settings.py
+
+# Flask stuff:
+instance/
+.webassets-cache
+
+# Scrapy stuff:
+.scrapy
+
+# Sphinx documentation
+docs/_build/
+
+# PyBuilder
+target/
+
+# Jupyter Notebook
+.ipynb_checkpoints
+
+# pyenv
+.python-version
+
+# celery beat schedule file
+celerybeat-schedule
+
+# SageMath parsed files
+*.sage.py
+
+# dotenv
+.env
+
+# virtualenv
+.venv
+venv/
+ENV/
+
+# Spyder project settings
+.spyderproject
+.spyproject
+
+# Rope project settings
+.ropeproject
+
+# mkdocs documentation
+/site
+
+# mypy
+.mypy_cache/
+
+.DS_Store
+
+.vscode
+
+
+#my ignore
+# pretrained/*
+experiments/*
+*.bk
+*.npy
+*.pth
+*.pth.tar
+*.official
+tmp/
+*.pkl
+*.csv
+logs/*
+.default.pkl
+datalist/kinetics400
diff --git a/History.md b/History.md
diff --git a/LICENSE b/LICENSE
@@ -1,3 +1,4 @@
+Copyright (c) 2020 MCG-NJU. All rights reserved.
                                  Apache License
                            Version 2.0, January 2004
                         http://www.apache.org/licenses/
@@ -186,7 +187,7 @@
       same "printed page" as the copyright notice for easier
       identification within third-party archives.
 
-   Copyright [yyyy] [name of copyright owner]
+   Copyright (c) 2020 MCG-NJU
 
    Licensed under the Apache License, Version 2.0 (the "License");
    you may not use this file except in compliance with the License.
@@ -198,4 +199,4 @@
    distributed under the License is distributed on an "AS IS" BASIS,
    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
    See the License for the specific language governing permissions and
-   limitations under the License.
+   limitations under the License.
diff --git a/README.md b/README.md
@@ -1,5 +1,5 @@
 # MVFNet: Multi-View Fusion Network for Efficient Video Recognition (AAAI 2021)
-![1](./mvfnet.png)  
+![1](mvfnet.png)  
 
 
 ## Overview
@@ -36,24 +36,25 @@ cd pretrained
 sh download_imgnet.sh
 ```
 - Download K400 pre-trained models
-TODO
+
+Please refer to [Model Zoo](#model-zoo).
 
 
 ## Data Preparation
-Please refer to [DATA](./data_process/DATASETS.md) for data preparation.
+Please refer to [DATASETS.md](./data_process/DATASETS.md) for data preparation.
 
 
 
 ## Model Zoo
 
-| Architecture | Dataset | T x interval |  Top-1 Acc. | Pre-trained model |
-|:------------:|:-------------------:|:------------------:|:-----------------:|:--------------:|
-|     MVFNet-ResNet50    |     Kinetics-400    |        4x16       |   74.2%   |   [Download link](...) |
-|     MVFNet-ResNet50    |     Kinetics-400    |        8x8       |   76.0%   |   [Download link](...) |
-|     MVFNet-ResNet50    |     Kinetics-400    |        16x4       |   77.0%   |   [Download link](...) |
-|     MVFNet-ResNet101    |     Kinetics-400    |        4x16       |    76.0%  |   [Download link](...) |
-|     MVFNet-ResNet101    |     Kinetics-400    |        8x8       |    77.4%  |   [Download link](...) |
-|     MVFNet-ResNet101    |     Kinetics-400    |        16x4       |   78.4%   |   [Download link](...)|
+| Architecture | Dataset | T x interval |  Top-1 Acc. | Pre-trained model | Train log| Test log|
+|:------------:|:-------------------:|:------------------:|:-----------------:|:--------------:|:--------------:|:--------------:|
+|     MVFNet-ResNet50    |     Kinetics-400    |        4x16       |   74.2%   |   [Download link](https://github.com/whwu95/MVFNet/releases/download/v0.2/R50_4x16.pth) | [Log link](https://github.com/whwu95/MVFNet/releases/download/v0.2/R50_4x16_1080Ti_Train.log)| [Log link](https://github.com/whwu95/MVFNet/releases/download/v0.2/R50_4x16_Test.txt)|
+|     MVFNet-ResNet50    |     Kinetics-400    |        8x8       |   76.0%   |   [Download link](https://github.com/whwu95/MVFNet/releases/download/v0.2/R50_8x8.pth) | Miss| [Log link](https://github.com/whwu95/MVFNet/releases/download/v0.2/R50_8x8_Test.txt)|
+|     MVFNet-ResNet50    |     Kinetics-400    |        16x4       |   77.0%   |   [Download link](https://github.com/whwu95/MVFNet/releases/download/v0.2/R50_16x4.pth) | [Log link](https://github.com/whwu95/MVFNet/releases/download/v0.2/R50_16x4_P40_Train.log)| [Log link](https://github.com/whwu95/MVFNet/releases/download/v0.2/R50_16x4_Test.txt)|
+|     MVFNet-ResNet101    |     Kinetics-400    |        4x16       |    76.0%  |   [Download link](https://github.com/whwu95/MVFNet/releases/download/v0.2/R101_4x16.pth) | [Log link](.https://github.com/whwu95/MVFNet/releases/download/v0.2/R101_4x16_1080Ti_Train.log)| [Log link](https://github.com/whwu95/MVFNet/releases/download/v0.2/R101_4x16_Test.txt)|
+|     MVFNet-ResNet101    |     Kinetics-400    |        8x8       |    77.4%  |   [Download link](https://github.com/whwu95/MVFNet/releases/download/v0.2/R101_8x8.pth) | [Log link](https://github.com/whwu95/MVFNet/releases/download/v0.2/R101_8x8_P40_Train.log)| [Log link](https://github.com/whwu95/MVFNet/releases/download/v0.2/R101_8x8_Test.txt)|
+|     MVFNet-ResNet101    |     Kinetics-400    |        16x4       |   78.4%   |   [Download link](https://github.com/whwu95/MVFNet/releases/download/v0.2/R101_16x4.pth) | [Log link](.https://github.com/whwu95/MVFNet/releases/download/v0.2/R101_16x4_P40_Train.log)| [Log link](https://github.com/whwu95/MVFNet/releases/download/v0.2/R101_16x4_Test.txt)|
 
 
 

diff --git a/codes/core/__init__.py b/codes/core/__init__.py
diff --git a/codes/core/dist_utils.py b/codes/core/dist_utils.py
diff --git a/codes/core/evaluation/__init__.py b/codes/core/evaluation/__init__.py
diff --git a/codes/core/evaluation/accuracy.py b/codes/core/evaluation/accuracy.py
diff --git a/codes/core/evaluation/eval_hooks.py b/codes/core/evaluation/eval_hooks.py
diff --git a/codes/core/evaluation/parallel_test.py b/codes/core/evaluation/parallel_test.py
diff --git a/codes/core/fp16/__init__.py b/codes/core/fp16/__init__.py
diff --git a/codes/core/fp16/decorators.py b/codes/core/fp16/decorators.py
diff --git a/codes/core/fp16/hooks.py b/codes/core/fp16/hooks.py
diff --git a/codes/core/fp16/utils.py b/codes/core/fp16/utils.py
diff --git a/codes/core/parallel/__init__.py b/codes/core/parallel/__init__.py
diff --git a/codes/core/parallel/_functions.py b/codes/core/parallel/_functions.py
diff --git a/codes/core/parallel/collate.py b/codes/core/parallel/collate.py
diff --git a/codes/core/parallel/data_container.py b/codes/core/parallel/data_container.py
diff --git a/codes/core/parallel/data_parallel.py b/codes/core/parallel/data_parallel.py
diff --git a/codes/core/parallel/distributed.py b/codes/core/parallel/distributed.py
diff --git a/codes/core/parallel/scatter_gather.py b/codes/core/parallel/scatter_gather.py
diff --git a/codes/core/test.py b/codes/core/test.py
diff --git a/codes/core/train.py b/codes/core/train.py
diff --git a/codes/datasets/__init__.py b/codes/datasets/__init__.py
diff --git a/codes/datasets/base.py b/codes/datasets/base.py
diff --git a/codes/datasets/builder.py b/codes/datasets/builder.py
diff --git a/codes/datasets/loader/__init__.py b/codes/datasets/loader/__init__.py
diff --git a/codes/datasets/loader/build_loader.py b/codes/datasets/loader/build_loader.py
diff --git a/codes/datasets/loader/sampler.py b/codes/datasets/loader/sampler.py
diff --git a/codes/datasets/pipelines/__init__.py b/codes/datasets/pipelines/__init__.py
diff --git a/codes/datasets/pipelines/augmentations.py b/codes/datasets/pipelines/augmentations.py
diff --git a/codes/datasets/pipelines/compose.py b/codes/datasets/pipelines/compose.py
diff --git a/codes/datasets/pipelines/formating.py b/codes/datasets/pipelines/formating.py
diff --git a/codes/datasets/pipelines/loading.py b/codes/datasets/pipelines/loading.py
diff --git a/codes/datasets/pkl_dataset.py b/codes/datasets/pkl_dataset.py
diff --git a/codes/datasets/rawframes_dataset.py b/codes/datasets/rawframes_dataset.py
diff --git a/codes/datasets/video_dataset.py b/codes/datasets/video_dataset.py
diff --git a/codes/models/__init__.py b/codes/models/__init__.py
diff --git a/codes/models/backbones/__init__.py b/codes/models/backbones/__init__.py
diff --git a/codes/models/backbones/bninception.py b/codes/models/backbones/bninception.py
diff --git a/codes/models/backbones/inception_v1_i3d.py b/codes/models/backbones/inception_v1_i3d.py
diff --git a/codes/models/backbones/mobilenet_v2.py b/codes/models/backbones/mobilenet_v2.py
diff --git a/codes/models/backbones/resnet.py b/codes/models/backbones/resnet.py
diff --git a/codes/models/backbones/resnet_i3d.py b/codes/models/backbones/resnet_i3d.py
diff --git a/codes/models/backbones/resnet_i3d_slowfast.py b/codes/models/backbones/resnet_i3d_slowfast.py
diff --git a/codes/models/backbones/resnet_r3d.py b/codes/models/backbones/resnet_r3d.py
diff --git a/codes/models/backbones/resnet_r3d_utils.py b/codes/models/backbones/resnet_r3d_utils.py
diff --git a/codes/models/backbones/resnet_x3d.py b/codes/models/backbones/resnet_x3d.py
diff --git a/codes/models/builder.py b/codes/models/builder.py
diff --git a/codes/models/common/__init__.py b/codes/models/common/__init__.py
diff --git a/codes/models/common/conv_module.py b/codes/models/common/conv_module.py
diff --git a/codes/models/common/misc.py b/codes/models/common/misc.py
diff --git a/codes/models/common/norm.py b/codes/models/common/norm.py
diff --git a/codes/models/common/se_module.py b/codes/models/common/se_module.py
diff --git a/codes/models/heads/__init__.py b/codes/models/heads/__init__.py
diff --git a/codes/models/heads/base.py b/codes/models/heads/base.py
diff --git a/codes/models/heads/i3d_clshead.py b/codes/models/heads/i3d_clshead.py
diff --git a/codes/models/heads/i3d_slowfast_clshead.py b/codes/models/heads/i3d_slowfast_clshead.py
diff --git a/codes/models/heads/segmental_consensuses/__init__.py b/codes/models/heads/segmental_consensuses/__init__.py
diff --git a/codes/models/heads/segmental_consensuses/relation_consensus.py b/codes/models/heads/segmental_consensuses/relation_consensus.py
diff --git a/codes/models/heads/segmental_consensuses/simple_consensus.py b/codes/models/heads/segmental_consensuses/simple_consensus.py
diff --git a/codes/models/heads/tsn_clshead.py b/codes/models/heads/tsn_clshead.py
diff --git a/codes/models/modules/CoST.py b/codes/models/modules/CoST.py
diff --git a/codes/models/modules/__init__.py b/codes/models/modules/__init__.py
diff --git a/codes/models/modules/local_attention.py b/codes/models/modules/local_attention.py
diff --git a/codes/models/recognizers/__init__.py b/codes/models/recognizers/__init__.py
diff --git a/codes/models/recognizers/base.py b/codes/models/recognizers/base.py
diff --git a/codes/models/recognizers/recognizer2d.py b/codes/models/recognizers/recognizer2d.py
diff --git a/codes/models/recognizers/recognizer3d.py b/codes/models/recognizers/recognizer3d.py
diff --git a/codes/models/recognizers/recognizerc2d.py b/codes/models/recognizers/recognizerc2d.py
diff --git a/codes/utils/__init__.py b/codes/utils/__init__.py
diff --git a/codes/utils/checkpoint.py b/codes/utils/checkpoint.py
diff --git a/codes/utils/file_client.py b/codes/utils/file_client.py
diff --git a/codes/utils/flops_hook.py b/codes/utils/flops_hook.py
diff --git a/codes/utils/logger.py b/codes/utils/logger.py
diff --git a/codes/utils/misc.py b/codes/utils/misc.py
diff --git a/codes/utils/registry.py b/codes/utils/registry.py
diff --git a/configs/MVFNet/K400/mvf_kinetics400_2d_rgb_r101_dense.py b/configs/MVFNet/K400/mvf_kinetics400_2d_rgb_r101_dense.py
@@ -21,7 +21,7 @@
     type='Recognizer2D',
     backbone=dict(
         type='ResNet',
-        pretrained='pretrained/resnet50.pth',
+        pretrained='pretrained/resnet101.pth',
         depth=101,
         out_indices=(3,),
         norm_eval=False,

diff --git a/configs/MVFNet/K400/mvf_kinetics400_2d_rgb_r50_dense.py b/configs/MVFNet/K400/mvf_kinetics400_2d_rgb_r50_dense.py
diff --git a/count_flops.py b/count_flops.py
diff --git a/data_process/DATASETS.md b/data_process/DATASETS.md
diff --git a/data_process/annotation/hmdb51/category.txt b/data_process/annotation/hmdb51/category.txt
diff --git a/data_process/annotation/hmdb51/testlist01.txt b/data_process/annotation/hmdb51/testlist01.txt
diff --git a/data_process/annotation/hmdb51/testlist02.txt b/data_process/annotation/hmdb51/testlist02.txt
diff --git a/data_process/annotation/hmdb51/testlist03.txt b/data_process/annotation/hmdb51/testlist03.txt
diff --git a/data_process/annotation/hmdb51/trainlist01.txt b/data_process/annotation/hmdb51/trainlist01.txt
diff --git a/data_process/annotation/hmdb51/trainlist02.txt b/data_process/annotation/hmdb51/trainlist02.txt
diff --git a/data_process/annotation/hmdb51/trainlist03.txt b/data_process/annotation/hmdb51/trainlist03.txt
diff --git a/data_process/annotation/kinetics600/kinetics-600_label_map.txt b/data_process/annotation/kinetics600/kinetics-600_label_map.txt
diff --git a/data_process/annotation/sthv2/something-something-v2-labels.json b/data_process/annotation/sthv2/something-something-v2-labels.json
diff --git a/data_process/annotation/sthv2/something-something-v2-test.json b/data_process/annotation/sthv2/something-something-v2-test.json
diff --git a/data_process/annotation/sthv2/something-something-v2-train.json b/data_process/annotation/sthv2/something-something-v2-train.json
diff --git a/data_process/annotation/sthv2/something-something-v2-validation.json b/data_process/annotation/sthv2/something-something-v2-validation.json
diff --git a/data_process/annotation/ucf101/testlist01.txt b/data_process/annotation/ucf101/testlist01.txt
diff --git a/data_process/annotation/ucf101/testlist02.txt b/data_process/annotation/ucf101/testlist02.txt
diff --git a/data_process/annotation/ucf101/testlist03.txt b/data_process/annotation/ucf101/testlist03.txt
diff --git a/data_process/annotation/ucf101/trainlist01.txt b/data_process/annotation/ucf101/trainlist01.txt
diff --git a/data_process/annotation/ucf101/trainlist02.txt b/data_process/annotation/ucf101/trainlist02.txt
diff --git a/data_process/annotation/ucf101/trainlist03.txt b/data_process/annotation/ucf101/trainlist03.txt
diff --git a/data_process/gen_10s_video.py b/data_process/gen_10s_video.py
diff --git a/data_process/gen_k400_pkl.py b/data_process/gen_k400_pkl.py
diff --git a/data_process/gen_label.py b/data_process/gen_label.py
diff --git a/data_process/gen_videos_info.py b/data_process/gen_videos_info.py
diff --git a/data_process/make_balance.py b/data_process/make_balance.py
diff --git a/data_process/mp_mv.py b/data_process/mp_mv.py
diff --git a/data_process/rename_video.py b/data_process/rename_video.py
diff --git a/data_process/slurm_run.sh b/data_process/slurm_run.sh
diff --git a/data_process/video_resize.py b/data_process/video_resize.py
diff --git a/datalist/hmdb51/train_rgb_split_1.txt b/datalist/hmdb51/train_rgb_split_1.txt
diff --git a/datalist/hmdb51/train_rgb_split_2.txt b/datalist/hmdb51/train_rgb_split_2.txt
diff --git a/datalist/hmdb51/train_rgb_split_3.txt b/datalist/hmdb51/train_rgb_split_3.txt
diff --git a/datalist/hmdb51/val_rgb_split_1.txt b/datalist/hmdb51/val_rgb_split_1.txt
diff --git a/datalist/hmdb51/val_rgb_split_2.txt b/datalist/hmdb51/val_rgb_split_2.txt
diff --git a/datalist/hmdb51/val_rgb_split_3.txt b/datalist/hmdb51/val_rgb_split_3.txt
diff --git a/datalist/sthv1/train_rgb.txt b/datalist/sthv1/train_rgb.txt
diff --git a/datalist/sthv1/val_rgb.txt b/datalist/sthv1/val_rgb.txt
diff --git a/datalist/ucf101/train_flow_split_1.txt b/datalist/ucf101/train_flow_split_1.txt
diff --git a/datalist/ucf101/train_flow_split_2.txt b/datalist/ucf101/train_flow_split_2.txt
diff --git a/datalist/ucf101/train_flow_split_3.txt b/datalist/ucf101/train_flow_split_3.txt
diff --git a/datalist/ucf101/train_rgb_split_1.txt b/datalist/ucf101/train_rgb_split_1.txt
diff --git a/datalist/ucf101/train_rgb_split_2.txt b/datalist/ucf101/train_rgb_split_2.txt
diff --git a/datalist/ucf101/train_rgb_split_3.txt b/datalist/ucf101/train_rgb_split_3.txt
diff --git a/datalist/ucf101/train_video_split_1.txt b/datalist/ucf101/train_video_split_1.txt
diff --git a/datalist/ucf101/val_flow_split_1.txt b/datalist/ucf101/val_flow_split_1.txt
diff --git a/datalist/ucf101/val_flow_split_2.txt b/datalist/ucf101/val_flow_split_2.txt
diff --git a/datalist/ucf101/val_flow_split_3.txt b/datalist/ucf101/val_flow_split_3.txt
diff --git a/datalist/ucf101/val_rgb_split_1.txt b/datalist/ucf101/val_rgb_split_1.txt
diff --git a/datalist/ucf101/val_rgb_split_2.txt b/datalist/ucf101/val_rgb_split_2.txt
diff --git a/datalist/ucf101/val_rgb_split_3.txt b/datalist/ucf101/val_rgb_split_3.txt
diff --git a/datalist/ucf101/val_video_split_1.txt b/datalist/ucf101/val_video_split_1.txt
diff --git a/mvfnet.png b/mvfnet.png
diff --git a/pretrained/download_imgnet.sh b/pretrained/download_imgnet.sh
@@ -0,0 +1,2 @@
+wget https://github.com/whwu95/MVFNet/releases/download/v0.1/resnet50.pth
+wget https://github.com/whwu95/MVFNet/releases/download/v0.1/resnet101.pth
diff --git a/report_accuracy.py b/report_accuracy.py
diff --git a/requirements.txt b/requirements.txt
diff --git a/scripts/dist_test_recognizer.sh b/scripts/dist_test_recognizer.sh
diff --git a/scripts/env_vision.sh b/scripts/env_vision.sh
diff --git a/test_recognizer.py b/test_recognizer.py
diff --git a/train_recognizer.py b/train_recognizer.py
Original file line number	Diff line number	Diff line change
		@@ -0,0 +1,2 @@
		wget https://github.com/whwu95/MVFNet/releases/download/v0.1/resnet50.pth
		wget https://github.com/whwu95/MVFNet/releases/download/v0.1/resnet101.pth