-
Notifications
You must be signed in to change notification settings - Fork 140
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
1. Revise filter methods as a part of the post-processing methods 2. Add DeciWatch as a speed-up method for demo inference, which can achieve both better inference speed and precision for image-based pose estimation models (e.g. HMR, SPIN). By choosing DeciWatch as a speed-up strategy, demo inference speed can boost from roughly 50 frames/s to 240 frames/s with interval = 5, and to 470 frames/s with interval = 10. (On Tesla V100 GPU)
- Loading branch information
Showing
29 changed files
with
1,514 additions
and
156 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,33 @@ | ||
# DeciWatch | ||
## Introduction | ||
|
||
We provide the config files for DeciWatch: [DeciWatch: A Simple Baseline for 10x Efficient 2D and 3D Pose Estimation](https://arxiv.org/pdf/2203.08713.pdf). | ||
|
||
```BibTeX | ||
@article{zeng2022deciwatch, | ||
title={DeciWatch: A Simple Baseline for 10x Efficient 2D and 3D Pose Estimation}, | ||
author={Zeng, Ailing and Ju, Xuan and Yang, Lei and Gao, Ruiyuan and Zhu, Xizhou and Dai, Bo and Xu, Qiang}, | ||
journal={arXiv preprint arXiv:2203.08713}, | ||
year={2022} | ||
} | ||
``` | ||
|
||
## Notes | ||
|
||
We use checkpoints trained on SPIN-3DPW for demo speed up. Checkpoints with different intervals and q values are provided. If you need more checkpoints trained on various datasets and backbones, please refer to the [official implementation of DeciWatch](https://github.com/cure-lab/DeciWatch). | ||
|
||
|
||
| Interval | Window Q |Config | Download | Speed Up | Precision Improvement (MPJPE In/Out) | | ||
|:------:|:-------:|:------:|:------:|:------:|:------:| | ||
| 10 | 1 |[deciwatch_interval10_q1](deciwatch_interval10_q1.py)| [model](https://openmmlab-share.oss-cn-hangzhou.aliyuncs.com/mmhuman3d/models/deciwatch/deciwatch_interval10_q1.pth.tar?versionId=CAEQOhiBgMChhsS9gxgiIDM5OGUwZGY0MTc4NTQ2M2NhZDEwMzU5MWUzMWNmZjY1)| 10X |99.35 / 95.85| | ||
| 10 | 2 |[deciwatch_interval10_q2](deciwatch_interval10_q2.py)| [model](https://openmmlab-share.oss-cn-hangzhou.aliyuncs.com/mmhuman3d/models/deciwatch/deciwatch_interval10_q2.pth.tar?versionId=CAEQOhiBgICau8O9gxgiIDk1Y2Y0MzUxMmY0MDQzZThiYzhkMGJlMjc3ZDQ2NTQ2)| 10X | 99.45 / 96.37| | ||
| 10 | 3 |[deciwatch_interval10_q3](deciwatch_interval10_q3.py)| [model](https://openmmlab-share.oss-cn-hangzhou.aliyuncs.com/mmhuman3d/models/deciwatch/deciwatch_interval10_q3.pth.tar?versionId=CAEQOhiBgICIq8O9gxgiIDZiMjEzMjY3ODA4MTQwNGY5NTU3OWNkZjRjZjI2ZDFi)| 10X | 99.60 / 96.98 | | ||
| 10 | 4 |[deciwatch_interval10_q4](deciwatch_interval10_q4.py)| [model](https://openmmlab-share.oss-cn-hangzhou.aliyuncs.com/mmhuman3d/models/deciwatch/deciwatch_interval10_q4.pth.tar?versionId=CAEQOhiBgICUq8O9gxgiIDJkZjUwYWJmNTRkNjQxMDE4YmUyNWMwNTcwNGQ4M2Ix)| 10X | 99.58 / 96.87 | | ||
| 10 | 5 |[deciwatch_interval10_q5](deciwatch_interval10_q5.py)| [model](https://openmmlab-share.oss-cn-hangzhou.aliyuncs.com/mmhuman3d/models/deciwatch/deciwatch_interval10_q5.pth.tar?versionId=CAEQOhiBgMCN7MS9gxgiIDUwNGFhM2Y0MGI3MjRiYWQ5NzZjODMwMDk3ZjU1OTk3)| 10X | 99.78 / 97.39 | | ||
| 5 | 1 |[deciwatch_interval5_q1](deciwatch_interval5_q1.py)| [model](https://openmmlab-share.oss-cn-hangzhou.aliyuncs.com/mmhuman3d/models/deciwatch/deciwatch_interval5_q1.pth.tar?versionId=CAEQOhiBgIDfocS9gxgiIDkxN2Y3OWQzZmJiMTQyMTM5NWZhZTYxYmI0MDlmMDBh) | 5X |99.31 / 95.05 | | ||
| 5 | 2 |[deciwatch_interval5_q2](deciwatch_interval5_q2.py)| [model](https://openmmlab-share.oss-cn-hangzhou.aliyuncs.com/mmhuman3d/models/deciwatch/deciwatch_interval5_q2.pth.tar?versionId=CAEQOhiBgIDgu8O9gxgiIDNjMDEyOWQ3NjRkODQ2YTI5MjUxYWU4NzhjOTc1YTRj) | 5X | 99.35 / 95.05 | | ||
| 5 | 3 |[deciwatch_interval5_q3](deciwatch_interval5_q3.py)| [model](https://openmmlab-share.oss-cn-hangzhou.aliyuncs.com/mmhuman3d/models/deciwatch/deciwatch_interval5_q3.pth.tar?versionId=CAEQOhiBgIDJs8O9gxgiIDk1MDExMjI5Y2U1MDRmZjViMDBjOGU5YzY3OTRlNmE5) | 5X | 99.45 / 94.84 | | ||
| 5 | 4 |[deciwatch_interval5_q4](deciwatch_interval5_q4.py)| [model](https://openmmlab-share.oss-cn-hangzhou.aliyuncs.com/mmhuman3d/models/deciwatch/deciwatch_interval5_q4.pth.tar?versionId=CAEQOhiBgMC.t8O9gxgiIGZjZWY3OTdhNGRjZjQyNjY5MGU5YzkxZTZjMWU1MTA2) |5X | 99.45 / 94.94 | | ||
| 5 | 5 |[deciwatch_interval5_q5](deciwatch_interval5_q5.py)| [model](https://openmmlab-share.oss-cn-hangzhou.aliyuncs.com/mmhuman3d/models/deciwatch/deciwatch_interval5_q5.pth.tar?versionId=CAEQOhiBgMCyq8O9gxgiIDRjMzViMjllNWRiNjRlMzA5ZjczYWIxOGU2OGFkYjdl) |5X | 99.55 / 94.48 | | ||
|
||
To use different settings of DeciWatch in demo, specify `--speed_up_type` with the checkpoint name. For example, you may use `--speed_up_type deciwatch_interval10_q3` for 10X speed up with a window size of 31. Simply set `--speed_up_type deciwatch` to use default setting `deciwatch_interval5_q3`. The meaning of interval and q can be found in the original paper. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,10 @@ | ||
# Config for DeciWatch trained on PW3D dataset with an interval of 10, | ||
# window size of 1 + 10*1(where q=1). | ||
# The model is trained only on SMPL pose parameters. | ||
speed_up_cfg = dict( | ||
type='deciwatch', | ||
interval=10, | ||
slide_window_q=1, | ||
checkpoint='https://openmmlab-share.oss-cn-hangzhou.aliyuncs.com/' | ||
'mmhuman3d/models/deciwatch/deciwatch_interval10_q1.pth.tar?versionId=' | ||
'CAEQOhiBgMChhsS9gxgiIDM5OGUwZGY0MTc4NTQ2M2NhZDEwMzU5MWUzMWNmZjY1') |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,10 @@ | ||
# Config for DeciWatch trained on PW3D dataset with an interval of 10, | ||
# window size of 1 + 10*2(where q=2). | ||
# The model is trained only on SMPL pose parameters. | ||
speed_up_cfg = dict( | ||
type='deciwatch', | ||
interval=10, | ||
slide_window_q=2, | ||
checkpoint='https://openmmlab-share.oss-cn-hangzhou.aliyuncs.com/' | ||
'mmhuman3d/models/deciwatch/deciwatch_interval10_q2.pth.tar?versionId=' | ||
'CAEQOhiBgICau8O9gxgiIDk1Y2Y0MzUxMmY0MDQzZThiYzhkMGJlMjc3ZDQ2NTQ2') |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,10 @@ | ||
# Config for DeciWatch trained on PW3D dataset with an interval of 10, | ||
# window size of 1 + 10*3(where q=3). | ||
# The model is trained only on SMPL pose parameters. | ||
speed_up_cfg = dict( | ||
type='deciwatch', | ||
interval=10, | ||
slide_window_q=3, | ||
checkpoint='https://openmmlab-share.oss-cn-hangzhou.aliyuncs.com/' | ||
'mmhuman3d/models/deciwatch/deciwatch_interval10_q3.pth.tar?versionId=' | ||
'CAEQOhiBgICIq8O9gxgiIDZiMjEzMjY3ODA4MTQwNGY5NTU3OWNkZjRjZjI2ZDFi') |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,10 @@ | ||
# Config for DeciWatch trained on PW3D dataset with an interval of 10, | ||
# window size of 1 + 10*4(where q=4). | ||
# The model is trained only on SMPL pose parameters. | ||
speed_up_cfg = dict( | ||
type='deciwatch', | ||
interval=10, | ||
slide_window_q=4, | ||
checkpoint='https://openmmlab-share.oss-cn-hangzhou.aliyuncs.com/' | ||
'mmhuman3d/models/deciwatch/deciwatch_interval10_q4.pth.tar?versionId=' | ||
'CAEQOhiBgICUq8O9gxgiIDJkZjUwYWJmNTRkNjQxMDE4YmUyNWMwNTcwNGQ4M2Ix') |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,10 @@ | ||
# Config for DeciWatch trained on PW3D dataset with an interval of 10, | ||
# window size of 1 + 10*5(where q=5). | ||
# The model is trained only on SMPL pose parameters. | ||
speed_up_cfg = dict( | ||
type='deciwatch', | ||
interval=10, | ||
slide_window_q=5, | ||
checkpoint='https://openmmlab-share.oss-cn-hangzhou.aliyuncs.com/' | ||
'mmhuman3d/models/deciwatch/deciwatch_interval10_q5.pth.tar?versionId=' | ||
'CAEQOhiBgMCN7MS9gxgiIDUwNGFhM2Y0MGI3MjRiYWQ5NzZjODMwMDk3ZjU1OTk3') |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,10 @@ | ||
# Config for DeciWatch trained on PW3D dataset with an interval of 5, | ||
# window size of 1 + 5*1(where q=1). | ||
# The model is trained only on SMPL pose parameters. | ||
speed_up_cfg = dict( | ||
type='deciwatch', | ||
interval=5, | ||
slide_window_q=1, | ||
checkpoint='https://openmmlab-share.oss-cn-hangzhou.aliyuncs.com/' | ||
'mmhuman3d/models/deciwatch/deciwatch_interval5_q1.pth.tar?versionId=' | ||
'CAEQOhiBgIDfocS9gxgiIDkxN2Y3OWQzZmJiMTQyMTM5NWZhZTYxYmI0MDlmMDBh') |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,10 @@ | ||
# Config for DeciWatch trained on PW3D dataset with an interval of 5, | ||
# window size of 1 + 5*2(where q=2). | ||
# The model is trained only on SMPL pose parameters. | ||
speed_up_cfg = dict( | ||
type='deciwatch', | ||
interval=5, | ||
slide_window_q=2, | ||
checkpoint='https://openmmlab-share.oss-cn-hangzhou.aliyuncs.com/' | ||
'mmhuman3d/models/deciwatch/deciwatch_interval5_q2.pth.tar?versionId=' | ||
'CAEQOhiBgIDgu8O9gxgiIDNjMDEyOWQ3NjRkODQ2YTI5MjUxYWU4NzhjOTc1YTRj') |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,10 @@ | ||
# Config for DeciWatch trained on PW3D dataset with an interval of 5, | ||
# window size of 1 + 5*3(where q=3). | ||
# The model is trained only on SMPL pose parameters. | ||
speed_up_cfg = dict( | ||
type='deciwatch', | ||
interval=5, | ||
slide_window_q=3, | ||
checkpoint='https://openmmlab-share.oss-cn-hangzhou.aliyuncs.com/' | ||
'mmhuman3d/models/deciwatch/deciwatch_interval5_q3.pth.tar?versionId=' | ||
'CAEQOhiBgIDJs8O9gxgiIDk1MDExMjI5Y2U1MDRmZjViMDBjOGU5YzY3OTRlNmE5') |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,10 @@ | ||
# Config for DeciWatch trained on PW3D dataset with an interval of 5, | ||
# window size of 1 + 5*4(where q=4). | ||
# The model is trained only on SMPL pose parameters. | ||
speed_up_cfg = dict( | ||
type='deciwatch', | ||
interval=5, | ||
slide_window_q=4, | ||
checkpoint='https://openmmlab-share.oss-cn-hangzhou.aliyuncs.com/' | ||
'mmhuman3d/models/deciwatch/deciwatch_interval5_q4.pth.tar?versionId=' | ||
'CAEQOhiBgMC.t8O9gxgiIGZjZWY3OTdhNGRjZjQyNjY5MGU5YzkxZTZjMWU1MTA2') |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,10 @@ | ||
# Config for DeciWatch trained on PW3D dataset with an interval of 5, | ||
# window size of 1 + 5*5(where q=5). | ||
# The model is trained only on SMPL pose parameters. | ||
speed_up_cfg = dict( | ||
type='deciwatch', | ||
interval=5, | ||
slide_window_q=5, | ||
checkpoint='https://openmmlab-share.oss-cn-hangzhou.aliyuncs.com/' | ||
'mmhuman3d/models/deciwatch/deciwatch_interval5_q5.pth.tar?versionId=' | ||
'CAEQOhiBgMCyq8O9gxgiIDRjMzViMjllNWRiNjRlMzA5ZjczYWIxOGU2OGFkYjdl') |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
smooth_cfg = dict(type='guas1d', window_size=11, sigma=4) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
smooth_cfg = dict(type='oneeuro', min_cutoff=0.004, beta=0.7) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
smooth_cfg = dict(type='savgol', window_size=11, polyorder=2) |
Oops, something went wrong.