DOPE: Distillation Of Part Experts for whole-body 3D pose estimation in the wild

This repository contains the code for running our DOPE model. We only provide code for testing, not for training. If you use our code, please cite our ECCV'20 paper:

@inproceedings{dope,
  title={{DOPE: Distillation Of Part Experts for whole-body 3D pose estimation in the wild}},
  author={{Weinzaepfel, Philippe and Br\'egier, Romain and Combaluzier, Hadrien and Leroy, Vincent and Rogez, Gr\'egory},
  booktitle={{ECCV}},
  year={2020}
}

License

DOPE is distributed under the CC BY-NC-SA 4.0 License. See LICENSE for more information.

Getting started

Our python3 code requires the following packages:

• pytorch
• torchvision
• opencv (for drawing the results)
• numpy/scipy

Our code has been tested on Linux, with pytorch 1.5 and torchvision 0.6. We do not provide support for installation.

Download the models

First create a folder models/ in which you should place the downloaded pretrained models. The list of models include:

• DOPE_v1_0_0 as used in our ECCV'20 paper
• DOPErealtime_v1_0_0 which is its real-time version

post-processing with a modified version of LCR-Net++

Our post-processing relies on a modified version of the pose proposals integration proposed in the LCR-Net++ code. To get this code, once in the DOPE folder, please clone our modified LCR-Net++ repository:

git clone https://github.com/naver/lcrnet-v2-improved-ppi.git

Alternatively, you can use a more naive post-processing based on non-maximum suppression by add --postprocess nms to the commandlines below, which will result in a slight decrease of performance.

Using the code

To use our code on an image, use the following command:

python dope.py --model <modelname> --image <imagename>

with

• <modelname>: name of model to use (eg DOPE_v1_0_0)
• <imagename>: name of the image to test

For instance, you can run

python dope.py  --model DOPErealtime_v1_0_0 --image 015994080.jpg

The command will create an image <imagename>_<modelname>.jpg that shows the 2D poses output by our DOPE model. 3D poses are also available but are not displayed.

Here is one example resulting image:

Our real-time models use half computation. In case your device cannot handle it, please uncomment the line #ckpt['half'] = False in dope.py.