The Project is real time application in opencv using first order model

Python version : python v3.7.3 or higher

create virual environment : pip install virtualenv

activate virtual environment : virtualenv env

For windows : env/Script/activate

For Linux : source env/bin/activate

Install modules : pip install -r requirements.txt

Install pytorch and torchvision : pip install torch===1.0.0 torchvision===0.2.1 -f https://download.pytorch.org/whl/cu100/torch_stable.html

gdown --id 1wCzJP1XJNB04vEORZvPjNz6drkXm5AUK The file is also availible via direct link on Google's Drive: https://drive.google.com/uc?id=1wCzJP1XJNB04vEORZvPjNz6drkXm5AUK

On Linux machine : unzip checkpoints.zip

If on windows platfrom unzip checkpoints.zip using unzipping software like 7zip.

Delete zip file : rm checkpoints.zip

Run application from live camera : python image_animation.py -i path_to_input_file -c path_to_checkpoint

Example : python .\image_animation.py -i .\Inputs\Monalisa.png -c .\checkpoints\vox-cpk.pth.tar

Run application from video file : python image_animation.py -i path_to_input_file -c path_to_checkpoint -v path_to_video_file

Example : python .\image_animation.py -i .\Inputs\Monalisa.png -c .\checkpoints\vox-cpk.pth.tar -v .\video_input\test1.mp4

test demo

Tkinter version

Need work on face alignments

Future plans adding deepfake voice and merging with video

@InProceedings{Siarohin_2019_NeurIPS,
 author={Siarohin, Aliaksandr and Lathuilière, Stéphane and Tulyakov, Sergey and Ricci, Elisa and Sebe, Nicu},
 title={First Order Motion Model for Image Animation},
 booktitle = {Conference on Neural Information Processing Systems (NeurIPS)},
 month = {December},
 year = {2019},
 url = {https://github.com/AliaksandrSiarohin/first-order-model}
}

• Original Project

  • AliaksandrSiarohin

  If you like this project give your support to original author of this project by giving github star to author's project

• video explanation to the project
  

  • Video explanation by original author
  • Two min papers

• try project on google colab

  • youtube link
  • link to colab version

  For any valueable feedback feel free to contact me on linkedin