[go: up one dir, main page]

Skip to content

EMOCA-v2.0.0

Latest
Compare
Choose a tag to compare
@radekd91 radekd91 released this 14 Feb 15:55
· 4 commits to release/EMOCA_v2 since this release

Release of EMOCA v2

New retrained of EMOCA that performs much better. Compared to the original model it produces:

  1. Much better lip and eye alignment
  2. Much better lip articulation

This is achieved by:

  1. Using a subset of mediapipe landmarks for mouth, eyes and eyebrows (as opposed to FAN landmarks that EMOCA v1 uses)
  2. Using absolute landmark loss in combination with the relative losses (as opposed to only relative landmark losses in EMOCA v1)
  3. Incorporating perceptual lip reading loss. Inspired by spectre. Big shout-out to these guys!

You will have to upgrade to the new environment in order to use EMOCA v2.
This includes:

  • switching to Python 3.8
  • updating pytorch and pytorch3d
  • upating minor packages

Please follow the steps in the README