You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We perform a conditional generation according to a text. Note that the input texts “disgust high smile” and “angry mouth down” are the combinations of two terms used for training. For instance, “disgust high smile” is a new description that hasn’t been seen before, which combines “disgust” and “high smile”.
26
+
27
+
23
28
24
29
Text to expression examples:
25
30
@@ -32,6 +37,8 @@ Text to expression examples:
32
37
33
38
### 3.3 Sequence filling
34
39
40
+
Similarly to inpainting whose purpose is to predict missing pixels of an image using a mask region as a condition, this task aims to predict missing frames of a temporal sequence by leveraging known frames as a condition.
The specific aim of the 3D facial animation generation is to learn a model that can generate facial expressions that are realistic, appearance-
55
+
preserving, rich in diversity, with various ways to condition it.
56
+
47
57
#### Diversity of label control
48
58
59
+
The diversity of the generated sequences in terms of expression is shown hereafter. The meshes are obtained by retargeting the expression of the generated 𝑥0 on the same neutral faces.
In the Geometry-adaptive generation task, we generate a facial expression from a given facial anatomy. This task can also be guided by a classifier. In order to benefit from the consistent and quality expressions adapted to the facial morphology by the DDPM, one can extract a landmark set 𝐿 from a mesh 𝑀, perform the geometry-adaptive task on it to generate a sequence involving 𝐿, and retarget it to 𝑀 by the landmark-guided mesh deformation. We show hereafter the diversity of the generated sequences.
71
+
58
72
59
73
eyebrow
60
74
@@ -68,9 +82,6 @@ lips up
68
82
### 3.5 Comparison
69
83
#### Label control
70
84
71
-
We perform a conditional generation according to the expression label y.
72
-
Conditioning the reverse process of an unconditional DDPM is achieved here by using classifier-guidance.
0 commit comments