Facial animations from 2D videos

Clickbait
Clickbait

Facial animations are part of a model's general animation that describes the movement of parts of a model's face. Although the development of computer graphics techniques for facial animation began in the early 1970s, major advances in this area are more recent and have occurred since the late 1980s. However, to this day, existing animation methods are not perfect and often require additional structures or markers to achieve the required animation quality.

Let's try to collect something on the knee so that it also comes to life. An article about how I crutched facial animations, what came out of it or didn't come out.

Introduction

, , . , , . , :

, :

  •  

    • , , ,  

    • , , , Kinect Intel Real Sense

  • -  

    • , .

    • , ,  

, , :

- , , . , ?

. . : 2 , .

, . , , .

, . . , :

  • Rele - ,  

  • Ren - ,

  • Len - ,

  • Chin 1-8 - , ,  

, .

rele

(x,y,z) :

x = \ frac {\ sum_ {i = m} ^ {n} {a_ {i_0} + a}} {n + 1} \\ y = \ frac {\ sum_ {i = m} ^ {n} {a_ {i_1} + a}} {n + 1} \\ z = \ frac {\ sum_ {i = m} ^ {n} {a_ {i_2} + a}} {n + 1}

rele AB, A- , B- , , . rele :

rele_i = \ sqrt {(x_ {left} -x_ {right}) ^ 2+ (y_ {left} -y_ {right}) ^ 2+ (z_ {left} -z_ {right}) ^ 2}

rele , , - :

rele = \ frac {\ sum_ {i = m} ^ {n} {\ frac {rele_i} {rele_0}}} {a}

rele AB - . :

“ rele , , , () ”

len

(x,y,z) :

x = \ frac {\ sum_ {i = m} ^ {n} {a_ {i_0} + a}} {n + 1} \\ y = \ frac {\ sum_ {i = m} ^ {n} {a_ {i_1} + a}} {n + 1} \\ z = \ frac {\ sum_ {i = m} ^ {n} {a_ {i_2} + a}} {n + 1}

len AB, A- , B- , , . len :

len_i = \ sqrt {(x_ {left} -x_ {nose}) ^ 2+ (y_ {left} -y_ {nose}) ^ 2+ (z_ {left} -z_ {nose}) ^ 2}

len , , - :

len = \ frac {\ sum_ {i = m} ^ {n} {\ frac {len_i} {len_0}}} {a}

len AB - . :

“ len , , , () ”

ren , .

chin0-chin7

chin0 - chin7 AB , ( 0-16).

chini AB, A- , B- , , i. chini :

chin_i = \ sqrt {(x_ {chin-left} -x_ {chin-right}) ^ 2+ (y_ {chin-left} -y_ {chin-right}) ^ 2+ (z_ {chin-left} -z_ {chin-right}) ^ 2}

chin_i ( ) , - :

chin = \ frac {\ sum_ {i = m} ^ {n} {\ frac {chin_i} {n}}} {a}

chin AB - . :

“ chin{0-7} , , , () ”

, - :

/ Blender, . :

Stages of bone shaping and animation

Nightmare times

Nightmare two

Nightmare three
The normal plate did not fit here, enjoy 10/10 jackals
, 10/10

" "

, , . 2-3 , , . . , , .

, . , :

, . . 

And the execution takes a significant amount of time, which is unacceptable in comparison with some of the methods




All Articles