Tinkoff Lab: How Students Develop a Visual Robot

image



Tinkoff has an educational project "Laboratory" Financial Technologies ". We select students and masters of Moscow technical universities who want to work with the bank's IT projects. We register them for work in the state for 20, 30 or 40 hours per week, give tasks, mentors and help them grow professionally. We work in partnership with MIPT: teachers and senior students of the university act as mentors for students.



, :



  • Computer Vision;
  • Speech-to-text;
  • ;
  • ;
  • .


. : .



Computer Vision - 2020 .



Computer Vision: « »



: ,

: ,

: (2 ) (1 )



, . Computer Vision audio-to-video. .

, . : . , .



, «.». - 30- .



, , , , , .



, Computer Vision

. — , , - .

, , . , .


: « »



. — Neural Voice Puppetry, , . .

:



  • ( , , );
  • .


:



. , Samsung AI Center, . . , . Arxiv.



image

c arxiv.org



, . , , . , .

«». , «», -.



image

Few-Shot Adversarial Learning of Realistic Neural Talking Head Models (Egor Zakharov et al.)



, , 1

Arxiv . : , . , .

, . . . , , .


: ,



, .



, , , «».



. , , . . , .



, . . — (, voxceleb, voxceleb2), .



:



  • ;
  • ;
  • .


«». API, . .



: , , . , . .



«» 20 . . . «». , : 40% , . 60 .



image



. (FaceAlign), — . 68.



:



image



, , .



, , (a.k.a. Samsung)). , . , .



image

. , ,



,

, . , , . — ! — . , , .

, . . , . .


:



, , . First Order Modu Samsung. - , .



LipGAN, .





. : — , — .







. 60 , . , .



, .



. , 3D-, :







, . «» «». : .



,

, , -. , .

— , , , .



— , .



image



— R&D-



, . , « » 63- .



,

, , -. .

27 ,




All Articles