Hello. My name is Dyadichenko Grigory and I love tracking. In recent years, tracking technologies have evolved by leaps and bounds and become more and more democratic. Many technologies of a very different plan have appeared. I was lucky to work with a huge number of technologies of various kinds, so I want to structure this knowledge somewhat. For the most part, we will be looking at tracking technologies that are compatible with Unity or the Web. So if this topic interests you. Welcome under the cut!
Tracking in general is a very voluminous topic. There are many tracking technologies that I want to talk about in this series of articles. But today I want to talk about Face Landmark Recognition. In general, in terms of face recognition, there are many other cool technologies and tasks that they solve, such as the same Face Recognition in FaceID and similar security cases, but in the context of working with graphics and interactive visualizations, perhaps the most interesting is the technology for determining key points on the face.
Application of AR masks
AR . , , AR. — . Instagram TikTok. . .
Face Tracking
2020 . , , , . , . Motion Capture , Faceware, . FaceRig VTuber’. , . , - , ARKit. , , . Faceware .
AR
, . - . . :
https://player.vimeo.com/video/220504292
https://mixr.ru/2021/01/20/trollo/
AR . , , .
Unity, , . , SDK , SDK , ( ).
SparkAR
:
: Android/IOS
Unity: ,
:
https://sparkar.facebook.com/ar-studio/
, Spark. — , Instagram . — , . , .. . , .
, , , - . , , Spark AR Studio .
ARFoundation (ARKit/ARCore)
:
: Android/IOS
Unity:
SDK : 2
:
https://docs.unity3d.com/Packages/com.unity.xr.arfoundation@4.1/manual/
ARFoundation 4.1 Face tracking ARCore ARKit ( ARFoundation ARCore). , , , API AR Foundation. Unity , , . .
SDK, , , . , .
OpenCV + Dlib
: / Unity 135$ (https://assetstore.unity.com/packages/tools/integration/opencv-for-unity-21088 + https://assetstore.unity.com/packages/tools/integration/dlib-facelandmark-detector-64314 )
: Android/IOS/WebGL/Win/Mac/Linux/Hololens/MagicLeap
Unity:
SDK : 9 ( , )
:
. , , Python, . — . Unity - , . OpenCV Dlib, . . . , . Python , Unity SDK.
- . , OpenCV - . -, OpenCV . -, , Unity, Unity . C , . , . 2 FPS, 30, 60 SDK .
XZIMG
: 2100€
: Android/IOS/WebGL/Win
SDK : 2
Unity:
:
https://www.xzimg.com/Products?nav=product-XMF
SDK - , . , , . , , . , MOTOROLA G5S. Android 4.1 - . , - . , . OpenCV .
ARGear
: / 25$
: Android/IOS
Unity:
SDK : 9
:
, XZIMG. Xiaomi Redmi Note 8T. . . , , , - . , , sample project Unity, sdk. - .
BRFv5
:
: Web/Android(Chrome)/IOS(Safari)
Unity:
https://github.com/Tastenkunst/brfv5-browser
SDK , . . . (: ) , 68 — . . . , Media Pipe .
, , Banuba Deepar. , . Deepar SDK Unity, .
, . . . . , OpenCV , , , , . , , .
, . , SLAM, ..