Thank you for being alive: how we chose passive liveness

Hello everyone! My name is Natalya Bessonova, I am the project director of the digital identity block of Rostelecom. In this article I want to talk about how we chose passive liveness from one face image for the Unified Biometric System.

There are not many articles on Habré devoted to liveness in biometric systems, and those that exist describe methods and algorithms for determining liveness, or, more simply, the belonging of biometric samples to a living person. Let's pay tribute to their authors - the articles are interesting and informative, but what if we are interested in how well they work on data that is not included in any of the open data sets? How do you know if the liveness is really good or bad and which one should you choose if necessary? In this article, I will describe an approach to choosing a passive singleshot-liveness (i.e., one image at a time) of a face for the Unified Biometric System .

Why do you need liveness

, ( , ). . , , ( , ):

O , «» Deepfake /, / . , . - «» , . - — . .

→ : , , ?

. Deepfake Detection Challenge , Amazon, Facebook Microsoft. NtechLab 2,2 .

, — . . , 5-10-20 . . . . , — . — .

. - . - , , … ( ) : ?

→

, . , , .

, , — , . .

→ :

, , . .

, - . : , 3D .

→

, , -, .

. , , . , , COVID-19, . : , , , , . , , . . .

, : « ?» « ?». ( ), , , , » , . , .

: (-) . : , , , , .., , , . , , - .

, , . , , deepfake. , , , .

2020 58624, , . . , :

• ;

  
  
  
  
  

• ;

  
  
  
  
  

• ( , ).

  
  
  
  
  

. , , . 58624.3, : 

• , ;

  
  
  
  
  

• , ; () , . ;

  
  
  
  
  

• , ;

  
  
  
  
  

• , .

  
  
  
  
  

, . , . , . .

.

, -,

, .

FIDO Biometrics , , . , , . , , , .

:

• – ;

  
  
  
  
  

• 2D- – ;

  
  
  
  
  

• – , , ;

  
  
  
  
  

• – ;

  
  
  
  
  

• 3D- – , 3D-.

  
  
  
  
  

, . , singleshot- deepfake , , , .

.

300 ( ), 1%. - :

• Logitech C270;

  
  
  
  
  

• Logitech C930;

  
  
  
  
  

• Logitech B920;

  
  
  
  
  

• Logitech Brio;

  
  
  
  
  

• Intel Realsense D415;

  
  
  
  
  

• Xiaomi Redmi6.

  
  
  
  
  

, , , .

, .

, :

1) CPU - Intel(R) Core(TM) i5-6600 CPU (4 , 3.30 , AVX AVX2 );

2) GPU - Nvidia GeForce GTX 1070 (8 );

3) - 16 DDR4;

4) - SSD SAMSUNG 970 EVO 500.

12 . , , singleshot-, API RGB , liveness score, . 3D- Intel RealSense D415 , , RGB , liveness score. .

, . : 1,3% 1%. : , 3D-, , .

. , . , . , , , 9% , , , .

. - . , , :

• ;

  
  
  
  
  

• ;

  
  
  
  
  

• .

  
  
  
  
  

, — , , , , . , , . , , , .

, .