How a document is recognized on a mobile phone: from simple to complex

Hello habr! Since 2015, we have been publishing posts on our blog describing various aspects of recognizing identity documents (and not only) on mobile devices (and not only). In the comments, we were asked several times to tell in general about how our recognition system works, but we put it off for a long time, because it is rather difficult to describe it “in a nutshell”. 

In this article, we have tried to briefly describe the structure of our identification document recognition system and the algorithms that are applied at various stages of the process. If you wanted to know how the Smart IDReader system works - welcome under the cut!

The idea of ​​using mobile devices for digitizing and recognizing documents is far from new. However, for quite a long time, the low quality of cameras installed in mobile devices, as well as the insufficient performance of mobile processors, did not allow building recognition systems with a quality sufficient for practical use. Now smartphones and tablets can be considered one of the most convenient ways to enter data - both in terms of the quality of the camera and the computer. It only remains to develop a good recognition system.

Principles

First of all, we outline the requirements that we laid down when designing the system. Four basic principles underlying Smart IDReader:

1. (, ). , , , ( , ).

2. . - , . , .

3. . - . - , - . , , . , , (. . 2) . 

4. . ( ) . , , , . , , .

, “” , . -, , , , ( ) . . -, : , , .. -, , , .

, . ( , ), . - , , . .

( ) , : , , , “” , .

, : , , , .

Smart IDReader , , . , (, ) , “ ” - , . 

Smart IDReader ( “”). , , , ( ), . , : , ID-, .

( ) :        

1. . . ,

2. , , , . “” , , . (“” , “” , 3 ). .

3. , : + + RANSAC. ( YAPE , ) ( - RFD, ). “” -. RANSAC . Smart IDReader . .

, ( , , ..), , ? , . , , , ( - ) , , , . , , , , , . , , .

( ) “ ” - , , . , - - , . , , , , . 

: , .  

“” ( , , , , ).  

.

, , , ? . , , . , , , , , - , . , , , , ( ). , , , , “” , .

, , , , . “” ,

. , , , . , ( ), -, , . , , .

( , ), , , , , .

, , - , . - .

, , , . .  

Smart IDReader , ( , , - , ID- , ). - ( , ), .

Smart IDReader , (, , - ). , , .

. , , , , . . , - . , . - “”, , “” , - ( ).

, , OVD (Optical Variable Devices) - , . , , . , .

, …

, . , . , , (, , , ), (MRZ) , , - . , , - , . 40 .

, , . , , , , , , “”. , , . 

! - , !




All Articles