One-eyed depth gauge

Recently, there was an interesting article from FaceBook about how you can do good 3D from monocular cameras. The article is not very applicable in practice. But the picture quality is mesmerizing:

After looking at this, I decided to make a short story about what is going on in the article, where modern technologies have come, and what can be expected from them in practice.

. 3D:

• 3 (, , TOF). -.

• . .

• . , .

. ? :

. .- , + .

? , .   “SLAM”. - ( ):

• .

• , .

• - , -

2014 ( ):

. . . 

.

SLAM- . AR Core ARKit, . :

:

• 3 ()

• …

OpenSource COLMAP. , .

?

SLAM 3D:

?

. , - . , - .

. “ ”? . “ ”, , , . .

- . - . KITTY:

- .

3 “ ”, - , “ ”, “ ”. , .

- - Depth Estimation, “” - .

. , “ ”, .

MiDaS

MiDaS. , :

• . , , , ...

• + .

MiDaS :

• pytorch

• intel

. ? - :

, . :

• ( )

• ,

, , :

. SLAM . , .

. DELTAS

TSDF , . . :

, :

, , TSDF.

? 3D . iPhone’ :

Consistent Video Depth Estimation

, ? , . . “Consistent Video Depth Estimation”.

, , SLAM . :

-, () . - - . 4-5 10- . :

? . , colab   .

State-Of-Art . .

. , :

, , depth . , , depth - - , , . . - .

Monocular Depth . , , , , .

p.s.

/. - (, ). , , 2-3 - .