Visualization of Alice's voice assistant with hologram effect

Hello, Habr! Say , laziness - the engine of progress . But no one said that this very engine would be fast . My story is about how I made a visualization of Alice's voice assistant with a hologram effect from scrap materials.





Introduction

, .. "" , ( " "), . - .





, – "Vector" Anki ( Digital Dream Labs). (, , ..), . , Vector Alexa, Google Assistant, Siri, .





Vector Robot by Anki
Vector Anki

. LED-. , "" "". , .





Yandex.Max station with LED display
. LED-

, , Cortana Microsoft. , , .





, , , , . .. 2000 , , . , :





  • c TFT (BenQ GW2750HM)





  • (core 2 duo p7350, GeForce 9300M, 4Gb RAM)





  • 3D- (Tevo Tarantula 2017)





  • RGB-





  • Arduino Nano





, Xiaomi





USB . , . , , . .





Autodesk Fusion 360. , , .





, , , / , . .. , , , . , , , .





Chassis Model in Autodesk Fusion 360
Autodesk Fusion 360

3D

ABS .. . : . 5 . .





Printed body

- , 3D- , , , ( ). , , .





, .





: , , .





(, ), . , .





The first check of the "hologram"
""

- , TFT-, . , .





, , , . "", . "" RGB , .





Fully assembled body

: , desktop- , Python- , Unity Arduino Nano .





: Python-. , Unity Arduino.





, -. . JS, , , . API .





, , . , , MQTT : (, ), . JSON, . JSON, . , .. , , (HTML + CSS). HTML - Chrome, MQTT JSON Base64, Unity. / , Serial / Arduino, ( / ) RGB .





. . , , . , : ", : , ", . .





Unity MQTT / . ( ), "", .





Visualization in Unity
Unity

.. , , Marvel " ", "". 3D- , Blender, Unity.





Alice 3D Model
3D-

- , , , .





! , .





. , , "" , OpenCV MQTT , USB .





, :





  1. " ", Home Assistant. ( esp8266/Arduino), ( Xiaomi). , . . , - , . API, ,





  2. It's a bad idea to use a TFT monitor





I also found an unusual application for such a device: instead of Alice, display the time or timer before some event with the backlight on.





Countdown to the new year
Countdown to the new year

While recording a video of Alice's rendering, I used a test animation of movement. The effect is as if Alice's model holds the light above it and goes to the user. I thought it was funny and decided to leave it that way.








All Articles