How we in IVI use arrays in ClickHouse to calculate product metrics

IVI is a cross-platform service, which means that we have to analyze metrics everywhere: on the web, TVs and mobile applications. The product is constantly evolving to be as efficient and convenient as possible and to increase the value and attractiveness of your subscription. Before introducing a new feature, we conduct a / b tests and investigate how much the innovation will be in demand and how it will affect conversion or viewership. At the same time, we can test up to 70 hypotheses, on which plans for product development directly depend.





In order to correctly assess the success or failure of the test, a technological solution was required. Here we talked about how we switched to ClickHouse (as well as about its problems for January 2018). The new ETL schema allowed us to have duplicate-tolerant repositories. In case of an error in the code, we can always roll back the consumer offset in kafka and process some of the data again, without making any extra effort to move the data. We would like to tell you about how we at IVI use ClickHouse to calculate metrics for solving various product tasks and understand that we really make the product better, and do not come up with features that no one will use.





About arrays and "machinations" with content monetization.

, . IVI . AVOD – , . SVOD – , . TVOD/EST – , SVOD. EST – , TVOD – , 30 , 48 .  « ? , ? ! 20 , ?! 600 ?!» - , , , . . 





, . , . , , , “ TVOD-” ( , , - «-» «»), . , , , TVOD/EST, (. . SVOD). , . 





, TVOD/EST SVOD . – : -, . , , ( ). a/b-. -, , -, , , .  





: a/b-, SVOD TVOD/EST, . , :





  1.      ;





  2.      ;





  3.      SVOD;





  4.      TVOD/EST;





  5.      SVOD;





  6.      TVOD/EST;





  7.      ;





  8.      TVOD/EST   .





: -> -> ( ). , «»: ivi -> -> -> -> () -> .





, ( ClickHouse ).





, , , a/b-, url , .. , , «» :





arrayElement(



– "” …





details.int_value,



– -





indexOf(







details.name,



– -





‘id'



– -













) in (1,2)







, , , . :





  • , ;





  • , ;





  • arrayCumSum ;





  • – – , ,





  • ;





  • , ;





  • .





. . : , .





, .





IVI « » (. ). , , – IVI Smart TV. , «magic mouse», - .





Login by code

, , , count() . ClickHouse , . , , – “”.





: , Smart TV. , , . , , . 





/ Smart TV:





 









  1. , « » ; 





  2. , ;





  3. , . 





, % . , - , Smart TV, . 





/ – . , . 





. ClickHouse – , , . . , , , , .





, - . 





? , . , , . 1 , «» (. 1). 2 – «» « ». , «back» , . «select from» CTR ( / ) , , – . 1 . 





P.S. , «» , «back»: 7 10 « back» , «magic mouse» .





.1





.2








All Articles