How Netflix Maintains Service Reliability: Priority-Based Load Limiting

In anticipation of the start of the "Highload Architect" course , we invite everyone to attend an open webinar on the topic "Patterns of horizontal storage scaling" .







In the meantime, we are sharing with you the traditional translation of the material.










Netflix users continue to watch their favorite TV series while the infrastructure recovers on its own from a system failure

Authors: Manuel Correa (by Manuel Correa)Arthur Goningberg (Arthur Gonigberg) and  Daniel West (Daniel West)





Getting stuck in traffic - there is nothing worse for any driver in the world. Movement slows down to the speed of a turtle, often due to some kind of nonsense or no reason at all. We engineers at Netflix are constantly looking for ways to improve traffic management - in our case, network traffic - but let's pretend for a moment that we manage traffic. What if we knew how important it is for one or another driver to pass, and could selectively ensure the movement of individual cars, instead of making everyone wait?





Netflix , Netflix , . , ( ) «». , . , .





Netflix, , . , , . , .





, : , ; , ; ; . - , , . , Netflix , :





  1. ( , ).





  2. .





  3.  - ( ).





, : -.





 





-





: , . :





  • NON_CRITICAL. . . , .





  • DEGRADED_EXPERIENCE. , , . , , , .





  • CRITICAL. . , .





API (Zuul) NON_CRITICAL, DEGRADED_EXPERIENCE CRITICAL 1 100 . , .





, . , , Zuul. . , , , . . Zuul , .





Zuul : ( ) , ( ).





Zuul , , . . , , .





, Zuul. ,    , Zuul, -   . . , , , . Zuul , . : Zuul , , .





, . (, ), , . . , .





 





 — . (  ) : 35 % 90 %. , 50 80 %, 10 95 % . .





, , Play . Zuul    , .





Zuul , , , . , , , . :





{ “maxRetries” : <max-retries>, “retryAfterSeconds”: <seconds> }
      
      



, . . , , .





, (NON_CRITICAL, DEGRADED CRITICAL), , . (FIT) Zuul, . , , , .





, , , . Netflix , , , . , Netflix , . , NONCRITICAL ,  — ChAP.





A-/B-, 45 , . , . ChAP KPI , .





Android iOS , . . , .





( SPS  )





2019 Netflix , - . 2020 , , . Netflix , , 2019 . Zuul , . .





: (SPS), Zuul . , .





Netflix, .





, , , -, , Netflix .





Netflix , , .






"Highload Architect".



" ".












All Articles