Bloomberg storage support team relies on open source and SDS



TL; DR : The Bloomberg Storage Engineering team has created a cloud storage for internal use that does not interfere with the infrastructure and withstands a lot of pressure from the volatility of trading during the pandemic.



Mattew Leonard, Bloomberg Storage Engineering, «» «». - , SAN NVMe DevOps. «» (. , . ).



Leonard 25 100 6000 , Bloomberg Terminal — , Michael Bloomberg . , Bloomberg Engineering.



IT, 2020 Storage Engineering, COVID-19 . Leonard , « » , , .



, , . — . . , , . ,

, , COVID-19. - , . , Bloomberg , , 240 . .



, . , . . . : « ABC, ABC». , « » , , . , , . , , , .

SearchStorage , . , , , AWS, Bloomberg.



, Bloomberg?



, . SLA, , .



?



. AWS, - , , «» — .



?



, , . , . , . SAN. SDS, . NFS. SDS . .



?



. - . - , . , , . , .



. — , , ( Bloomberg — - , . ).



?



. Bloomberg , . , . , , , , . , , — . — , , , , , . , .



?



. — . , , , , , — . , , , , , . , . — , , .



, , AWS ?



S3 — , . . - — . AWS , , .



?



. NVMe Flash, . , , .



?



6000 , , - . , , . , — , , . SLA, , , , . , , .



Kubernetes , ?



, , ---, , .



N.B. : 15 2020 - Ceph. Ceph, .

, — API . , — Bloomberg. full stack web-, node.js, python, , Apache Airflow, .



, . . , .



, Kubernetes CSI, , Kubernetes Bloomberg, , Kubernetes , . SDS Kubernetes, . , , Bloomberg. , .



, ?



Apache Airflow. HAProxy . Ceph, SDS. , . OpenStack — . , SDS . .



- ?



, . , « SAN, , NFS, ». , .. . , , , Bloomberg — , . , . , SLA, , ? , , .



SDS, . NVMe TCP, , . , , , . , .



P.S.

P.S. , , 28-30 Kubernetes , , Kubernetes, .




All Articles