How we tested the Huawei OceanStor Dorado 18000 V6 High-End array in battle

“Not a storage system, but a Formula 1 car,” I thought when I saw the announcement of a new top-end array from Huawei. And also with skepticism: "Let's see how this supercar will show itself on the track." And so I was lucky to "run in" the Huawei OceanStor Dorado 18000 V6, loading it with synthetic and applied tests. I share the results obtained. At the same time, it turned out to go through an unplanned quest in search of a parameter, which at first noticeably spoiled the picture of performance on AIX. So, under cat.





The strength of the Dorado

Compact and powerful as a James Bond grenade pen, the OceanStor Dorado 18000 V6 storage system fits in four units, excluding disk shelves. For our tests, we got a four-controller system with four disk shelves, in which 60 1.92 TB NVMe Palm-Size drives are installed.





, , «» 1,5  IOPS 70R/30W 8K, 100% random, 0% read Cache Hit.





. 100Gb RDMA , .. .  — 32, . 





Fig.  1. Triple cache mirroring.
. 1. -.

Dorado 18000 V6 . . , : , . . 





, , . 





Dorado 18000 V6 AIX 16 Gb Fibre Channel, SAN Brocade GEN5 16 Gb. LPAR Oracle. Vdbench.





«»

,  — 5.2:1. 85 , Dorado V6.





, 3.5:1, Dorado V6 . 





Fig.  2. Indicators of the efficiency of data storage after placing a copy of the DBMS.
. 2. .

— . , . Huawei Dorado V6 6% , «» All-Flash High-End . , . - - .





. , Huawei Dorado V6 80%.





(Qualification)





Dorado 18000 V6 NVMe,  — Dorado 3000 V6 SAS Dorado 5000 V6 NVMe. :





Fig.  3. Summary test results.
. 3. .

:





  • Random – 65R/35W 8K, 100% random;





  • Sequential – 256K, 100% write;





  • 1 Like – , 40KB random read, 24KB random write (90R/10W);





  • 2 Like — , 115KB random Read, 72KB random write (70R/30W);





  • Vmware Like , 86KB random read, 11KB random write (46R/54W).





. RAID6. . . , CPU .





, . LPAR 16  FC, - 6 / . 





Huawei Taishan 2000 (Model 2280) ARM. FC 16 Gb,  — . 10  FC :





  • #1, AIX 7.2, 4 x FC 16Gb, 16 x LUN 500GB, RAID6;





  • #2, CentOS 7.6, 2 x FC 16Gb, 16 x LUN 500GB, RAID6;





  • #3, CentOS 7.6, 4 x FC 16Gb, 16 x LUN 500GB, RAID6.





1,3  IOPS, 9,9 / 0,53 , . 80% CPU , 15%. 





Fig.  4. Maximum performance of random access, Array view.
. 4. , Array view.
Fig.  5. Maximum performance of random access, Controller view.
. 5. , Controller view.

-. Dorado V6 , -. 





, . Front-End .





Vdbench 1 /. , FC .





 — . Dorado 18000 V6 , Back-End Front-End -. 





, , , , MPIO .





Dorado 18000 V6 . , Front-End . .. . Back-End .





Fig.  6. Topology of Dorado 18000 V6 in normal operation.
. 6. Dorado 18000 V6 .
Fig.  7. Dorado 18000 V6 topology when three controllers fail.
. 7. Dorado 18000 V6 .

, , .





Fig.  8. Load on four controllers in normal mode.
. 8. .
Fig.  9. Load balancing after failure of two out of four controllers.
. 9. .
Fig.  10. Load balancing after failure of three controllers out of four.
. 10. .

«»

. Dorado V6 RAID , . Dorado , . RAID-TP, RAID6 .





60  1,92 TB RAID6. Vdbench  — 140 000 IOPS, 65R/35W 8K, 1,1 /. 1,92 TB 69 . .





60  1,92 TB RAID-TP. 28 .





Fig.  11. Latency jump when one disk fails.
. 11. .

,  — . AIX 7.1 Dorado 5000 V6, , .





Dorado 18000 V6 , Dorado 5000 V6! , . AIX - LUN, ! 80 . IOPS .





Fig.  12. Unexpected abnormal performance failure :(
. 12. :(

 — AIX 7.2 : 18000 V6 , . , Linux Vmware  — . AIX 7.1, , , AIX OS. IBM AIX Performance Management Guide . 





, Huawei . , ODM- Huawei .





IBM. AIX. «» perfpmr , : FC , , HBA, LUN, -, - OS, Java, , xdisk, ndisk, dd. SAN, , .





«» . AIX 7.1 «» , spec_accessupdate. , AIX Performance Management Guide , Help- . , AIX 7.1 AIX 7.2 :





Purpose: Indicates for devices how timestamp changes are reflected.Values:





  • 0 is standards-compliant behavior (default in AIX 7.1)





  • 1 indicates access and update times are not changed





  • 2 indicates lazy access/update changes (default in AIX 7.2)





spec_accessupdate=2, - AIX 7.1 . 





ioo -p -o spec_accessupdate=2





Oracle ASM «» , spec_accessupdate AIX 7.1 . 





?

Huawei, , . Dorado V6 . , . Dorado V6  — Device Manager . . SNMP. , Dorado V6 — «» . Dorado V6 . 





Dorado V6. Huawei Smart Kit. . Dorado V6 Device Manager.





Dorado V6. . High-Availability RPO=0, Disaster Recovery . - . Redirect-On-Write, . Business Continuity Manager (eReplication Suite) .





Huawei eDesigner SCT. : Dorado V6 . , . Huawei OceanStor eStor. eService support.eservice.huawei.com/#/Welcome





, – 6% . . -, CPU Power. , -, SLA . . 





P.S. Dorado V6 . NVMe over Fabrics: NVMe over RoCE, NVMe over FC. Dorado V6, 5000, . .





, - « »








All Articles