Tsinghua University: distributed storage helps China Brain Project

Challenge:

Reliability: high sensitivity, high resolution camera needs continuous shooting, can not lose frame

Bandwidth: the minimum bandwidth of rush must reach 20.16GB/s

Large capacity: the data amount of continuous tens of hours observation reaches PB

Solution:

Concurrency and scalability of the storage system are two key elements to support the RUSH platform. Through public bidding and rigorous testing, Inspur distributed storage AS13000 stood out and won the bid. A 40-node storage unit is applied to control 28 cameras for concurrent collection and storage of high-throughput data. Continuous shooting (12MP photos, 30FPS, 16-bit) is enabled. Storage bandwidth is stabilized at 20.16GB/s, maximum shooting duration is 48hours, and the storage capacity is around 5PB.

Benefit:

In response to the application characteristics of concurrent collection and storage of high-throughput data, as well as the requirements for the performance, bandwidth and scalability of the storage system, Inspur customized the AS13000 solution and conducted a simulation to measure the data traffic and operation time. It is noted that data traffic was increased in the simulation to guarantee that the system can handle future business expansion, and to test the load capacity and performance changes of the system and platform. Finally, the AS13000 solution was verified to have stable read bandwidth of 45GB/s and stable write bandwidth of 35GB/s, which fully meets the storage needs of the RUSH platform. The solution helps safeguard the China Brain Project and shows Inspur’s power in distributed storage.