Ceph ~30PB Test Report Dan van der Ster (CERN IT-DSS), Herve Rousseau (CERN IT-DSS)
Abstract During March 2015 CERN ITDSS provisioned nearly 30 petabytes of rotational disk storage for a 2 week Ceph test. For the past year, CERN IT has operated a 3 petabyte cluster in production for OpenStack and in test for various R&D projects. The present test therefore represents a 10fold increase in scale versus known deployments . This test consisted of 1 adding 7200 4TB drives on 150 storage nodes to an existing (but much smaller) test cluster. The cluster was benchmarked and various failure conditions were simulated. In summary, the test showed that operating such a cluster is feasible, though we present some caveats and suggestions for improved scalability. 1. Motivation CERN ITDSS currently operates around 200PB of disk storage (usually with 2 copies, thus 100PB usable) and the LHC experiments continue to produce an estimated 12PB more data per month.
CE
te/st / a /CERN/of /storage/in /to /and /cluster/ te/st / a /CERN/of /storage/in /to /and /cluster/
