Requirements Before Getting Started

To achieve quorum a minimum of three systems are required. The storage provided by the system can be SAS or SATA HDD or SSDs but a minimum of 1x SSD is required for use as a journal (write log) device in each system. Systems must use a hardware RAID controller for QuantaStor boot/system devices and we recommend using a hardware RAID controller for the storage pools as well.

  • 3x QuantaStor servers minimum (up to 64x Systems)
    • Dual Intel Xeon or AMD Opteron CPU
    • 128 GB RAM
    • 1x 375GB or larger high write endurance SSD/NVMe/NVRAM/Optane device for use as Journal Device
    • 5x to 100x HDDs or SSD for data storage per system
    • NTP / Time Synchronization
    • Separate Networks for iSCSI and Ceph communication

Front-end / Back-end Network Configuration

Networking for scale-out file and block storage deployments use a separate front-end and back-end network to separate the client communication to the front-end network ports (S3/SWIFT, iSCSI/RBD) from the inter-node Ceph communication on the back-end. This not only boosts performance, it increases the fault-tolerance, reliability and maintainability of the Ceph cluster.

All nodes should have one or more ports designated as front-end ports and assigned IP address and subnet masks specifically for client access. One can have multiple physical, virtual IPs, and VLANs used on the front-end network to enable a variety of clients to access the storage. The back-end network ports should all be physical ports but it is not required.

A basic configuration Ceph network configuration: