Configure Scale-out Storage Cluster: Difference between revisions

From OSNEXUS Online Documentation Site
Jump to navigation Jump to search
mNo edit summary
 
(20 intermediate revisions by the same user not shown)
Line 1: Line 1:
[[Category:ibm_guide]]
[[Category:ibm_guide]]
IBM Cloud deployments of QuantaStor scale-out storage clusters provide dedicated and highly available file, block, and object storage which can be deployed an any of the IBM Cloud data-centers worldwide.  Scale-out cluster use Ceph technology and provide NAS (NFS/SMB), SAN (iSCSI) and S3/SWIFT compatible object storage support in a single deployment.  As the name implies, scale-out clusters may be expanded by adding storage media and/or additional QuantaStor servers. 
Each server in a scale-out cluster must contain at least one SSD to accelerate write performance and each cluster must contain a minimum of 3x servers (6+ recommended) and a maximum of 32x servers (scalable to over 10PB in the IBM Cloud). QuantaStor’s storage grid technology enables systems to be grouped together and managed as a storage grid that can span IBM Cloud datacenters.  Within a storage grid one or more storage clusters may be provisioned and managed via the QuantaStor web based management interface.
''' OSNEXUS Videos '''
* [[Image:youtube_icon.png|50px|link=https://www.youtube.com/watch?v=CwGYaGMuSfU]] [https://www.youtube.com/watch?v=CwGYaGMuSfU Covers QuantaStor 5 S3 Reverse Proxy for IBM Cloud Object Storage [15:43]]
* [[Image:youtube_icon.png|50px|link=https://www.youtube.com/watch?v=VpfcjZDO3Ys]] [https://www.youtube.com/watch?v=VpfcjZDO3Ys Covers Designing Ceph clusters with the QuantaStor solution design web app [17:44]]
== Key Features ==
== Key Features ==
'''QuantaStor Scale-out Object Storage'''
'''QuantaStor Scale-out Object Storage'''
*S3 & SWIFT Compatible REST API support
*S3 Object Storage Compatible REST API support
*Hybrid HDD + SSD configuration to boost write performance
*Hybrid HDD + SSD configuration to boost write performance
*Easy web-based management of all systems with built-in QuantaStor storage grid technology.
*Easy web-based management of all systems with built-in QuantaStor storage grid technology.
Line 8: Line 20:


== Configurations ==
== Configurations ==
'''HYBRID OBJECT STORAGE SOLUTIONS'''
{| class="wikitable" style="width: 100%;"
{| class="wikitable" style="width: 100%;"
|-
|-
| style="width: 40%"|'''Medium Tier - Hybrid Object Storage – 48TB'''
| style="width: 15%"|<center>'''Capacity'''</center>
| style="width: 30%"|'''Use Cases'''
| style="width: 10%"|<center>'''Media Type'''</center>
| style="width: 30%"|'''System View'''
| style="width: 10%"|<center>'''Protocol Support'''</center>
| style="width: 25%"|<center>'''Workload'''</center>
| style="width: 25%"|<center>'''Bill of Materials'''</center>
| style="width: 15%"|<center>'''Design'''</center>
|-
|-
|2x E5-2620v4 or 4110, 128GB RAM, 8x 6TB, <br>QS Medium Tier License, 1x 800GB SSDs (write log), <br>2x 1TB SATA (mirrored boot), 2x 10GbE Private Network ports
|<center>144TB raw / 96TB usable<br><br>QS 5 Image: 4 x MD (48TB)</center>
|<center>HDD + SSD</center>
|<center>S3 / SWIFT</center>
|Highly-available Large Scale Object Storage Archive<br>Data Analytics<br>Private Cloud Content Delivery Network<br>Disk-to-Disk Backup via S3<br>Next Generation Applications using S3 back-end
|Highly-available Large Scale Object Storage Archive<br>Data Analytics<br>Private Cloud Content Delivery Network<br>Disk-to-Disk Backup via S3<br>Next Generation Applications using S3 back-end
|[[File:Svr_supermicro_2u12_6029p.png | center]]
|Per Server (4x):<br>Intel Xeon Dual E5-2620 / 12x LFF bay server<br>64GB RAM<br>2 x 800GB SATA SSD (RAID1/boot)<br>9 x 4TB SATA HDD (data)<br>1 x 800GB SATA SSD (journal)<br>2 x 10 Gbps Redundant Private Network Uplinks
<center>
|<center>{{QsButton|https://bit.ly/2QVqH95|View Design}}</center>
{{QsButton|https://bit.ly/2PfXuVt|View Design}}
{{QsButton|https://bit.ly/2KXF6CC|Provisioning Guide}}
{{QsButton|https://ibm.co/2DE53AG|Deploy}}
</center>
|-
|-
|}
|<center>432 raw / 288raw<br><br>QS 5 Image: 4 x LG (128TB)</center>
 
|<center>HDD + SSD</center>
{| class="wikitable" style="width: 100%;"
|<center>S3 / SWIFT</center>
|Highly-available Large Scale Object Storage Archive<br>Data Analytics<br>Private Cloud Content Delivery Network<br>Disk-to-Disk Backup via S3<br>Next Generation Applications using S3 back-end
|Per Server (4x):<br>Intel Xeon Dual E5-2620 / 12x LFF bay server<br>128GB RAM<br>2 x 800GB SATA SSD (RAID1/boot)<br>9 x 12TB SATA HDD (data)<br>1 x 800GB SATA SSD (journal)<br>2 x 10 Gbps Redundant Private Network Uplinks
|<center>{{QsButton|https://bit.ly/2Ir2V0N|View Design}}</center>
|-
|-
| style="width: 40%"|'''Large Tier - Hybrid Object Storage – 128TB'''
|<center>3072TB raw / 2026TB usable<br><br>QS 5 Image: 8 x 2XL (384TB)</center>
| style="width: 30%"|'''Use Cases'''
|<center>HDD + SSD</center>
| style="width: 30%"|'''System View'''
|<center>S3 / SWIFT</center>
|-
|2x E5-2650v4, 128GB RAM, 16x 8TB, QS Large Tier License <br> 2x 800GB SSDs (write log), 2x 1TB SATA (mirrored boot) <br> 2x 10GbE Private Network ports
|Highly-available Large Scale Object Storage Archive<br>Data Analytics<br>Private Cloud Content Delivery Network<br>Disk-to-Disk Backup via S3<br>Next Generation Applications using S3 back-end
|Highly-available Large Scale Object Storage Archive<br>Data Analytics<br>Private Cloud Content Delivery Network<br>Disk-to-Disk Backup via S3<br>Next Generation Applications using S3 back-end
|[[File:Svr_supermicro_2u12_6029p.png | center]]
|Per Server (8x):<br>Intel Xeon Dual E5-2620 / 36x LFF bay server<br>256GB RAM<br>2 x 800GB SATA SSD (RAID1/boot)<br>32 x 12TB SATA HDD (data)<br>2 x 960GB SATA SSD (journal)<br>2 x 10 Gbps Redundant Private Network Uplinks
<center>
|<center>{{QsButton|https://bit.ly/2WYhpil|View Design}}</center>
{{QsButton|https://bit.ly/2PfXuVt|View Design}}
{{QsButton|https://bit.ly/2KXF6CC|Provisioning Guide}}
{{QsButton|https://ibm.co/2DE53AG|Deploy}}
</center>
|-
|-
|}
|}


'''ALL-FLASH OBJECT STORAGE SOLUTIONS'''
{| class="wikitable" style="width: 100%;"
{| class="wikitable" style="width: 100%;"
|-
|-
| style="width: 40%"|'''Extra Large Tier - Hybrid Object Storage – 256TB'''
| style="width: 15%"|<center>'''Capacity'''</center>
| style="width: 30%"|'''Use Cases'''
| style="width: 10%"|<center>'''Media Type'''</center>
| style="width: 30%"|'''System View'''
| style="width: 10%"|<center>'''Protocol Support'''</center>
| style="width: 25%"|<center>'''Workload'''</center>
| style="width: 25%"|<center>'''Bill of Materials'''</center>
| style="width: 15%"|<center>'''Design'''</center>
|-
|-
|2x E5-2650v4, 256GB RAM, 32x 8TB, QS XL Tier License <br> 2x 800GB SSDs (write log), 2x 1TB SATA (mirrored boot) <br> 2x 10GbE Private Network ports <br>
|<center>152TB raw / 76TB usable<br><br>QS 5 Image: 4 x MD (48TB)</center>
|Highly-available Large Scale Object Storage Archive<br>Data Analytics<br>Private Cloud Content Delivery Network<br>Disk-to-Disk Backup via S3<br>Next Generation Applications using S3 back-end
|<center>SSD</center>
|[[File:Svr_supermicro_2u12_6029p.png | center]]
|<center>S3 / SWIFT</center>
<center>
|OpenStack<br>Virtualization<br>Data Analytics<br>Private Cloud Content Delivery Network<br>Next Generation Applications using S3 back-end
{{QsButton|https://bit.ly/2PfXuVt|View Design}}
|Per Server (4x):<br>Intel Xeon Dual E5-2620 / 12x LFF bay server<br>64GB RAM<br>2 x 800GB SATA SSD (RAID1/boot)<br>10 x 3.8TB SATA SSD (data)<br>2 x 10 Gbps Redundant Private Network Uplinks
{{QsButton|https://bit.ly/2KXF6CC|Provisioning Guide}}
|<center>{{QsButton|https://bit.ly/2K4c5Ur|View Design}}</center>
{{QsButton|https://ibm.co/2DE53AG|Deploy}}
</center>
|-
|-
|}
|}
== Quick Configuration Steps ==
== Quick Configuration Steps ==



Latest revision as of 19:41, 26 October 2020

IBM Cloud deployments of QuantaStor scale-out storage clusters provide dedicated and highly available file, block, and object storage which can be deployed an any of the IBM Cloud data-centers worldwide. Scale-out cluster use Ceph technology and provide NAS (NFS/SMB), SAN (iSCSI) and S3/SWIFT compatible object storage support in a single deployment. As the name implies, scale-out clusters may be expanded by adding storage media and/or additional QuantaStor servers.

Each server in a scale-out cluster must contain at least one SSD to accelerate write performance and each cluster must contain a minimum of 3x servers (6+ recommended) and a maximum of 32x servers (scalable to over 10PB in the IBM Cloud). QuantaStor’s storage grid technology enables systems to be grouped together and managed as a storage grid that can span IBM Cloud datacenters. Within a storage grid one or more storage clusters may be provisioned and managed via the QuantaStor web based management interface.


OSNEXUS Videos


Key Features

QuantaStor Scale-out Object Storage

  • S3 Object Storage Compatible REST API support
  • Hybrid HDD + SSD configuration to boost write performance
  • Easy web-based management of all systems with built-in QuantaStor storage grid technology.
  • Easy expansion by adding systems and/or drives.

Configurations

HYBRID OBJECT STORAGE SOLUTIONS

Capacity
Media Type
Protocol Support
Workload
Bill of Materials
Design
144TB raw / 96TB usable

QS 5 Image: 4 x MD (48TB)
HDD + SSD
S3 / SWIFT
Highly-available Large Scale Object Storage Archive
Data Analytics
Private Cloud Content Delivery Network
Disk-to-Disk Backup via S3
Next Generation Applications using S3 back-end
Per Server (4x):
Intel Xeon Dual E5-2620 / 12x LFF bay server
64GB RAM
2 x 800GB SATA SSD (RAID1/boot)
9 x 4TB SATA HDD (data)
1 x 800GB SATA SSD (journal)
2 x 10 Gbps Redundant Private Network Uplinks
View Design
432 raw / 288raw

QS 5 Image: 4 x LG (128TB)
HDD + SSD
S3 / SWIFT
Highly-available Large Scale Object Storage Archive
Data Analytics
Private Cloud Content Delivery Network
Disk-to-Disk Backup via S3
Next Generation Applications using S3 back-end
Per Server (4x):
Intel Xeon Dual E5-2620 / 12x LFF bay server
128GB RAM
2 x 800GB SATA SSD (RAID1/boot)
9 x 12TB SATA HDD (data)
1 x 800GB SATA SSD (journal)
2 x 10 Gbps Redundant Private Network Uplinks
View Design
3072TB raw / 2026TB usable

QS 5 Image: 8 x 2XL (384TB)
HDD + SSD
S3 / SWIFT
Highly-available Large Scale Object Storage Archive
Data Analytics
Private Cloud Content Delivery Network
Disk-to-Disk Backup via S3
Next Generation Applications using S3 back-end
Per Server (8x):
Intel Xeon Dual E5-2620 / 36x LFF bay server
256GB RAM
2 x 800GB SATA SSD (RAID1/boot)
32 x 12TB SATA HDD (data)
2 x 960GB SATA SSD (journal)
2 x 10 Gbps Redundant Private Network Uplinks
View Design

ALL-FLASH OBJECT STORAGE SOLUTIONS

Capacity
Media Type
Protocol Support
Workload
Bill of Materials
Design
152TB raw / 76TB usable

QS 5 Image: 4 x MD (48TB)
SSD
S3 / SWIFT
OpenStack
Virtualization
Data Analytics
Private Cloud Content Delivery Network
Next Generation Applications using S3 back-end
Per Server (4x):
Intel Xeon Dual E5-2620 / 12x LFF bay server
64GB RAM
2 x 800GB SATA SSD (RAID1/boot)
10 x 3.8TB SATA SSD (data)
2 x 10 Gbps Redundant Private Network Uplinks
View Design

Quick Configuration Steps

Step One: Storage Management Tab → Create Grid → Click OK
Step Two: Storage Management Tab → Add Grid Node → Enter 2nd Appliance IP → Click OK
Step Three: Storage Management Tab → Add Grid Node → Enter 3nd Appliance IP → Click OK
Step Four: Storage Management Tab → Controllers & Enclosures → Right-click Controller → Configure Pass-thru devices → Select all → Click OK (do this for each controller on each appliance)
Step Five: Storage Management Tab → Modify Storage System → Set Domain Suffix → Click OK (do this for each appliance)
Step Six: Scale-out Object Storage Tab → Create Ceph Cluster → Select all appliances → Click OK
Step Seven: Scale-out Object Storage Tab → Multi-Create OSDs → Select SSDs as journals, HDDs as OSDs → Click OK
Step Eight: Scale-out Object Storage Tab → Create Object Storage Pool Group → Select Erasure Coding Mode → Click OK