Template:CephTroubleshooting - Revision history

Qadmin: /* Node Failure and Replacement */

2025-04-03T04:03:02Z

Node Failure and Replacement

← Older revision		Revision as of 04:03, 3 April 2025
Line 18:		Line 18:
	== Node Failure and Replacement ==		== Node Failure and Replacement ==

	In the event a node has completely failed (due to hardware failure, ~~decomissioning~~, or other action), the node should be ~~removed~~ from the ~~Ceph~~ cluster.		In the event a node has completely failed (due to hardware failure, decommissioning, or other action), the node should be replaced with a new server. If the media within the failed server is not damaged it should be moved into the new server so that the OSDs can be recovered more quickly without having to rebuild them all from scratch. If the cluster node and all its OSD devices are lost then we will assist with removing the node and all of the associated OSDs from the cluster. A new node or nodes may be added to the cluster at any time. See the Management and Operations section for details on Adding and Removing Ceph Cluster Members.

	A new node ~~can then~~ be added to the cluster ~~(if desired or necessary)~~.

	See the Management and Operations section for details on Removing ~~and Adding a node to a~~ Ceph ~~cluster~~.

Qadmin: /* Hardware Disk Failure */

2025-04-03T04:00:00Z

Hardware Disk Failure

← Older revision		Revision as of 04:00, 3 April 2025
Line 4:		Line 4:
	The following guide will provide an outline of steps to take when encountering issues with Scale-out SAN and Object Storage using Ceph in a QuantaStor environment.		The following guide will provide an outline of steps to take when encountering issues with Scale-out SAN and Object Storage using Ceph in a QuantaStor environment.

	== Hardware ~~Disk~~ Failure ==		== Hardware NVMe/SSD/HDD Device Failure ==

	* Replace failed drive and ~~return hardware RAID5 to normal operational status~~		* Replace failed drive using the Replace Prepare function to remove the device from the cluster gracefully and prepare it for replacement with a new device.

	== Node Connectivity Issues ==		== Node Connectivity Issues ==

Qadmin: /* Storage Pool / RAID LUN Failure */

2019-06-04T17:45:25Z

Storage Pool / RAID LUN Failure

← Older revision		Revision as of 17:45, 4 June 2019
Line 7:		Line 7:

	* Replace failed drive and return hardware RAID5 to normal operational status		* Replace failed drive and return hardware RAID5 to normal operational status

	~~== Storage Pool / RAID LUN Failure ==~~

	* Identify cause of storage loss
	** If correctable, restore connectivity/availability of underlying storage and import pool. OSD will return to normal status automatically
	** If not correctable, remove the OSD from the Ceph configuration. Provide new storage and use the steps described in the Management and Operations section to create a new OSD (and Journal if necessary).

	== Node Connectivity Issues ==		== Node Connectivity Issues ==

Qadmin: /* Storage Pool / RAID LUN Failure */

2016-03-23T18:44:02Z

Storage Pool / RAID LUN Failure

← Older revision		Revision as of 18:44, 23 March 2016
Line 13:		Line 13:
	** If correctable, restore connectivity/availability of underlying storage and import pool. OSD will return to normal status automatically		** If correctable, restore connectivity/availability of underlying storage and import pool. OSD will return to normal status automatically
	** If not correctable, remove the OSD from the Ceph configuration. Provide new storage and use the steps described in the Management and Operations section to create a new OSD (and Journal if necessary).		** If not correctable, remove the OSD from the Ceph configuration. Provide new storage and use the steps described in the Management and Operations section to create a new OSD (and Journal if necessary).


	== Node Connectivity Issues ==		== Node Connectivity Issues ==

Qadmin at 18:02, 23 March 2016

2016-03-23T18:02:50Z

← Older revision		Revision as of 18:02, 23 March 2016
Line 6:		Line 6:
	== Hardware Disk Failure ==		== Hardware Disk Failure ==

			* Replace failed drive and return hardware RAID5 to normal operational status

	== Storage Pool / RAID LUN Failure ==		== Storage Pool / RAID LUN Failure ==

			* Identify cause of storage loss
			** If correctable, restore connectivity/availability of underlying storage and import pool. OSD will return to normal status automatically
			** If not correctable, remove the OSD from the Ceph configuration. Provide new storage and use the steps described in the Management and Operations section to create a new OSD (and Journal if necessary).


	== Node Connectivity Issues ==		== Node Connectivity Issues ==

			* Verify networking hardware infrastructure is correct and all cabling valid
			* Verify that node network configuration is correct under System Management
			** Note that all nodes must share networks on the same network port (ie, All nodes should have 10.0.0.0/16 on ethX, 192.168.0.0/16 on ethY)

			Ceph will automatically restore OSD status and rebalance data once network status has been successfully restored.

	== Node Failure and Replacement ==		== Node Failure and Replacement ==

			In the event a node has completely failed (due to hardware failure, decomissioning, or other action), the node should be removed from the Ceph cluster.

			A new node can then be added to the cluster (if desired or necessary).

			See the Management and Operations section for details on Removing and Adding a node to a Ceph cluster.

Qadmin at 17:30, 23 March 2016

2016-03-23T17:30:52Z

← Older revision		Revision as of 17:30, 23 March 2016
Line 1:		Line 1:
	= Troubleshooting =		= Troubleshooting =
			<!-- Header will be merged into including documents / Including here for initial authoring purposes -->

	The following guide will provide an outline of steps to take when encountering issues with Scale-out SAN and Object Storage using Ceph in a QuantaStor environment.		The following guide will provide an outline of steps to take when encountering issues with Scale-out SAN and Object Storage using Ceph in a QuantaStor environment.

Qadmin: Created page with "= Troubleshooting = The following guide will provide an outline of steps to take when encountering issues with Scale-out SAN and Object Storage using Ceph in a QuantaStor env..."

2016-03-23T17:29:42Z

Created page with "= Troubleshooting = The following guide will provide an outline of steps to take when encountering issues with Scale-out SAN and Object Storage using Ceph in a QuantaStor env..."

New page

= Troubleshooting =

The following guide will provide an outline of steps to take when encountering issues with Scale-out SAN and Object Storage using Ceph in a QuantaStor environment.

== Hardware Disk Failure ==

== Storage Pool / RAID LUN Failure ==

== Node Connectivity Issues ==

== Node Failure and Replacement ==