Oracle ZFS Storage Appliance : How to Configure Cluster Cabling Correctly

Asset ID:	1-71-2081179.1
Update Date:	2018-05-10
Keywords:

Solution Type Technical Instruction Sure

Solution 2081179.1 : Oracle ZFS Storage Appliance : How to Configure Cluster Cabling Correctly

Applies to:

Oracle ZFS Storage ZS3-BA - Version All Versions and later
Oracle ZFS Storage ZS4-4 - Version All Versions and later
Sun Storage 7310 Unified Storage System - Version All Versions and later
Oracle ZFS Storage Appliance Racked System ZS4-4 - Version All Versions and later
Sun Storage 7410 Unified Storage System - Version All Versions and later
7000 Appliance OS (Fishworks)

Goal

This document provides guidance (and illustrations) on how to correctly cable the cluster links between the two heads.

Solution

IMPORTANT NOTICE

If the 'UART0' and 'UART1' ports are cabled 'straight through' instead of 'crossover' (see the RED and BLUE cables below) there is a risk of a cluster 'split brain' situation - each cluster head believes that it is
the only 'active' head in the cluster - which could result in BOTH cluster heads importing the data pools (a 'double import').

In this situation, both cluster heads may direct I/O to the pools - which may result in data corruption.

This 'split brain' situation may occur at any time after a period of 'normal' running, and the loss of redundancy is not a 'stop' condition for the clustered appliance.

Please take extra care when performing hardware maintenance operations on one of the heads - it is critical to ensure that the clustron cables are plugged in correctly - according to the specific schema below.

What cables are required ? For further information see http://docs.oracle.com/cd/E71909_01/html/E71918/gqucg.html#scrolltoc

NOTE: "Gather the three 1-meter Ethernet cables that were supplied for connecting clustered controllers. If supplying your own Ethernet cables, ensure they are straight-through and Category 5 or better."

Sun Storage 7310 Unified Storage System

System	Part Number	Clustron Card Slot
7310	371-3024	Slot 0
7310 (SAS-2)	371-3024	Slot 0
	542-0298
	7056175
	7089470

7310 cluster links

NOTE: The cables connecting the 'left' and 'right' ports CROSS OVER.

Sun Storage 7410 Unified Storage System

System	Part Number	Clustron Card Slot
7410	371-3024	Slot 5
7410 (SAS-2)	371-3024	Slot 5
	542-0298
	7056175
	7089470

7410 cluster links

NOTE: The cables connecting the 'left' and 'right' ports CROSS OVER.

Sun ZFS Storage 7320

System	Part Number	Clustron card Slot
7320	542-0298	Slot 1
	7056175
	7089470

7320 cluster links

NOTE: The cables connecting the 'left' and 'right' ports CROSS OVER.

Sun ZFS Storage 7420

System	Part Number	Clustron card Slot
7420	542-0298	(Dedicated)
	7056175
	7089470

7420 cluster links

NOTE: The cables connecting the 'top' and 'bottom' ports CROSS OVER.

Sun ZFS Backup Appliance

System	Part Number	Clustron card Slot
ZFS-BA	542-0298	(Dedicated)
	7056175
	7089470

7420 cluster links

NOTE: The cables connecting the 'top' and 'bottom' ports CROSS OVER.

Oracle ZFS Storage ZS3-2

System	Part Number	Clustron Card Slot
ZS3-2	(On-board MB)	N/A

ZS3-2 cluster links

NOTE: The cables connecting the 'left' and 'centre' ports CROSS OVER.

Oracle ZFS Storage ZS3-4

System	Part Number	Clustron Card Slot
ZS3-4	7056175	(Dedicated)
	7089470

7420 cluster links

NOTE: The cables connecting the 'top' and 'bottom' ports CROSS OVER.

Oracle ZFS Storage ZS3-BA

System	Part Number	Clustron Card Slot
ZS3-BA	7056175	(Dedicated)
	7089470

7420 cluster links

NOTE: The cables connecting the 'top' and 'bottom' ports CROSS OVER.

Oracle ZFS Storage ZS3-ES

System	Part Number	Clustron Card Slot
ZS3-ES	7056175	Slot 2
	7089470

ZS3-ES cluster links

NOTE: The cables connecting the 'left' and 'right' ports CROSS OVER.

Oracle ZFS Storage ZS4-4

System	Part Number	Clustron Card Slot
ZS4-4	7056175	(Dedicated)
	7089470

7420 cluster links

NOTE: The cables connecting the 'top' and 'bottom' ports CROSS OVER.

Oracle ZFS Storage Appliance Racked System ZS4-4

System	Part Number	Clustron Card Slot
ZS4-4 Racked	7089470	(Dedicated)

7420 cluster links

NOTE: The cables connecting the 'top' and 'bottom' ports CROSS OVER.

Oracle ZFS Storage ZS5-2

System	Part Number	Clustron Card Slot
ZS5-2	7092289	Slot 4

7420 cluster links

NOTE: The cables connecting the 'top' and 'bottom' ports CROSS OVER.

Oracle ZFS Storage ZS5-4

System	Part Number	Clustron Card Slot
ZS5-4	7311641	Slot 4

7420 cluster links

NOTE: The cables connecting the 'top' and 'bottom' ports CROSS OVER.

Check for relevancy - 10-May-2018

Attachments

This solution has no attachment