Sun Storage 7000 Unified Storage System: Quick Reference for ZFS Storage Appliance Hardware Configuration

Asset ID:	1-79-1554743.1
Update Date:	2018-05-01
Keywords:

Solution Type Predictive Self-Healing Sure

Solution 1554743.1 : Sun Storage 7000 Unified Storage System: Quick Reference for ZFS Storage Appliance Hardware Configuration

Applies to:

Sun ZFS Storage 7120 - Version All Versions and later
Sun Storage 7310 Unified Storage System - Version All Versions and later
Oracle ZFS Storage ZS3-2 - Version All Versions and later
Sun ZFS Storage 7320 - Version All Versions and later
Sun Storage 7410 Unified Storage System - Version All Versions and later
7000 Appliance OS (Fishworks)

Purpose

Quick reference for Series 7000 NAS/ZFS Storage Appliance hardware configuration.

To discuss this information further with Oracle experts and industry peers, we encourage you to review, join or start a discussion in the My Oracle Support Community - Disk Storage ZFS Storage Appliance

Scope

This page provides an over view of the ZFS Storage Appliance products hardware and compatibily metrics.

Details

MACH8 disks are READZILLAs (located on the node) and ZEUS are LOGZILLAs (located in the JBOD);

Serial Management interface SP console (SERIAL MGT) connect with RJ-45 cable
Network Management interface SP console (NET MGT) connect with RJ-45 cable

Appliance Kit Software is located in Doc ID 2021771.1
ZFS Storage Appliance (AR) Intergrated Engineering Metrics
Motherboard replacement documentation
Fishstick procedures (Internal Only) USB Doc ID 1446500.1 requires dual boot OS and Virtual Doc ID 1572801.1

Sun Storage 7110 Unified Storage System

Sun Fire X4240, Code name IWASHI - no readzillas and logzillas (drives sit in the front of the 7110, no JBOD)
Documentation: http://docs.oracle.com/cd/E19548-01/index.html
Hardware: 7110 Unified Storage System
Disk Location: http://docs.oracle.com/cd/E19548-01/pdf/821-1388.pdf (page 35)
No extended storage shelves

SCSI:#0400 ID00
SCSI:#0400 ID01
OS disk (disk slot# 0 & 1)

The supported configuration consists of either 16 internal 146GB 10K 2.5" SAS disk drives with a total of 2TB or 16 internal 300GB 10K 2.5" SAS disk drives with a total of 4.2TB.

Two drives(disk # 0 & 1) will be used for the OS in a RAID 1 (mirror) and the remaining 14 drives are available for storage.

Gigabit Ethernet connectors (NET0, NET1, NET2, NET3) connect with RJ-45 cable
HBA SAS card is located in PCIe slot 0 (375-3356) 4Gigabit/Sec PCI Express Dual FC Host Adapter
FC HBA Opt card is located in PCIe slot 2, 3, and 4 (371-4325) 8Gigabit/Sec PCI Express Dual FC Host Adapter
Infiniband is located in PCIe slot 1, 2 and 3 (375-3606-01) Dual Port 40Gb/sec 4x Infiniband QDR

All PCIe cards are low-profile, and must be fitted with low-profile mounting brackets.
Note that 10Gb Ethernet NIC cards must not be combined with 1Gb Ethernet NIC cards in the same system.
Note that 375-3606-01 HCA expansion cards are not supported in the 10Gb network configurations

ILOM - Reference Documentation

http://docs.oracle.com/cd/E19121-01/sf.x4140/820-1188-12/820-1188-12.pdf

Addendum http://docs.oracle.com/cd/E19121-01/sf.x4240/820-4198-12/820-4198-12.pdf

Sun Storage 7210 Unified Storage System

Sun Fire X4540, Code name FUGU - no readzillas and logzillas - J4500 SAS-1 is a standard configuration (internal disk drives, open the top of the unit)
Documentation: http://docs.oracle.com/cd/E19548-01/index.html
Hardware: 7210 Unified Storage System
Disk Location: http://docs.oracle.com/cd/E19548-01/pdf/821-1388.pdf (page 37)
No extended storage shelves

SCSI:#0200 ID00
SCSI:#0200 ID01
OS disk (disk slot# 0 & 1)

Up to forty-eight 3.5-inch SATA-II drives of 250GB - 1TB capacity (48TB total system capacity)
Up to two Solid State Drives 18GB 3.5" SATA
As an option, the 7210 offers expanded storage up to 144 TB using a maximum of two J4500
disk shelves via an external SAS HBA card, Sun part # 594-4098-04 (PTO), 596-6707-04 (ATO)
and 4XMini SAS Shielded Cables.

ILOM - Reference Documentation

http://docs.oracle.com/cd/E19121-01/sf.x4140/820-1188-12/820-1188-12.pdf

Addendum http://docs.oracle.com/cd/E19121-01/sf.x4240/820-4198-12/820-4198-12.pdf

Sun Storage 7310 Unified Storage System

Sun Fire X4140, Code name MAGURO - Can accept both readzillas and logzillas - J4400 JBOD SAS-1 is a standard configuration
Documentation: http://docs.oracle.com/cd/E19548-01/pdf/821-1388.pdf
Hardware: 7310 (SAS 1.0) Unified Storage System

Sun Fire X4140, Code name MAGURO 7310 with a SAS-2 backend and different HBA's and a different JBOD and part numbers are NOT interchangeable between SAS-1 and SAS-2 systems.
Hardware: 7310 (SAS 2.0) Unified Storage System
Disk Location (takes both read and logzillas): http://docs.oracle.com/cd/E19548-01/pdf/821-1388.pdf (page 48)
Sun Unified Storage 7310 standalone can support up to four J4400/Sun Disk shelves.
Sun Unified Storage 7310 cluster with four J4400/Sun Disk shelves

SATA:11M-XXX
SATA:12M-XXX
OS disk (disk slot# 6 & 7)

Two mirrored hard disk drives (HDDs) that store the operating system reside in slots 6 and 7.
Up to six solid state drives (ReadZilla SSDs) that store the read cache fill slots 0 through 5, in order.

To cable the controller to the disk shelves, use the following guidelines:

Connect each disk chain to two HBAs if available.
Maximize the number of Disk Shelves chains before adding disk shelves to an individual chain.
Balance the number of Disk Shelves across the disk chains in your system.
Controllers cannot use 2X4 port SAS-2 HBAs

Max number of Sun Disk Shelves for a standalone: one 2X4 port SAS-2 HBAs in slot PCIe1with one HBA PCIE3 with 4 disk shelves in a single chain.
Max number of Sun Disk Shelves for a cluster: one 2X4 port SAS-2 HBAs in slot PCIe1with one HBA PCIE3 with 4 disk shelves.

ILOM - Reference Documentation

http://docs.oracle.com/cd/E19121-01/sf.x4140/820-1188-12/820-1188-12.pdf

Addendum http://docs.oracle.com/cd/E19121-01/sf.x4240/820-4198-12/820-4198-12.pdf

Sun Storage 7410 Unified Storage System

Sun Fire X4440, Code name TORO Bigger version of the 7310 - J4400 JBOD SAS-1 is a standard configuration
Documentation: http://docs.oracle.com/cd/E19548-01/pdf/821-1388.pdf
Hardware: 7410 (SAS 1.0) Unified Storage System

Sun Fire X4440, Code name TORO 7410 with a SAS-2 backend have different HBA's and a different JBOD and part numbers are NOT interchangeable between SAS-1 and SAS-2 systems
Hardware: 7410 (SAS 2.0) Unified Storage System
Disk Location: http://docs.oracle.com/cd/E19548-01/pdf/821-1388.pdf(page 60)
Sun Unified Storage 7410 is available with either one or two or three HBA cards installed, each of which can support up to four J4400/Sun Disk shelves for a total of 12 disk shelves.

SATA:11M-XXX
SATA:12M-XXX
OS disk (disk slot # 6 & 7)
The 500GB Boot Drives (HDDs) reside in slots 6 and 7 as a mirrored set , and the Sun Storage ReadZilla Flash 2.5" 100GB solid state drives (SSD's), will fill in order, slots 0 through 5.

You can have a maximum of 6 Sun Storage ReadZilla Flash SSD's.

To cable the controller to the disk shelves, use the following guidelines:

Max number of Sun Disk Shelves for a standalone: one 2X4 port SAS-2 HBAs in slot PCIe1with one HBA PCIE0 with 4 disk shelves in a single chain or two PCIE0, PCIE2 HBAs and 8 J4400/Sun Disk shelves or three PCIE0, PCIE2, PCIE3 HBAs and 12 J4400/Sun Disk shelves.
Max number of Sun Disk Shelves for a cluster: one 2X4 port SAS-2 HBAs in slot PCIe1with one HBA PCIE0 with 4 disk shelves or two PCIE0, PCIE2 HBAs and 8 J4400/Sun Disk shelves or three PCIE0, PCIE2, PCIE3 HBAs and 12 J4400/Sun Disk shelves..

ILOM - Reference Documentation

http://docs.oracle.com/cd/E19121-01/sf.x4140/820-1188-12/820-1188-12.pdf

Addendum http://docs.oracle.com/cd/E19121-01/sf.x4240/820-4198-12/820-4198-12.pdf

Sun ZFS Storage 7120

Sun Fire X4270, M2, Code name IWASHI + Replacement for the 7110 -Disk Shelf 24x3.5" SAS-2
Documentation: http://docs.oracle.com/cd/E22471_01/index.html
Hardware: 7120 (SAS 2.0) Unified Storage System
Disk Location: http://docs.oracle.com/cd/E22471_01/pdf/821-1792.pdf (page 25)
cabling: http://docs.oracle.com/cd/E22471_01/html/821-1673/installation__7120_cabling.html
Sun ZFS Storage 7120 can support up to two Sun Disk shelves

HDD:P0
HDD:P1
Drive location
OS disk rear panel (disk slot # 0 & 1)
Two mirrored hard disk drives (HDDs) that store the operating system reside in slots 0 and 1.
Storage Drive Backplane (Front Panel) - The storage drive backplane is a FRU and includes the connectors for the storage drives, as well as the interconnect for the I/O board, Power and Locator buttons, and system/component status LEDs. The system has a 12-disk backplane. Each drive has an LED indicator for Power/Activity, Fault, and Locate.

The NIC ports are PCIe1, PCIe4
The InfiniBand ports are PCIe1
The SAS HBA ports are PCIe3, PCIe4
The 8Gb DP FC HBA ports are PCIe1, PCIe4
The Flash HBA Logzilla ports are PCIe0

To cable the controller to the disk shelves, use the following guidelines:

Max number of Sun Disk Shelves for a standalone: one 2X4 port SAS-2 HBAs in slot PCIe3 with one HBA PCIE3 with 2 disk shelves in a single chain.

ILOM - Reference Documentation

http://docs.oracle.com/cd/E19860-01/index.html

Sun ZFS Storage 7320

Sun Fire X4170 M2 , Code name MAGURO + Replacement for the 7410 - Disk Shelf 24x3.5" SAS-2
Documentation: http://docs.oracle.com/cd/E22471_01/pdf/821-1792.pdf
Hardware: 7320 (SAS 2.0) Unified Storage System
Disk Location: http://docs.oracle.com/cd/E22471_01/pdf/821-1792.pdf (page 38)
Cabling: http://docs.oracle.com/cd/E22471_01/html/821-1673/installation__7320_cabling.html
Cluster Cabling: http://docs.oracle.com/cd/E22471_01/html/821-1673/installation__7320_cluster_cabling.html
Sun ZFS Storage 7320 standalone can support up to four Sun Disk shelves or four DE2-24 shelves
Sun ZFS Storage 7320 cluster can support up to four Sun Disk shelves or six DE2-24 shelves.

HDD:P0
HDD:P1
Drive location
OS disk (disk slot # 0 & 1)
Two mirrored hard disk drives (HDDs) that store the operating system reside in slots 0 and 1. Up to four solid state drives (ReadZilla SSDs) that store the read cache fill slots 2 through 5, in order. Slots 6 and 7 are empty and must contain drive fillers.

Configuration options for a single controller
The NIC ports are PCIe0, PCIe1
The InfiniBand ports are PCIe0
The SAS HBA ports are PCIe2
The 8Gb DP FC HBA ports are PCIe0,PCIe1

Configuration options clustered storage controllers
The NIC ports are PCIe0
The InfiniBand ports are PCIe0
The SAS HBA ports are PCIe2
The 8Gb DP FC HBA ports are PCIe0
The Clustron Card PCIe1

To cable the controller to the disk shelves, use the following guidelines:

Connect each disk chain to two HBAs if available.
Maximize the number of Disk Shelves chains before adding disk shelves to an individual chain.
Balance the number of Disk Shelves across the disk chains (HBA card) in your system.
Disks with different capacities or rotation speeds cannot be mixed within a single disk shelf.
To use mixed disk shelf types (Sun Disk Shelves and DE2-24 Shelves), the controller must have only 4X4 port SAS-2 HBAs.
*Do not use mixed disk shelves (Sun Disk Shelves and DE2-24 Shelves) in the same chain, each must be on their own SAS fabric.
*Controllers cannot use 2X4 port SAS-2 HBAs and 4X4 port SAS-2 HBAs at the same time on the chassis.
To use DE2 and Sun Disk Shelves together, the controller must use 4X4 port SAS-2 HBAs, which are only supported with release AK 2013.1.0 and later.

Max number of Sun Disk Shelves for a standalone: one 2X4 port SAS-2 HBAs in slot PCIe2 with one HBA up to 4 disk shelves in a single chain.
Max number of Sun Disk Shelves for a cluster: one 2X4 port SAS-2 HBAs in slot PCIe2 per node with one HBA in two chains up to 4 disk shelves.

Max number of DE2-24 Shelves for a standalone: one 4X4 port SAS-2 HBAs in slot PCIe2 with 2 disk shelves in two chains up to 4 shelves.
Max number of DE2-24 Shelves for a cluster: one 4X4 port SAS-2 HBAs in slot PCIe2 per node with 2 disk shelves in two chains up to 6 shelves.

ILOM - Reference Documentation

http://docs.oracle.com/cd/E19860-01/index.html

Sun ZFS Storage 7420

Sun Fire X4470 and Sun Fire X4470 M2, Code name OTORO Replacement for the 7410 - Optional Sun Disk Shelf 24x3.5" SAS-2
Documentation: http://docs.oracle.com/cd/E22471_01/pdf/821-1792.pdf
Hardware: 7420 (SAS 2.0) Unified Storage System
Disk Location: http://docs.oracle.com/cd/E22471_01/pdf/821-1792.pdf (page 43 & 44)
Cabling: http://docs.oracle.com/cd/E22471_01/html/821-1673/installation__7420_cabling_pt.1.html
Cluster Cabling: http://docs.oracle.com/cd/E22471_01/html/821-1673/installation__7420_cluster_cabling_pt.1.html

Sun ZFS Storage 7420 is available with either two, three, or four HBA cards installed, each of which can support up to six disk shelves in a single chain for a total of 24 disk shelves or Six HBAs total of 36 DE2-24 disk shelves.
Sun ZFS Storage 7420 cluster is available with either two, three, or four HBA cards installed, each of which can support up to six disk shelves in a single chain for a total of 24 disk shelves or Six HBAs total of 36 DE2-24 disk shelves.

HDD:P0
HDD:P1
Drive Location
OS disk (disk slot # 0 & 1)
The 500GB boot drives (HDDs) reside in slots 0 and 1 as a mirrored set, and Sun Storage Readzilla 512GB solid state drives (SSDs), may optionally fill, in order, slots 2 through 5. Each storage controller may have 0, 2, 3, or 4 Readzilla devices.

The 7420 M2 reserves slot 0 for a SAS-2 internal HBA, and slots 1 and 8 for two SAS-2 external HBAs

10Gb Ethernet and Quad 1Gb Ethernet - Slot 7, 2, 6, 3, 5, 4, 0 (not available for 7420 M2), 9
SAS-2 external HBA - Slot 2, 7, 3, 6
The Infiniband ports - Slot 7, 2, 6, 3, 5, 4
The 8Gb DP FC HBA - Slot 7, 2, 6, 3, 5, 4, 0 (not available for 7420 M2)
The Clustron Card is in the Cluster Card slot C

Max number of Sun Disk Shelves for a standalone: one 2X4 port SAS-2 HBAs in slot PCIe1 with one HBA up to 6 disk shelves in a single chain or two HBA's PCIe1 and PCIe2 up to 12 shelves in two chains or three HBAs PCIe1, PCIe2 and PCIe7 up to 18 shelves in three chains or four HBAs PCIe1, PCIe2, PCIe7 and PCIe8 up to 24 shelves in four chains.
Max number of Sun Disk Shelves for a cluster: one 2X4 port SAS-2 HBAs in slot PCIe1 with one HBA up to 6 disk shelves in a single chain or two HBA's PCIe1 and PCIe2 up to 12 shelves in two chains or three HBAs PCIe1, PCIe2 and PCIe7 up to 18 shelves in three chains or four HBAs PCIe1, PCIe2, PCIe7 and PCIe8 up to 24 shelves in four chains.

When installing additional PCIe cards to your base 7420 configuration, cards must be added in a specific order.
Note: The 7420 M2 reserves slot 0 for a SAS-2 internal HBA, and slots 1 and 8 for two SAS-2 external HBAs (see PCIe Options).

Max number of DE2-24 Shelves for a standalone Sun Fire X4470 M2: one 4X4 port SAS-2 HBAs in slots PCIe1, PCIe2, PCIe7 and PCIe8 with Six HBAs and 36 disk shelves in six chains.
Max number of DE2-24 Shelves for a cluster Sun Fire X4470 M2: one 4X4 port SAS-2 HBAs in slots PCIe1, PCIe2, PCIe7 and PCIe8 with Six HBAs and 36 disk shelves in six chains.

ILOM - Reference Documentation

http://docs.oracle.com/cd/E19860-01/index.html

Oracle ZFS Storage ZS3-2

Netra X3-2 Server , Code name MAGURO-G2, Disk Shelf Oracle Storage DE2-24C or Oracle Storage DE2-24P
Documentation: http://docs.oracle.com/cd/E27998_01/index.html
Hardware: Oracle ZFS Storage ZS3-2
Disk Location: http://docs.oracle.com/cd/E27998_01/pdf/E48492.pdf (Page 29)
Cabling: http://docs.oracle.com/cd/E27998_01/html/E48491/installation__de2_to_zs3-2_7120_7320_standalone.html
Cluster Cabling: http://docs.oracle.com/cd/E27998_01/html/E48491/installation__de2_to_zs3-2_7320_clustered.html
Cluster Ports: on board the system board
Sun ZFS Storage ZS3-2 standalone can support up to eight DE2-24 shelves with two HBA card
Sun ZFS Storage ZS3-2 standalone can support up to sixteen DE2-24 shelves with two HBA cards

HDD: P0
HDD: P1
Drive Location
OS disk (disk slot 0 & 1 )

Disk Slots--Front Panel
Top: Slot 4 (SSD) Slot 5 (SSD) Slot 6 (Filler) Slot 7 (Filler)
Bottom: Slot 0 (Boot) Slot 1 (Boot) Slot 2 (SSD) Slot 3 (SSD)

Two 900GB SAS-2 boot drives reside in slots 0 and 1 as a mirrored set. The ZS3-2 supports up to four optional 1.6TB flash read-optimized (Readzilla) solid state drives (SSDs). The SSDs are installed in slots 2 through 5 (in order).

The 1Gbe NIC ports are PCIe3, PCIe4 , PCIe5 and PCIe6.
The SAS-2 HBA ports are PCIe1, PCIe2 and PCIe3.
The Infiniband ports are PCIe3, PCIe4 , PCIe5 and PCIe6.
The 8Gb DP FC HBA ports are PCIe3, PCIe4 , PCIe5 and PCIe6.
The 10Gb Ethernet ports are PCIe3, PCIe4 , PCIe5 and PCIe6.

PCIe Slots--Rear Panel
Top: Slot 4 Slot 5 Slot 6
Bottom: Slot 1 Slot 2 Slot 3

The three Cluster I/O ports (0, 1, and GigE) are reserved for cluster interconnection only.
PCIe Slots 1 and 2 are reserved for internal- and external HBAs. When adding PCIe cards, populate from higher order slots (6) first toward lower order slots. Note: Any empty PCIe slots must have a filler panel installed.

To cable the controller to the disk shelves, use the following guidelines:

Connect each disk chain to two HBAs if available.
Maximize the number of Disk Shelves chains before adding disk shelves to an individual chain.
Balance the number of Disk Shelves across the disk chains in your system.
Disks with different capacities or rotation speeds cannot be mixed within a single disk shelf.
To use mixed disk shelf types (Sun Disk Shelves and DE2-24 Shelves), the controller must have only 4X4 port SAS-2 HBAs.
* Do not use mixed disk shelves (Sun Disk Shelves and DE2-24 Shelves) in the same chain, each must be on their own SAS fabric.
* Controllers cannot use 2X4 port SAS-2 HBAs and 4X4 port SAS-2 HBAs at the same time on the chassis.
To use DE2 and Sun Disk Shelves together, the controller must use 4X4 port SAS-2 HBAs, which are only supported with release AK 2013.1.0 and later.

Max number of Sun Disk Shelves for a standalone: one 2X4 port SAS-2 HBAs in slot PCIe1 with 4 disk shelves.
Max number of Sun Disk Shelves for a cluster: one 2X4 port SAS-2 HBAs in slot PCIe1 with 4 disk shelves.

Max number of DE2-24 Shelves for a standalone: one 4X4 port SAS-2 HBAs in slot PCIe2 with 2 disk shelves per two disk chains total 4 disk shelves or two HBA in slots PCIE2 and PCIE3 with 2 disk shelves per four disk chains up to 8 disk shelves.
Max number of DE2-24 Shelves for a cluster: one 4X4 port SAS-2 HBAs in slot PCIe2 with 4 disk shelves across per two disk chains for a total of 8 disk shelves or two HBA in slots PCIE 2 and PCIE3 with 4 disk shelves across per 4 disk chains up to 16 disk shelves.

ILOM - Reference Documentation

http://docs.oracle.com/cd/E24707_01/index.html
http://docs.oracle.com/cd/E27124_01/html/E27125/z40005d61993629.html#scrolltoc

Oracle ZFS Storage ZS3-4

Sun Server X2-4 , Code name OTORO -Z3, Disk Shelf Oracle Storage DE2-24C or Oracle DE2-24P
Documentation: http://docs.oracle.com/cd/E27998_01/index.html
Hardware:Oracle ZFS Storage ZS3-4
Disk Location: http://docs.oracle.com/cd/E27998_01/pdf/E48492.pdf (page 42)
Cabling Mixed Disk Shelves: http://docs.oracle.com/cd/E27998_01/html/E48491/installation__zs3-4_7420_with_de2_and_sun_disk_shelves.html
Clustered Cabling Mixed Disk Shelves: http://docs.oracle.com/cd/E27998_01/html/E48491/installation__zs3-4_7420_clustered_with_de2_and_sun_disk_shelves.html
Cluster Ports: PCIE slot 'Cluster Card'

Sun ZFS Storage 7420 is available with either two, three, or four HBA cards installed, each of which can support up to six disk shelves in a single chain for a total of 24 disk shelves or Six HBAs total of 36 DE2-24 disk shelves.
Sun ZFS Storage 7420 cluster is available with either two, three, or four HBA cards installed, each of which can support up to six disk shelves in a single chain for a total of 24 disk shelves or Six HBAs total of 36 DE2-24 disk shelves.

HDD: P0
HDD: P1
Drive Location
OS disk (disk slot 0 & 1 )

The ZS3-4 controller has two 900GB SAS-2 system boot drives in slots 0 and 1, configured as a mirrored pair. Up to four 1.6TB SAS-2 Readzilla SSDs can fill slots 2 through 5, in order.

The SAS-2 internal HBA is PCIe0
The 1Gbe NIC ports are PCIe2, PCIe3, PCIe4 , PCIe5 , PCIe6, PCIe7 and PCIe9
The SAS-2 HBA ports are PCIe1, PCIe2, PCIe7 and PCIe8, the other two HBA slots are PCIe3 and PCIe6 for Six HBAs total of 36 DE2-24 disk shelves
The Infiniband ports are PCIe2, PCIe3, PCIe4 , PCIe5 , PCIe6 and PCIe7
The 8Gb DP FC HBA ports are PCIe2, PCIe3, PCIe4 , PCIe5 , PCIe6, PCIe7 and PCIe9
The 10Gb Ethernet ports are PCIe2, PCIe3, PCIe4 , PCIe5 , PCIe6, PCIe7 and PCIe9

When installing additional PCIe cards to your base ZS3-4 configuration, cards must be added in a specific order.
Note: The 7420 M2 reserves slot 0 for a SAS-2 internal HBA, and slots 1 and 8 for two SAS-2 external HBAs (see PCIe Options).

Max number of DE2-24 Shelves for a standalone Sun Fire X4470 M2: one 4X4 port SAS-2 HBAs in slots PCIe1, PCIe2, PCIe7 and PCIe8 with Six HBAs and 36 disk shelves in six chains.
Max number of DE2-24 Shelves for a cluster Sun Fire X4470 M2: one 4X4 port SAS-2 HBAs in slots PCIe1, PCIe2, PCIe7 and PCIe8 with Six HBAs and 36 disk shelves in six chains.

ILOM - Reference Documentation

http://docs.oracle.com/cd/E19860-01/E21549/z4002bd41037689.html#scrolltoc

Oracle ZFS Storage ZS3-ES

Sun Server X3-2, Code name Akami, Disk Shelf Oracle Storage DE2-24C or Oracle Storage DE2-24P
Documentation: http://docs.oracle.com/cd/E37831_01/html/E48559/toc.html
Hardware: Oracle ZFS Storage ZS3-ES
Disk Location: http://docs.oracle.com/cd/E37831_01/pdf/E48559.pdf (page 2 & 3)
The Oracle ZFS Storage ZS3-ES is similar to the Oracle ZFS Storage ZS3-2 for connecting to Oracle DE2 disk shelves.
Oracle ZFS Storage ZS3-ES cabling: https://docs.oracle.com/cd/E37831_01/html/E48558/z4000089165586.html
Sun ZFS Storage ZS3-ES standalone can support up to eight DE2-24 shelves with two HBA card
Sun ZFS Storage ZS3-ES standalone can support up to sixteen DE2-24 shelves with two HBA cards

HDD: P0
HDD: P1
Drive Location
OS disk (disk slot 0 & 1 )

The ZS-ES controller has eight 2.5-inch SAS-2 system boot drives slots 0 and 1, configured as a mirrored pair, two SAS-2 Readzilla devices in slots 2 and 3, four HDD/SSD fillers in slots 4 through 7.

Two hot-pluggable, redundant power supplies.
Sixteen 16 GB DDR3 DIMMs occupying all DIMM slots. There are no empty DIMM slots and, therefore, no fillers
An on-board Oracle Integrated Lights Out Manager (Oracle ILOM 3.1) service processor (SP) based on the AST2300 chip

All of the PCIe slots comply with the PCI Express 3.0 specification and can accommodate 25 watt PCIe3 cards
Four PCIe Gen3 slots: three external slots and one internal.

The InfiniBand ports are PCIe card slot 1
The Clustron V2 port are PCIe card slot 2
The SAS-2 HBA ports are PCIe card slot 3
The SAS-2 internal HBA ports are PCIe card Slot 4 is for an internal SAS-2 HBA and is not visible from the rear

To cable the controller to the disk shelves, use the following guidelines:

Connect each disk chain to two HBAs if available.
Maximize the number of Disk Shelves chains before adding disk shelves to an individual chain.
Balance the number of Disk Shelves across the disk chains in your system.
Disks with different capacities or rotation speeds cannot be mixed within a single disk shelf.
DE2-24 Shelves, the controller must have only 4X4 port SAS-2 HBAs.
* Controllers cannot use 2X4 port SAS-2 HBAs and must be only 4X4 port SAS-2 HBAs on the chassis.

Max number of DE2-24 Shelves for a standalone: one 4X4 port SAS-2 HBAs in slot PCIe2 with 2 disk shelves per two disk chains total 4 disk shelves or two HBA in slots PCIE2 and PCIE3 with 2 disk shelves per four disk chains up to 8 disk shelves.
Max number of DE2-24 Shelves for a cluster: one 4X4 port SAS-2 HBAs in slot PCIe2 with 4 disk shelves across per two disk chains for a total of 8 disk shelves or two HBA in slots PCIE 2 and PCIE3 with 4 disk shelves across per 4 disk chains up to 16 disk shelves.

ILOM - Reference Documentation

http://docs.oracle.com/cd/E24707_01/index.html

Oracle ZFS Storage ZS4-4

Sun Server X4-4 , Code name Otoro-ZS4 , Oracle Storage DE2-24C or Oracle DE2-24P, but uses specialized components
Documentation: http://docs.oracle.com/cd/E56021_01/index.html
Hardware: Oracle ZFS Storage ZS4-4
Disk Location: http://docs.oracle.com/cd/E56021_01/pdf/E55847.pdf (page 8 & 9)
Oracle ZFS Storage ZS4-4 Standalone cabling guide: http://docs.oracle.com/cd/E56021_01/html/E55848/govym.html#AKSCGgovzf
Oracle ZFS Storage ZS4-4 clustered cabling guide:http://docs.oracle.com/cd/E56021_01/html/E55848/govzg.html#scrolltoc
Sun ZFS Storage ZS4-4 is available with one, two, three or four HBA cards installed, six disk shelves per chain up to 36 DE2-24 disk shelves.
Sun ZFS Storage ZS4-4 cluster is available with either one, two, three or four HBA cards installed, six disk shelves per chain up to 36 DE2-24 disk shelves.

HDD: P0
HDD: P1
Drive Location
OS disk (disk slot 0 & 1 )

The ZS4-4 controller has two 2.5-inch 900GB SAS-2 system boot drives in slots 0 and 1,
configured as a mirrored pair. Up to four 1.6TB SAS-2 Read flash SSDs can fill slots 2 through
5, in that order. A filler panel must be installed in empty drive slot

Two hot-pluggable, redundant power supplies.

The ZS4-4 controller has four Intel Xeon E7-8895 v2 15-core 2.8 GHz CPUs and eight memory
riser card

DIMM slots: 96 DIMM slots, 24 DIMMs per CPU
DIMM type: Registered low-voltage DDR3L-1600 DIMMs, Registered low-voltage DDR3L-1600 Load Reduced DIMMs
DIMM size: 16GB and 32GB
Maximum capacity: 3TB

Ethernet Ports

The ZS4-4 has four RJ-45 10-Gigabit Ethernet (10GbE) network connectors on the rear panel,
labeled NET 0, NET 1, NET 2, and NET 3 (bottom left to top right). Use these ports to connect the appliance to the network.

PCIe I/O Slot Numbering

The ZS4-4 base configuration contains the following PCIe cards:

One 8-port SAS-2 internal HBA (slot 2)

Two 4-port (4x4) SAS-2 external HBAs (slot 6 and slot 7)

One cluster interface card (slot 4)

PCIe cards slot position

The InfiniBand ports are PCIe1, PCIe3, PCIe5, PCIe8, PCIe9, PCIe10 and PCIe11.
The 10Gb Ethernet Optical NIC ports are PCIe1, PCIe3, PCIe5, PCIe8, PCIe9, PCIe10 and PCIe11.
The 10Gb Ethernet Copper NIC ports are PCIe1, PCIe3, PCIe5, PCIe8, PCIe9, PCIe10 and PCIe11.
The FC HBAs ports are PCIe1, PCIe3, PCIe5, PCIe8, PCIe9, PCIe10 and PCIe11.
The 8-port SAS-2 Internal HBA ports are PCIe2 .
The 4-port (4x4) SAS-2 External HBA ports are PCIe3 and PCIe9 .
The Cluster Interface (second generation) ports are PCIe4 .

Install optional PCIe cards in the following order:

1. Install additional 4x4 SAS-2 HBAs in slot 9, then slot 3. Then Slot 6 and slot 7 ZS4-4 PCIe Base and Optional Configuration
2. Install InfiniBand CX3 HCAs into the first available client-option slot starting with slot 11, then slot 8, slot 5, slot 1, slot 10, slot 3, slot 9.
3. Install 16Gb FC HBAs into the first available client-option slot starting with slot 11, then slot 8, slot 5, slot 1, slot 10, slot 3, slot 9.
4. Install 10Gb Ethernet Optical NICs into the first available client-option slot starting with slot 11, then slot 8, slot 5, slot 1, slot 10, slot 3, slot 9.
5. Install 10Gb Ethernet Copper NICs into the first available client-option slot starting with slot 11, then slot 8, slot 5, slot 1, slot 10, slot 3, slot 9.

Max number of Sun Disk Shelves for a standalone Sun Server X4-4: one 2X4 port SAS-2 HBAs in slots PCIe2 six disk shelves per chain for 6 disk shelves.
Max number of Sun Disk Shelves for a cluster Sun Server X4-4: one 2X4 port SAS-2 HBAs in slots PCIe2 six disk shelves per chain for 6 disk shelves.

Max number of DE2-24 Shelves for a standalone Sun Server X4-4: one 4X4 port SAS-2 HBAs in slots PCIe9, PCIe3, PCIe6 and PCIe7 HBAs six disk shelves per chain up to 36 disk shelves.
Max number of DE2-24 Shelves for a cluster Sun Server X4-4: one 4X4 port SAS-2 HBAs in slots PCIe9, PCIe3, PCIe6 and PCIe7 HBAs six disk shelves per chain up to 36 disk shelves.

ILOM - Reference Documentation

http://docs.oracle.com/cd/E24707_01/index.html

Oracle ZFS Storage ZS5-2

Netra X5-2 Server, Code name MaguroZ5, Disk Shelf , Oracle Storage DE#-24C and Oracle Storage DE#-24PDocumentation: https://docs.oracle.com/cd/E76475_01/html/E76485/gpxfl.html
Hardware: Oracle ZFS Storage ZS5-2 https://support.oracle.com/handbook_private/Systems/ZS5_2/ZS5_2.html
Disk Location: https://docs.oracle.com/cd/E76475_01/html/E76485/gpxdz.html#scrolltoc
Cabling: https://docs.oracle.com/cd/E76475_01/html/E76482/govud.html#scrolltoc
Cluster Ports: Cluster interface card (slot 4)

Storage enclosure (up to 16 enclosures per solution allowed, clustered or non-clustered)

Drive Location
OS disk (disk slot 0 & 1 )

Disks Slots - Front Panel
HDD 0-1 - System disks
HDD 2-7 - Filler (always empty)

Mirrored boot disks reside in HDD0 and HDD1 (2.5” SAS-3 1.2TB 10K RPM HGST Cobra-F). Reminder of disk drive slots are populated with filler panels.

ZS5-2 PCIe Card Configuration

The ZS5-2 base configuration contains the following PCIe cards:

The ZS5-2 controller is equipped with six PCle Gen3 expansion slots. One of these slots is always dedicated to an external HBA and one is reserved for a cluster interface card. The remaining slots may be used for an additional external HBA or one of several client-facing adapters.
The ZS5-2 base configuration contains the following PCIe cards:
One 4-port (4x4) SAS external HBA (slot 2)
One cluster interface card (slot 4)

-PCIe Slot Order - Install optional PCIe cards in the following order:

Install an additional 4x4 SAS HBA in slot 6.
Install Dual QDR 40Gb InfiniBand HCA into the first available client-option slot starting with slot 5, then slot 1, slot 3, slot 6.
Install Dual universal 16Gb FC HBA into the first available client-option slot starting with slot 5, then slot 1, slot 3, slot 6.
Install Dual 10Gb Ethernet into the first available client-option slot starting with slot 5, then slot 1, slot 3, slot 6.
Install Dual 10GBASE-T Network Interface Card into the first available client-option slot starting with slot 5, then slot 1, slot 3, slot 6.

ZS5-2 Attached Storage

The ZS5-2 controller connects to external storage through a 4-port (4x4) SAS HBA. You can attach from one to sixteen disk shelves to the controller. To maintain read-cache availability for the surviving controller in a failed cluster configuration, and to increase the read-cache size for any system, the controller does not contain read cache devices, and such devices can be included externally in disk shelves. For disk shelf configuration details, see Disk Shelf Configurations. The ZS5-2 does not support the Sun Disk Shelf.
Supports up to four chains of four EBODs for total of 16 disk shelves (when using optional 2 nd Thebe3)
Backend storage is provided via DE2-24P, DE2-24C and DE3-24P/C disk enclosures .

ILOM - Reference Documentation

http://docs.oracle.com/cd/E24707_01/index.html

Oracle ZFS Storage ZS5-4

Oracle Server X5-4, Code name OtoroZ5, Disk Shelf , Oracle Storage DE#-24C and Oracle Storage DE#-24P
Documentation: https://docs.oracle.com/cd/E76475_01/html/E76485/gqtuo.html#scrolltoc
Hardware:https://support.oracle.com/handbook_private/Systems/ZS5_4/ZS5_4.html
Disk Location: https://docs.oracle.com/cd/E76475_01/html/E76485/gqtjb.html#scrolltoc
Cabling: https://docs.oracle.com/cd/E76475_01/html/E76482/govud.html#scrolltoc
Cluster Ports: Cluster interface card (slot 4)

Storage Enclosure - The ZS5-4 controller connects to external storage through a 4-port (4x4) SAS HBA. Each SAS HBA is capable of supporting 12 disk shelves per the recommended cabling methodology. Each ZS5-4 controller can support a maximum of 48 disk shelves. To maintain read-cache availability for the surviving controller in a failed cluster configuration, and to increase the read-cache size for any system, the controller does not contain read cache devices, and such devices can be included externally in disk shelves. For disk shelf configuration details, see Disk Shelf Configurations. The ZS5-4 does not support the Sun Disk Shelf.

Disks Slots - Front Panel
HDD 0-1 - System Disks
HDD 2-5 - Permanent HDD Filler Panels

Mirrored boot disks reside in HDD0 and HDD1 (2.5” SAS-3 1.2TB 10K RPM HGST Cobra-F). Reminder of disk drive slots are populated with filler panel

ZS5-4 PCIe Card Configuration

The eleven PCIe slots are located inside the controller at the back. As viewed from the front of the controller, the slots are divided into two groups, a group of six on the right of the SP card and a group of five on the left of the SP card. The slots are designated from right to left. The six slots on the right side are designated as PCI-1 to PCI-6. The five slots on the left are designated as PCI-7 to PCI-11.

PCIe Slot Length and Capabilities

The controller contains eleven low-profile PCIe 2.0 card slots, which have the following length and capabilities:

Slots 1, 2, 3, 4, 5, 6, 7, 9 and 10 have x8 connectors (x8 electrical interface)
Slots 8 and 11 have x16 connectors (x8 or x16 electrical interface)

PCIe Card Slot Population Order

Each base unit ZS5-4 is always loaded with the following HBAs in the following PCIe slots:

Slot 2: Internal SAS-3 HBA
Slot 4: Cluster interface card
Slot 6: 4x4 SAS HBA
Slot 7: 4x4 SAS HBA

All allowable option ZS5-4 PCIe cards should be installed in the remaining card slot locations and filled in accordance to the following priority and sequence as follows:

Install any additional 4x4 SAS HBA cards into -- Slot 9, then 3
Install any dual port QDR InfiniBand (IB) cards into -- Slot 11, then 8, then 5, then 1, then 10, then 3, then 9
Install any dual port 16Gb Fibre Channel (FC) cards into -- Slot 11, then 8, then 5, then 1, then 10, then 3, then 9
Install any dual port 10GbE SFP+NIC cards into -- Slot 11, then 8, then 5, then 1, then 10, then 3, then 9
Install any dual port 10GBase-T NIC cards into -- Slot 11, then 8, then 5, then 1, then 10, then 3, then 9

ZS5-4 Attached Storage

The ZS5-4 controller connects to external storage through a 4-port (4x4) SAS HBA. Each SAS HBA is capable of supporting 12 disk shelves per the recommended cabling methodology. Each ZS5-4 controller can support a maximum of 48 disk shelves. To maintain read-cache availability for the surviving controller in a failed cluster configuration, and to increase the read-cache size for any system, the controller does not contain read cache devices, and such devices can be included externally in disk shelves. For disk shelf configuration details, see Disk Shelf Configurations. The ZS5-4 does not support the Sun Disk Shelf.

ILOM - Reference Documentation

http://docs.oracle.com/cd/E24707_01/index.html

Oracle ZFS Storage ZS5-ES

Oracle Server X5-2, Code name AKAMI-Z5, Disk shelf , Oracle Storage DE3-24C or Oracle DE3-24P.
Documentation: http://docs.oracle.com/cd/E86025_01/
Disk Location: http://docs.oracle.com/cd/E86025_01/html/E86028/gopqe.html#scrolltoc
Cabling: http://docs.oracle.com/cd/E86025_01/html/E86027/gqcck.html#scrolltoc
Cluster Port: Locate the 3-port cluster interface card in PCIe slot 3.

Oracle ZFS Storage ZS5-ES supports one of the following configurations:

One Oracle Storage Drive Enclosure DE3-24C connected to a SAS-3 HBA
Two Oracle Storage Drive Enclosures DE3-24P connected to a SAS-3 HBA

Disk Slots - Front Panel

HDD 0-1 - System Disks
HDD 2-3 - Read cache SSD
HDD 4,5,6 and 7 - Permanent filler panel

Eight front-accessible and hot-swappable 2.5" SAS disk bays (Only four drive bays are populated HDD0, HDD1 are mirrored boot disks and HDD2 & HDD3 are ReadZilla SSD's). Remainder of drive bays are populated with filler panels.

ZS5-ES PCIe Card Configuration

There are three external and one internal PCIe slots available in the Oracle ZFS Storage ZS5-ES. The external slots support optional, standard PCIe cards and are numbered 1, 2, and 3 from left to right when you view the controller from the rear. The internal slot, which installs on the riser in PCIe slots 3 and 4,
supports a required internal SAS controller HBA card. For a view of the rear panel that shows PCIe slot numbering. ZS5-ES populates the following slots/cards: PCIe Slot 1 CX3 Infiniband, PCIe Slot 2 Thebe2, PCIe Slot 3 Clustron 3.

ZS5-ES Attached Storage

Oracle ZFS Storage ZS5-ES supports one of the following configurations:

One Oracle Storage Drive Enclosure DE3-24C connected to a SAS-3 HBA
Two Oracle Storage Drive Enclosures DE3-24P connected to a SAS-3 HBA

ILOM - Reference Documentation

http://docs.oracle.com/cd/E37444_01/index.html

Disk Shelves Drive Locations

Find below the Logzilla slot location for different Expansion Units :

DE2-24P / DE2-24C / Sun Disk Shelf(DS2) : Up to four Logzilla SSDs are supported per disk shelf. Logzilla SSDs should be populated in order of slots 20, 21, 22, and 23.
J4400 : Up to four Logzilla SSDs are supported per disk shelf. Logzilla SSDs should be populated in order of slots 8, 4, 16, and 20

DE2-24P / DE2-24C / Sun Disk Shelf(DS2) should have either 24 HDDs (fully populated),
or 20 HDDs in slots 0-20 and 1 to 4 Logzilla SSDs in slots 20-23, in increasing order.

DE3-24P is a 2U chassis that supports 24 2.5'' SAS-3 drives. The high-performance HDDs provide reliable storage, and the SSDs provide accelerated write operations. This disk shelf features dual, redundant I/O Modules (IOMs), and dual power supply with fan modules. Up to four write-optimized log SSDs are supported per disk shelf. Log devices should be populated in order of slots 20, 21, 22, and 23.

DE3-24C is a 4U chassis that supports 24 3.5" SAS-3 drives. The SSDs provide accelerated write operations, and the high-capacity HDDs provide reliable storage. This disk shelf features dual, redundant I/O Modules (IOMs), and dual power supply with fan modules. Up to four write-optimized log SSDs are supported per disk shelf. Log devices should be populated in order of slots 20, 21, 22, and 23.

External Read Cache Devices - Read cache devices, installed in DE3-24 disk shelves, are external to the controller and referred to as external second level adaptive replacement cache (EL2ARC). When a cluster takeover occurs, read cache remains persistent and sharable between controllers, enabling read performance to be sustained. For slot configuration details and minimum software requirements, see Disk Shelf Configurations.

INTERMIXING SAS-2 AND SAS-3 COMPONENTS

Intermixing Oracle Storage Drive Enclosure DE2 with Oracle Storage Drive Enclosure DE3 or Thebe-2 (SAS-2 HBA) with Thebe-3 (SAS-3 HBA) in the same system is supported with OS8.7.

Refer to the matrix at https://my.oracle.com/content/web/cnt2665650 for details, and observe the best practices notes.

- 7x20 systems do not support Oracle Storage Drive Enclosure DE3, and they can use only Oracle Storage Drive Enclosure DE2.

- Oracle Storage Drive Enclosure DE3 can be installed in the same link as Oracle Storage Drive Enclosure DE2, but it will run at SAS-2 speeds.

Notice that Oracle ZFS Storage ZS3-2 and later systems can install a SAS-3 HBA to support Oracle Storage Drive Enclosure DE3 at SAS-3 speed.

Sun Storage J4400

Sun Disk Shelf DS2

Oracle Storage DE2-24C

Oracle Storage DE2-24P

Oracle Storage DE3-24P

Oracle Storage DE3-24C

References

<NOTE:1572801.1> - Sun Storage 7000 Unified Storage System: How to recover a ZFSSA using a virtual fishstick
<NOTE:1173064.1> - Oracle ZFS Storage Appliance: How to generate a system core dump in case of system hang (BUI and CLI fails to respond) using NMI when directed to do so by an Oracle Support Engineer
<NOTE:2021771.1> - Oracle ZFS Storage Appliance: Software Updates
<NOTE:1416406.1> - Sun ZFS Storage Appliances Troubleshooting Resource Center
<NOTE:1019887.1> - Sun Storage 7000 Unified Storage System: How to Collect a Support Bundle using the BUI or CLI
<NOTE:1446500.1> - Oracle ZFS Storage Appliance: How to Create and Use a Fishstick
<NOTE:1513423.1> - Sun Storage 7000 Unified Storage System: How To Upgrade the Appliance Kit Software and Service Processor BIOS/ILOM Firmware
<NOTE:1400578.1> - Sun Storage 7000 Unified Storage System: How to collect SP/ILOM diagnostic data

Attachments

This solution has no attachment