![]() | Oracle System Handbook - ISO 7.0 May 2018 Internal/Partner Edition | ||
|
|
![]() |
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Solution Type Predictive Self-Healing Sure Solution 1416397.1 : How to Identify Which Flash card is Installed in an Exadata Storage Cell and Order the Correct FRU
This is a How-to guide detailing the Flash components used in Exadata systems. Oracle Confidential PARTNER - Available to partners (SUN). Reason: Intended for resolving SR's, and provide proactive FRU replacement guidelines requiring an Oracle engineer to review Applies to:Oracle Exadata Hardware - Version 11.2.0.1 and laterExadata Database Machine X2-2 Hardware - Version All Versions and later Exadata X3-8 Hardware - Version All Versions and later Exadata Database Machine V2 - Version All Versions and later Exadata X3-2 Hardware - Version All Versions and later Information in this document applies to any platform. Exadata, Flash, FMOD, FDOM, Aura, V2, X2-2, X2-8, X3-2, X3-8 PurposeHow to identify which Flash card is present in Exadata Storage cell to order the correct FRU ScopeFor internal and HW support partner use only. This document contains engineering level information, not suitable for customer distribution. Do not distribute to customers. DetailsThe Exadata Storage cells contain Solid State Flash memory. A Flash 1.0 and 1.1 assembly consists of:
A Flash Card assembly is also known as an Aura 1.0 or 1.1 card. Aura was the engineering code name. A Flash 2.0 assembly is a self-contained FRU ,the PCI Flash Board and 400GB SSD Module are a complete assembly. The engineering code name is Aura 2.
Note:
1. The minimum OS image required to support 541-4416 F20 M2 is Exadata image patch update 11.2.2.3.2 or later 2. If for some reason, a version 1.0 flash board 511-1500 or 511-1275 is being replaced with a version 1.1 flash board 541-4416, it is also necessary to replace the ESM with part 371-4953 to avoid the ESM cable coming into contact with other PCI boards on the same riser, and to ensure the FMOD's have D20Y firmware or above
3.The minimum OS image required to support 7026993 or 7070787 is Exadata image 11.2.3.2.0 or later
4.7026993 and 7070787 are fully compatible and can be used as alternatives for either part
Notes:
1. The minimum image version required to support 371-5014 is Exadata image 11.2.2.1.1 2. 371-4415 and 371-5014 are different only in firmware, however they are not substitutable per logistics rules even though the Exadata will update the firmware according to the image 3. The FMOD output model string such as 'SD88SA02' in 'lsscsi' and firmware version is NOT an indicator of the FRU part number. Only the F20 card type should be used to determine which FMOD part number to use . 4. The 371-5014 was reworked to 7061269 in December 2012.
5. The 371-4415 was reworked to 7061269 in December 2012. The SSD contained on 7026993 and 7070787 is not removeable,it is not a separate FRU item
Note: Ensure ESM is fitted to the correct Flash board
The 7026993 and 7070787 do not contain an ESM
For 1.0 and 1.1 F20 cards: ( rev 08) = 511-1275 or 511-1500
For 2.0 F40 card ( rev 03) = 7026993 or 7070787
# lspci | grep MPT 1b:00.0 SCSI storage controller: LSI Logic / Symbios Logic SAS1068E PCI-Express Fusion-MPT SAS (rev 08) 21:00.0 SCSI storage controller: LSI Logic / Symbios Logic SAS1068E PCI-Express Fusion-MPT SAS (rev 08) 29:00.0 SCSI storage controller: LSI Logic / Symbios Logic SAS1068E PCI-Express Fusion-MPT SAS (rev 08) 2f:00.0 SCSI storage controller: LSI Logic / Symbios Logic SAS1068E PCI-Express Fusion-MPT SAS (rev 08)
# lspci | grep MPT 1b:00.0 SCSI storage controller: LSI Logic / Symbios Logic SAS1068E PCI-Express Fusion-MPT SAS (rev 10) 21:00.0 SCSI storage controller: LSI Logic / Symbios Logic SAS1068E PCI-Express Fusion-MPT SAS (rev 10) 29:00.0 SCSI storage controller: LSI Logic / Symbios Logic SAS1068E PCI-Express Fusion-MPT SAS (rev 10) 2f:00.0 SCSI storage controller: LSI Logic / Symbios Logic SAS1068E PCI-Express Fusion-MPT SAS (rev 10)
This example shows 7026993 or 7070787: # lspci | grep SSD 20:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SSS6200 PCI-Express Flash SSD (rev 03) 30:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SSS6200 PCI-Express Flash SSD (rev 03) 90:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SSS6200 PCI-Express Flash SSD (rev 03) b0:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SSS6200 PCI-Express Flash SSD (rev 03)
/usr/bin/flash_dom -l command as follows.The output to flash_dom -l can be found in "sundiag" collection. The "Rev" of the card can be B3 or C0
B3 = 511-1275 or 511-1500
C0 = 541-4416 This example shows a truncated output from the command. Each flash board will be displayed with its corresponding flash modules. Note also the FMOD Firmware. The example only shows the flash card /proc/mpt/ioc0. # /usr/bin/flash_dom -l ... HBA# Port Name Chip Vendor/Type/Rev MPT Rev Firmware Rev IOC 1. /proc/mpt/ioc0 LSI Logic SAS1068E B3 105 011b0300 0 Current active firmware version is 011b0300 (1.27.03) Firmware image's version is MPTFW-01.27.03.00-IT x86 BIOS image's version is MPTBIOS-6.26.00.00 (2008.10.14) FCode image's version is MPT SAS FCode Version 1.00.49 (2007.09.21) D# B___T Type Vendor Product Rev 1. 0 0 Disk ATA MARVELL SD88SA02 D20R 2. 0 1 Disk ATA MARVELL SD88SA02 D20R 3. 0 2 Disk ATA MARVELL SD88SA02 D20R 4. 0 3 Disk ATA MARVELL SD88SA02 D20R
This example is of a 541-4416 card: # /usr/bin/flash_dom -l
... HBA# Port Name Chip Vendor/Type/Rev MPT Rev Firmware Rev IOC WWID Serial Number 1. /proc/mpt/ioc0 LSI Logic SAS1068E C0 105 011b5c00 0 5080020000c11bc0 465769T+1111A400JY Current active firmware version is 011b5c00 (1.27.92) Firmware image's version is MPTFW-01.27.92.00-IT x86 BIOS image's version is MPTBIOS-6.26.00.00 (2008.10.14) FCode image's version is MPT SAS FCode Version 1.00.49 (2007.09.21) D# B___T Type Vendor Product Rev Operating System Device Name 1. 0 0 Disk ATA MARVELL SD88SA02 D20Y /dev/sdn [8:0:0:0] 2. 0 1 Disk ATA MARVELL SD88SA02 D20Y /dev/sdo [8:0:1:0] 3. 0 2 Disk ATA MARVELL SD88SA02 D20Y /dev/sdp [8:0:2:0] 4. 0 3 Disk ATA MARVELL SD88SA02 D20Y /dev/sdq [8:0:3:0]
It is also possible to identify the type of version flash board from the ILOM. Use the "show" command from within the ILOM to read the FRUID information using the PCIE riser board targets: For Exadata V2 , X2-2 and X2-8
For Exadata X3-2 and X3-8 /System/PCI_Devices/Add-on/Device_1 /System/PCI_Devices/Add-on/Device_2 /System/PCI_Devices/Add-on/Device_4 /System/PCI_Devices/Add-on/Device_5
-> show /SYS/MB/RISER1/PCIE1/F20CARD /SYS/MB/RISER1/PCIE1/F20CARD Targets: PRSNT UPTIME Properties: type = F20 Card ipmi_name = PCIE1/F20CARD fru_name = BD,ASY,PCIE1_FLASH,AURA_P1.0 fru_part_number = 511-1275-04 fru_serial_number = 0111APO-0941AU0022 fru_extra_1 = 50 Aura fault_state = OK clear_fault_action = (none)
This example shows a 541-4416 located in PCIE slot 1 within V2 , X2-2 and X2-8: -> show /SYS/MB/RISER1/PCIE1/F20CARD
Targets: PRSNT UPTIME Properties: type = F20 Card ipmi_name = PCIE1/F20CARD fru_name = ASY,BD,PCIE_FLASH,F20 M2 fru_part_number = 511-1646-01 fru_serial_number = 465769T+1111A400JV fru_extra_1 = 04 F20 M2 fault_state = OK clear_fault_action = (none)
Note:For the Exadata V2 image version 11.2.2.3.2 or later is required to see the Flash board in slot 4.Before this version the slot could not be displayed,the other slots are displayed in full
-> show /System/PCI_Devices/Add-on/Device_4 /System/PCI_Devices/Add-on/Device_4 Targets: Properties: part_number = 7103066 description = Sun Flash Accelerator F40 400GB eMLC PCI-E 2.0 Low Profile Adapter location = PCIE4 (PCIe Slot 4) pci_vendor_id = 0x1000 pci_device_id = 0x007e pci_subvendor_id = 0x108e pci_subdevice_id = 0x0581
References<NOTE:1501410.1> - INTERNAL Exadata Database Machine Hardware Firmware and Patch History (X3-2, X4-2, X3-8, X4-8 w/X4-2L)<NOTE:1358327.1> - INTERNAL Exadata Database Machine Hardware Firmware and Patch History (V2, X2-2, X2-8) <NOTE:888828.1> - Exadata Database Machine and Exadata Storage Server Supported Versions Attachments This solution has no attachment |
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|