Exadata Database Machine X2-8
 
Exadata X3-8 Hardware
 
Exadata X3-8b Hardware
 

PLA-Support>Sun Systems>Sun_Other>Sun Collections>SN-OTH: x64-CAP VCAP
 

In this Document

Goal

Solution

References

Oracle Confidential PARTNER - Available to partners (SUN).
Reason: FRU CAP

Applies to:

Goal

How to Replace an Exadata X2-8 and Exadata X3-8 10Gb Ethernet FEM (Fabric Expansion Module)

Solution

DISPATCH INSTRUCTIONS

- WHAT SKILLS DOES THE FIELD ENGINEER/ADMINISTRATOR NEED:

The FSE needs to be Exadata Trained.

- TIME ESTIMATE: 60 minutes
- TASK COMPLEXITY: 3

FIELD ENGINEER/ADMINISTRATOR INSTRUCTIONS:
- PROBLEM OVERVIEW:
- WHAT STATE SHOULD THE SYSTEM BE IN TO BE READY TO PERFORM THE
RESOLUTION ACTIVITY?:

The system administrator should prepare the system for service by performing any application related functions required to shutdown the compute or storage node. This might include but is not limited to performing a system backup, failover of application or services, and finally a system shutdown.

- WHAT ACTION DOES THE FIELD ENGINEER/ADMINISTRATOR NEED TO TAKE:

Identify the faulty component:

10Gbe Port layout/location:

BLADE  DEVICE    SPEED  BACK PANEL                     STICKER

bl0      eth8        10Gb   Left NEM most bottom       NEM0/NET0
bl1      eth9        10Gb   Left NEM second bottom    NEM0/NET1
bl2      eth10      10Gb   Left NEM second top          NEM0/NET2
bl3      eth11      10Gb   Left NEM most top              NEM0/NET3
bl0      eth12      10Gb   Right NEM most bottom      NEM1/NET0
bl1      eth13      10Gb   Right NEM second bottom   NEM1/NET1
bl2      eth14      10Gb   Right NEM second top         NEM1/NET2
bl3      eth15      10Gb   Right NEM most top            NEM1/NET3

Please see "How to Power on & off the Server" & "How to Remove & Install a Fabric Expansion Module" within the "Sun Fire X4800 Server Service Manual".


Replacing a faulty FEM:

1. Power-off the target node for service. Note power cable do not need to be removed as power is completely cut to CMODs when the server is powered off.This is also known as "standby-mode"
2. Remove the suspect CMOD that includes the FEM module.
3. Remove the CMOD cover then replace the defective FEM.
4. Replace the CMOD top cover and insert the CMOD into the chassis slot.
5. Power on the system either via ILOM or via the push button on the front of the server.

Replacing a faulty FEM:

Please refer to "How to Remove a CPU Module (CMOD)" & "How to Remove & Install a Fabric Expansion Module" within the "Sun Fire X4800 Server Service Manual".

OBTAIN CUSTOMER ACCEPTANCE
- WHAT ACTION DOES THE FIELD ENGINEER/ADMINISTRATOR NEED TO TAKE TO RETURN THE SYSTEM TO AN OPERATIONAL STATE:

The customer is responcible to verify the new component is functioning correctly, some steps the customer may want to use for verification are as follows:

1. On the host that the FEM was replaced run:

# ethtool eth# (where eth# corrosponds with the replaced NIC)

# ethtool eth9
Settings for eth9:
        Supported ports: [ FIBRE ]
        Supported link modes:   1000baseT/Full
                               10000baseT/Full
        Supports auto-negotiation: No
        Advertised link modes:  1000baseT/Full
                                10000baseT/Full
        Advertised auto-negotiation: No
        Speed: 10000Mb/s
        Duplex: Full
        Port: FIBRE
        PHYAD: 0
        Transceiver: external
        Auto-negotiation: on
        Supports Wake-on: umbg
        Wake-on: umbg
        Current message level: 0x00000007 (7)
        Link detected: yes

Ensure:

Link detected: yes
Speed: 10000Mb/s (or 1000Mb/sec if connected to gigabit)

# ifconfig eth# (where eth# corrosponds with the replaced NIC)

# ifconfig eth9
eth9    Link encap:Ethernet  HWaddr 00:1B:21:78:4E:89
          UP BROADCAST RUNNING SLAVE MULTICAST  MTU:1500  Metric:1
          RX packets:1705 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:102300 (99.9 KiB)  TX bytes:0 (0.0 b)

Ensure the "UP" & "RUNNING" Flags are present

Ping an external system to ensure the interface can communicate.

PARTS NOTE:
Oracle Exadata X2-8
Oracle Exadata X3-8

REFERENCE INFORMATION:

Exadata Documentation
Sun Fire X4800 Server Service Manual

Steps To Shutdown/Startup The Exadata & RDBMS Services and Cell/Compute Nodes On An Exadata Configuration.

References

This solution has no attachment