Oracle Ethernet Switch ES2-72
 
Oracle Switch ES1-24
 
Sun Network 10GbE Switch 72p
 
Sun Blade 6000 10GbE Switched 24p NEM
 
Oracle Ethernet Switch ES2-64
 
Sun Blade 6000 System
 

PLA-Support>Sun Systems>SAND>Network>SN-SND: Sun Network Ethernet Switches
 
_Old GCS Categories>Sun Microsystems>Operating Systems>Solaris Network
 

In this Document

Purpose

Details

Product Support Team

Alerts

Description

Sun Blade 6000 Ethernet Switched NEM 24p 10GE

Sun Network 10GE Switch 72p

Versions

Hardware Versions

Switches

Transceiver/Cables/Server Modules

Software Versions

Compatibility/Patches

Software Compatibility Matrix

Configuration

FAQ

Can Sun Blade 6000 Ethernet Switched NEM 24p 10GE co-exist with a different type of NEM in the two slots of SB6000?

What are Fabric Expansion Modules (FEMs)?

What Sun Blade 6000 server blades are supported by the Sun Blade 6000 Ethernet Switched NEM 24p 10GE?

What are the key features for the new FEM, X4871A-Z?

Are there plans to support existing/older servers blades (such as x6250, x6240, x6440) by the Sun Blade 6000 Ethernet Switched NEM 24p 10GE?

More FAQs

Information Gathering

Installation

De-installation

Troubleshooting

Performance

Lab

Contacts

Aliases

Product Marketing Group Contact

Proactive

Further Reading

Manuals

More

References

Oracle Confidential PARTNER - Available to partners (SUN).
Reason: Solaris and Network Domain (SaND) Product Page, internal content

Applies to:

Purpose

This document contains the 10-Gigabit Ethernet Switches (Opus) Product Page.

Details

Product Support Team

Alerts

Slow Memory Leak Issue for Ethernet Modules Firmware on Certain Systems May Cause Network Outage <Document 1622661.1>

Description

The Opus switch family is a Data Center fabric system covering shelf, rack, and multirack deployments. It targets systems from 10s of nodes with one or more shelfs in a rack to thousands of nodes housed in 10s of racks within a data center, all under a unified management framework. The major components in the Opus family are:

1. 10GBE uplink port switch for Constellation blade servers- 14 x 10GE uplinks for Constellation 10 (Opus C10 NEM)
2. 72 10GE port non ­blocking 1RU Top of Rack switch (Opus 2 ToR)
3. Oracle Switch ES1-24- 24 port 10 GBE switch (Opus 24)

Oracle's 10-Gigabit Ethernet switches provide a 10-Gigabit Ethernet Fabric via small form-factor pluggable (SFP+) ports and quad small form-factor pluggable (QSFP) ports.

The Sun Blade 6000 Ethernet Switched Network Express Module (NEM) 24p 10GE (Opus C10 NEM) is a multipurpose connectivity module for the Sun Blade 6000 modular system. The Switched NEM supports connections to external devices through 10 Gigabit Ethernet (10GE) SFP+ ports and QSFP ports as well as connections to internal server modules (blades) in a Sun Blade 6000 modular system chassis with disk modules in the same chassis.

The Sun Network 10GE Switch 72p (Opus 2 ToR) is a "Top of the Rack" switch with 16 QSFP (64x 10GE) and 8 SFP+ (1/10 GE) ports. Opus 2 ToR switch is meant to address deployments in the range of 1 to 4 racks (i.e.: Less than 200 nodes) and can thus be used stand alone, or as part of a larger Opus fabric.

• Sun Blade 6000 Ethernet Switched NEM 24p 10GE

• 10GE network switching between blades and external network up links
• 10 internal ports, 1 x 10GE per server blade
• 14 external ports via 3 QSFP and 2 SFP+ connectors
• FreeScale PPC8547E Ethernet fabric control processor
• SAS2 storage aggregation
• 20 internal ports, 2 per server blade
• 16 external ports via 4 x4 mini SAS connectors
• Internal Chassis Management Module (CMM) connectivity
• 10/100 Base-T Ethernet
• I2C
• External management ports
• 1 serial service port to PPC8547E control processor
• Hot swap control
• SIS LEDs

• Sun Network 10GE Switch 72p

• 1 RU 72 ports non-blocking 10GE switching; expressed as
• 16 fixed QSFP connectors (64 10GE ports) and
• 8 SFP+ connectors
• FreeScale PPC8572 dual core Ethernet fabric control processor
• External management ports
• 1 serial port
• 2x 10/100/1000 Base-T RJ-45
• 1+1 redundant power supply
• 4+1 redundant fans
• Support reversible air flows
• Chassis supports mounting on either 'front' or 'back'

Versions

Hardware Versions

• Switches

• Transceiver/Cables/Server Modules

Software Versions

Compatibility/Patches

Software Compatibility Matrix

• Compatibility Matrix for Opus NEM (Minumim Versions)

• • • Patch for Sun Blade 6000 Switched NEM 1.2 : 13255101 or higher

• Compatibility Matrix for Network 10GBE Switch 72p (Opus TOR - Minumim Versions)

• • •  Patch for Network 10GBE Switch 72p 1.2 : 13255111 or higher

• • Patch for Oracle Switch ES1-24 1.3 : 17050841 or higher
    
    
  • Patch for Oracle Ethernet Switch ES2-72/ES2-64 2.0 : 21378426 or higher
    
    
    

Configuration

see

Sun Blade 6000 Ethernet Switched NEM 24p 10GbE Software Configuration Guide

FAQ

Can Sun Blade 6000 Ethernet Switched NEM 24p 10GE co-exist with a different type of NEM in the two slots of SB6000?
What are Fabric Expansion Modules (FEMs)?
What Sun Blade 6000 server blades are supported by the Sun Blade 6000 Ethernet Switched NEM 24p 10GE?
What are the key features for the new FEM, X4871A-Z?
Are there plans to support existing/older servers blades (such as x6250, x6240, x6440) by the Sun Blade 6000 Ethernet Switched NEM 24p 10GE?
More FAQs

Can Sun Blade 6000 Ethernet Switched NEM 24p 10GE co-exist with a different type of NEM in the two slots of SB6000?

Answer:

No. It can not co-exist with a different type of NEM. One slot or both slots of the SB6000 need to be NEM 24p 10GE.

What are Fabric Expansion Modules (FEMs)?

Answer:

A plugable I/O module for Sun Blade Server Modules. Its primary purpose is to provide on-board high performance I/O such as 10 Gigabit Ethernet and Infiniband without the use of ExpressModule (EM) slots. The actual performance of a FEM is dependent on the application, driver and OS of choice. In addition, specific Network Express Modules are required to bring I/O payload from individual FEMs to external networks.

What Sun Blade 6000 server blades are supported by the Sun Blade 6000 Ethernet Switched NEM 24p 10GE?

Answer:

1)Sun Blade X6270 Server Module - with x4871A-z FEM (Fabric Expansion Module)

2) Sun Blade T6320 Server Module - with x4822A (pass thru FEM) - with x4871A-z FEM

Note: The Sun Blade T6320 in combination with the X2073A NEM switch requires firmware 7.2.5 or later to support network boot capability. Please refer to the 'Sun Blade T6320 Product Notes' for details.

3) Sun Blade T6340 Server Module - with x4871A-z FEM

What are the key features for the new FEM, X4871A-Z?

Answer:

- Industry PCIe 2.0 compliant Dual port 10 GbE incorporating Intel 82599 10 Gigabit Ethernet Controller

- Receive-side Scaling, Advanced packet filtering, Direct Cache Access,TCP segmentation/Large Send Off-loading (LSO): improve throughput, balance network loads across CPU cores and lower CPU utilization for multi-core processors (dependency on the feature availability in the server Operating System)

- High Virtualization performance: Large number of Virtual Machine Device Queues (VMDq) allieviate I/O bottlenecks between virtual machines by providing

• Unique paths for routing packets to VMs
• Efficient handling of all VM data traffic
• Lower CPU utilization and higher throughput

Note: Performance of FEM x4871A-z for CMT Blade Servers T6320 and T6340 will be further enhanced via future firmware upgrade slated for March 2010. Please refer to product web pages of FEM x4871A-z for more details.

Are there plans to support existing/older servers blades (such as x6250, x6240, x6440) by the Sun Blade 6000 Ethernet Switched NEM 24p 10GE?

Answer:

There are no plans to support these existing/older blade servers. Resources are prioritized to support the future more powerful blades with better match with capability of Blade 6000 Ethernet Switched NEM 24p 10GE.

Is UDLD or CDP supported on Opus switches?

Answer:

No, UDLD and CDP are Cisco proprietary and can cause spurious error messages  when connected to Opus switches since SEFOS does not know how to handle the received L2  packets.  UDLD and CDP should always be disabled on uplinked Cisco switches

More FAQs

• Sun Blade 6000 Switched NEM 24p 10GbE Internal FAQs (DOC)
• FAQ: Sun Network 10GbE Switch 72p (PDF)

Information Gathering

• Information needed for collaboration:
  • Short failure description including error or warning messages
  • Short customer situation including timeframes and business impact
  • Platform type/version, part# and revision of Chassis, Blade, FEM and NEM
  • *Explorer* output of affected blade(s) or system(s)
  • *Explorer* output of OK blade or system (if exists)
  • Which slot is used for the blade(s)? Which port is used for the systems ?
  • Short description of your measures to find and solve the problem before requesting collaboration
  • ILOM snapshot of affected switch or NEM
  • Firmware version of Chassis, Blade, NEM SP and NEM SEFOS (repeat for NEM0 if installed):
    ssh -l [chassis-sp]
    Sun(TM) Integrated Lights Out Manager Version 3.0.6.11 r47352 <-- CMM Version
    -> start /CH/NEM1/SP/cli start: Connecting to /CH/NEM1/SP/cli using Single Sign On Sun(TM)
    Integrated Lights Out Manager (Fabric Component Edition) Version 3.0.0.0
    -> cd /SP
    -> version
    SP firmware 3.0.0.0 <-- NEM SP firmware
    SP firmware build number: 50399
    SP firmware date: Tue Nov 24 10:24:11 PST 2009
    SP filesystem version: 1.0.0.0
    -> cd /NEM
    -> ls
    ...
    Properties: type = Network Express Module
    product_name = SUN BLADE 6000 ETHERNET SWITCHED NEM 24P 10GE
    product_part_number = 541-3770-02 <-- Part#
    product_serial_number = 0110SJC-0947CB0141
    product_manufacturer = SUN MICROSYSTEMS
    prepare_to_remove_status = (none)
    prepare_to_remove_action = (none)
    return_to_service_action = (none)
    ...
    -> cd fs_cli
    SEFOS# show system information
    Hardware Version : 2.5.4_00161614
    Firmware Version : ONEM-1.0.0.0 <-- SEFOS version
    Switch Name : C10 NEM 24P
    System Contact : Sun Microsystems, Inc.
    System Location : Sun Microsystems, Inc.
    Logging Option : Console
    Logging Login Authentication Mode : Local Config
    Save Status : Not Initiated
    Remote Save Status : Not Initiated
    Config Restore Status : Successful
  • Running switch configuration:
    SEFOS# show run
    Building configuration...
    interface extreme-ethernet 0/1
    ...
    disable snmpagent
    ...
  • • switch logs, interface status and statistics
      
      # show interfaces stat
      # show interfaces count
      # show logging
      
      for an affected interface, e.g.
      # show interfaces extreme-ethernet 0/1
      
      for an OK interface (if any), e.g
      # show interfaces extreme-ethernet 0/2
      # show etherchannel summary
      # show spanning-tree
      # show vlan
      # show mac-address-table
      
      

Installation

see

Sun Blade 6000 Ethernet Switched NEM 24p 10GbE Users Guide

De-installation

see

Sun Blade 6000 Ethernet Switched NEM 24p 10GbE User Guide

Troubleshooting

Performance

Lab

use Systems TSC Global Lab

Contacts

Aliases

• Opus Interest Mail Alias (opus-interest@sun.com) - Opus Marketing Issues
• Opus Support Mail Alias (opus-support@sun.com) - Opus Support Questions and Topics

Product Marketing Group Contact

• Opus Product Manager : Dilip Modi

Proactive

Further Reading

Manuals

• Sun Blade 6000 Ethernet Switched Network Express Module 24p 10GbE Documentation
• Sun Network 10GbE Switch 72p Documentation
  
  
• Sun Ethernet Fabric Operating System (SEFOS) Documentation
• Sun Ethernet Fabric Operating System (SEFOS) - CLI Base Reference Manual (821-0410-12, December 2010) (*.pdf)
• Sun Blade 6000 Switched NEM 24p 10GbE Systems page - my.oracle.com
  
  
• Oracle Switch ES1-24 Documentation Library 

More

• Blade 6000 Modules Overview (Internal, pdf)
• Sun 10GbE Production Portfolio (Niantic NICs + Opus Switches - Internal (*.pdf)
• SUN HARDWARE PRODUCT INTRO: Sun Blade 6000 Ethernet Switched NEM 24p 10GE - Internal
• Opus Documentation Review Page - Internal - Draft
• Sun Network 10GbE Switch 72p Product Page
• Sun Blade 6000 and Sun Netra 6000 Ethernet Switched NEM 24p 10 GbE Product Page
• Sun Blade 6000 I/O and Management Architecture (PDF)

References

This solution has no attachment