Sun Storage 7000 Unified Storage System: Appliance may hang, run slowly or lose network connectivity when using SNMP to monitor many network interfaces

Asset ID:	1-72-1397764.1
Update Date:	2017-05-17
Keywords:

Solution Type Problem Resolution Sure

Solution 1397764.1 : Sun Storage 7000 Unified Storage System: Appliance may hang, run slowly or lose network connectivity when using SNMP to monitor many network interfaces

Applies to:

Oracle ZFS Storage ZS3-4 - Version All Versions and later
Oracle ZFS Storage ZS3-BA - Version All Versions and later
Sun Storage 7110 Unified Storage System - Version All Versions and later
Sun Storage 7310 Unified Storage System - Version All Versions and later
Sun Storage 7410 Unified Storage System - Version All Versions and later
7000 Appliance OS (Fishworks)
NAS head revision : [not dependent]
BIOS revision : [not dependent]
ILOM revision : [not dependent]
JBODs Model : [not dependent]
CLUSTER related : [not dependent]

Symptoms

Over a period of days the appliance may appear to become sluggish.

Access to the BUI may be lost and the CLI may appear to hang or take a long time for commands to run.

Client access to the shares may be interrupted sporadically or may take a long time.

Eventually the entire appliance may hang.

See <CR 6998845> "snmpd does not process duplicate interface containers"

Check /var/log/snmpd.log for the continuously repeating error

error on subcontainer 'interface container' insert (-1)

Check how much CPU the snmpd process is using from the OS shell with prstat and ps

# prstat -mL

# ps -ef | grep snmpd

To discuss this information further with Oracle experts and industry peers, we encourage you to review, join or start a discussion in the My Oracle Support Community - Disk Storage ZFS Storage Appliance Community

Changes

Configuring extra network interfaces may trigger this problem.

This is especially true when VLANs are used to create many more datalinks than would normally be available for the number of network devices, since each VLAN datalink will be configured with an interface.

The problem may be seen to occur when the number of interfaces configured is greater than 12 but may not occur until 20 are configured.

Cause

The cause of these problems is the SNMP daemon gradually using all CPU resources.

This is because net-snmp currently (as of Appliance Firmware Release 2011.1.1.0) supports a maximum of 20 network interfaces.

See 15680487 "snmpd does not process duplicate interface containers" for details of the original problem.

The CR filed to increase the limit of interfaces that SNMP can monitor is 15696295 net-snmp needs to support more than 20 configured interfaces".

Solution

Disabling SNMP will stop this problem.

The choice will then be to either reduce the number of interfaces below 20 if possible, or to not use SNMP to monitor the system.

To disable SNMP in the BUI click the "Disable Service" icon next to the SNMP service under the Configuration > Services screen.

Alternatively from the BUI:

appliance:> configuration services snmp disable

This issue can be resolved by upgrading to Appliance Firmware Release 2011.1.6.0

NOTE: If a customer is on 2013 code and observes similar issues, please see bug -

Bug 15712191 - SUNBT7040231 net-snmp needs to dynamically grow MibCache.

They will need to reduce their interface count below 50 as a workaround if they want to use SNMP under 2013 code.

Back to Document 1392086.1 Sun Storage 7000 Unified Storage System: How to Troubleshoot Network Problems.

References

<BUG:15696295> - SUNBT7018550 NET-SNMP NEEDS TO SUPPORT MORE THAN 20 CONFIGURED INTERFACES
<BUG:15680487> - SUNBT6998845 SNMPD DOES NOT PROCESS DUPLICATE INTERFACE CONTAINERS
<NOTE:1392086.1> - Sun Storage 7000 Unified Storage System: How to Troubleshoot Network Problems

Attachments

This solution has no attachment