Enterprise Manager plugin for ZFS Storage: Latest Snapshot Status Metric Extension for monitoring large amount of snapshots

Asset ID:	1-72-2303625.1
Update Date:	2018-01-05
Keywords:

Solution Type Problem Resolution Sure

Solution 2303625.1 : Enterprise Manager plugin for ZFS Storage: Latest Snapshot Status Metric Extension for monitoring large amount of snapshots

Applies to:

Oracle ZFS Storage ZS5-2 - Version All Versions and later
Oracle ZFS Storage ZS5-4 - Version All Versions and later
Enterprise Manager Base Platform - Version 12.1.0.5.0 and later
Oracle ZFS Storage ZS3-2 - Version All Versions and later
Oracle ZFS Storage ZS4-4 - Version All Versions and later
7000 Appliance OS (Fishworks)

Symptoms

OEM Agent 12.1.0.5 - Monitoring the ZFS targets is crashing during the agent start up.

Later it was reported that the cause was an agent out of memory due to the snapshot status metric.

Cause

The Snapshots Status metric is designed to show all the snapshots for the admin to monitor.

However this metric breaks down due to the large number of snapshot records the customer ZFSSA has, and EM limits the number of records (maximum flood control level) in one metric, so in this case, EM is not able to show and collect all the snapshots status for the customer's ZFSSA.

Solution

A metric extension is created containing a new metric Latest Snapshot Status". It only shows the latest one snapshot record for each share/project, instead of showing all snapshots taken for each share/project.

The collection of the original metric "Snapshot Status" need to be disabled.

Requirements

Oracle Enterprise Manager 12.1
Oracle Enterprise Manager Plug-in for Oracle ZFS Storage 2.1 or above
Enterprise Manager Agent hosting Plug-in deployed on a Linux Operating System Environment

Installation

This Metric Extension is for a Linux environment, it would have to be edited for a Windows environment prior to deployment. It should work unchanged in a Solaris environment but it was not tested for Solaris.

Download the metric extension: MEA_ME%24LatestSnapshot.zip

Installation Steps

Import the appropriate Metric Extension archive (.zip file) to Enterprise Manager:

Log into Oracle Enterprise Manager
Select from top level menu: "Enterprise" - "Monitoring" - "Metric Extension".
Click the "Actions" - "Import...", select "Browse" and select the downloaded .zip file
Choose the newly added metric extension and click "Actions" - "Save As Deployable Draft"
Choose the newly added metric extension and click "Actions" - "Publish Metric Extension"

To deploy to a targets.

Choose the extension row and click "Action" - "Deploy To Targets", click "+Add" and select targets.

Uninstallation Steps

Undeploy from all targets:

Go to "Enterprise" - "Monitoring" - "Metric Extensions"
Select the BackendLoad metric extension, choose "Actions" - "Manage Target Deployments"
Select all deployed targets and click "Undeploy"

Delete the Metric Extension:

Go to "Enterprise" - "Monitoring" - "Metric Extensions"
Select the BackendLoad metric extension, choose "Actions" - "Delete"

References

<BUG:22447084> - CHINOPV0002.USDC2.ORACLECLOUD.COM CRASHING WITH JAVA.LANG.OUTOFMEMORYERROR
<NOTE:1399201.1> - EM 12c, EM 13c: How to Modify or Increase Enterprise Manager Cloud Control Agent JVM Heap and Permgen Memory for the java.lang.OutOfMemoryError
<NOTE:1349887.1> - 12c EM: Steps to Tune the Cloud Control 12c Agent Performance When Monitoring a Large Number of Targets
<BUG:22451666> - ZFS TARGETS CAUSING JAVA.LANG.OUTOFMEMORYERROR
<BUG:22464411> - ZFSALERT THIS METRIC IS GENERATING TOO MANY ALERTS
<BUG:25883000> - ZFS TARGETS CAUSING JAVA.LANG.OUTOFMEMORYERROR

Attachments

This solution has no attachment