Oracle Virtual Networking (OVN/Xsigo) Environment Maintenance Activities

Asset ID:	1-71-2123295.1
Update Date:	2017-06-22
Keywords:

Solution Type Technical Instruction Sure

Solution 2123295.1 : Oracle Virtual Networking (OVN/Xsigo) Environment Maintenance Activities

Applies to:

Oracle Fabric Interconnect F1-4 - Version All Versions to All Versions [Release All Releases]
Oracle Fabric Manager - Version 4.0.2 to 4.0.2 [Release 4.0]
Oracle Fabric Interconnect F1-15 - Version All Versions to All Versions [Release All Releases]
Information in this document applies to any platform.

Goal

This KB details instructions on what common maintenance tasks may be needed for the Oracle Virtual Networking Fabric Interconnects F1-15, F1-4 and Oracle Fabric Manager for continued optimum performance and reliability.

Solution

It is possible that over a period of time, if customers have generated many diagnostic log bundles on the Fabric Interconnects for Oracle to analyze and/or if there are a large number of process or IO card core files, that a Debian file system on Fabric Interconnect may become too full, thereby slowing down performance. May be unable to generate new diagnostic log bundles or notice sluggishness when accessing the Fabric Interconnect CLI.

To examine file system usage log into the Fabric Interconnect as user 'root' and run:

f1-4-sca11-a:# df -v
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/hda6 427796 140685 265024 35% /
tmpfs 476144 0 476144 0% /lib/init/rw
udev 10240 644 9596 7% /dev
tmpfs 476144 4 476140 1% /dev/shm
tmpfs 5120 0 5120 0% /mnt
/dev/hda8 9614116 1275168 7850576 14% /opt/xsigo/xsigos
/dev/hda9 9614116 969572 8156172 11% /var/log
/dev/hda10 8649544 1586596 6623572 20% /var/data
/dev/hda11 6332928 33756 5977472 1% /var/datatmp
/dev/hda11 6332928 33756 5977472 1% /var/tmp
/dev/hda11 6332928 33756 5977472 1% /var/data/tmp
/dev/hda7 2885780 2113172 626020 78% /var/fsroot
/dev/hdb8 189339 264 179299 1% /mnt/volatile/config
/dev/hdb9 45355 67 42946 1% /mnt/volatile/etc
/tmp 476144 36 476108 1% /tmp
/tmp 476144 56 476088 1% /var/run

Example output - please note two File Systems to pay attention to, /var/fsroot/ and /var/log::

In the output look for any file system that is more than 75% full, normally will be /var/fsroot and/or /var/log, (/var/log/coredumps)may need to be cleared periodically of old core, crash, and diagnostic log tar bundle files. May copy them off to another system for auditing purposes for safe-keeping if desired.

If there are a large number of core files in /var/log/coredumps, copy old ones off to another server or safekeeping and then delete the old ones from the file system:

To display dates on files from within a directory with date of file creation so you know which files are old and can either be moved off and then deleted or just deleted without moving.

# ls -la

# rm -f <coredump filename>

Also remove old Fabric Interconnect diagnostic log bundles in /var/fsroot/admin or /var/fsroot/<username>

Should also periodically clear old Fabric Interconnect alarms to help make the tech-support output smaller and easier to navigate/read. This is done from within the Oracle Fabric Manager (OFM):

http://docs.oracle.com/cd/E38500_01/pdf/E49557.pdf --> Page 373

Other maintenance to perform within OFM is to "clear completed jobs" - which is accomplished by clicking on the "broom" in left hand pane and "clean the database" under the "screwdriver" icon at top right of the OFM GUI screen. These tasks should be performed periodically to keep the OFM Database compact to allow it to operate efficiently.

NOTE : Clearing completed jobs and cleaning the database should always be performed prior to upgrading the Oracle Fabric Manager software version.

This is where all Oracle Fabric Interconnect login users reside, check each user's directory and remove all old diagnostic log tar bundles:

f1-4-sca11-a:/var/fsroot# ls -la
total 41
drwxrwsrwt 11 root xgusers 4096 2012-09-19 21:11 .
drwxr-xr-x 19 root root 1024 2011-08-03 18:51 ..
drwxrws--- 7 admin xgusers 4096 2015-12-04 08:25 admin
drwxrws--- 2 administrator xgusers 4096 2012-08-21 14:51 administrator
drwxrwsrwx 2 root xgusers 4096 2011-05-18 15:47 cmdlocal
drwxrws--- 2 guest xgusers 4096 2012-09-19 21:11 guest
drwx------ 2 root root 4096 2010-06-30 10:56 lost+found
drwxrws--- 2 ray xgusers 4096 2010-06-23 15:58 operator
drwxrws--- 2 ray xgusers 4096 2012-08-01 16:41 ray
drwxrws--- 2 guest xgusers 4096 2011-03-28 16:45 svc_mgmt
drwxrws--- 2 administrator xgusers 4096 2010-06-23 16:02 user-test1

Example output of /var/fsroot/admin folder:

f1-4-sca11-a:/var/fsroot/admin# ls -la
total 881908
drwxrws--- 7 admin xgusers 4096 2015-12-04 08:25 .
drwxrwsrwt 11 root xgusers 4096 2012-09-19 21:11 ..
-rw-rw-r-- 1 admin xgusers 15512 2012-10-09 14:29 bala.txt
-rw-rw-r-- 1 admin xgusers 266374 2013-04-18 10:10 config.Thu.Apr.18.10:10:10.PDT.2013
-rw-rw-r-- 1 admin xgusers 574 2014-08-06 03:45 eileen
-rw-rw-r-- 1 admin xgusers 574 2014-08-06 03:47 eileen1
-rw-rw-r-- 1 admin xgusers 247297 2015-02-26 08:22 f1-4-sc11-a-02262015
drwxr-sr-x 4 1152 109 4096 2008-05-06 01:59 fw-47396-1.0.5
-rw-r--r-- 1 root xgusers 269968 2011-05-27 15:44 fw-47396-1.0.5.tgz
-rw-r--r-- 1 root xgusers 692680 2012-11-28 02:00 fw-ConnectX2-rel-2_11_2010-b2-375-3697-01.bin
-rw-r----- 1 root xgusers 378836 2011-05-27 11:29 fw-IS4-rel-7_3_120-MTS3600Q_A1.bin
-rw-rw-r-- 1 admin xgusers 31020810 2013-09-19 04:56 gino.tar.gz
-rw-rw-r-- 1 admin xgusers 10603 2012-08-24 14:08 ibtest
-rw-r--r-- 1 root xgusers 842983 2011-05-31 10:04 is3.img
-rw-rw-r-- 1 admin xgusers 32770922 2015-06-15 15:11 leonard_test.gz
drwxrwsr-x 2 admin xgusers 4096 2014-07-07 08:13 logdump.1789213338
drwxrwsr-x 2 admin xgusers 4096 2013-07-03 10:48 logdump.830072826
-rw-r--r-- 1 root xgusers 634880 2012-08-08 13:39 OptionRom289.tar
-rw-rw-r-- 1 admin xgusers 246402 2014-08-18 09:47 ray_test_1
-rw-rw-r-- 1 admin xgusers 37727048 2013-06-03 02:37 SR#-f1-4-sc11-a-logs.tar.gz
drwx--S--- 2 admin xgusers 4096 2010-07-20 16:50 .ssh
-rwxrwxr-x 1 admin xgusers 15512 2013-05-30 08:17 test.tst
drwxrwsr-x 2 admin xgusers 4096 2013-09-13 05:44 Xgos
-rw-rw-r-- 1 admin xgusers 285416 2014-01-31 22:14 xms_export_1391252400022.xml
-rw-rw-r-- 1 admin xgusers 285416 2014-02-01 22:14 xms_export_1391338800002.xml
-rw-rw-r-- 1 admin xgusers 285416 2014-02-02 22:14 xms_export_1391425200002.xml
-rw-rw-r-- 1 admin xgusers 285416 2014-02-03 22:14 xms_export_1391511600002.xml
-rw-rw-r-- 1 admin xgusers 284910 2014-02-04 22:15 xms_export_1391598000002.xml
-rw-rw-r-- 1 admin xgusers 284910 2014-02-05 22:15 xms_export_1391684400002.xml
-rw-rw-r-- 1 admin xgusers 284910 2014-02-06 22:15 xms_export_1391770800003.xml
-rw-rw-r-- 1 admin xgusers 284910 2014-02-07 22:15 xms_export_1391857200002.xml
-rw-rw-r-- 1 admin xgusers 284910 2014-02-08 22:15 xms_export_1391943600002.xml
-rw-rw-r-- 1 admin xgusers 284910 2014-02-09 22:15 xms_export_1392030000002.xml
-rw-rw-r-- 1 admin xgusers 284910 2014-02-10 22:16 xms_export_1392116400002.xml
-rw-rw-r-- 1 admin xgusers 284910 2014-02-11 22:16 xms_export_1392202800002.xml
-rw-rw-r-- 1 admin xgusers 285437 2014-02-12 22:16 xms_export_1392289200003.xml
-rw-rw-r-- 1 admin xgusers 285437 2014-02-13 22:16 xms_export_1392375600002.xml
-rw-rw-r-- 1 admin xgusers 285437 2014-02-14 22:16 xms_export_1392462000002.xml
-rw-rw-r-- 1 admin xgusers 285437 2014-02-15 22:17 xms_export_1392548400003.xml
-rw-rw-r-- 1 admin xgusers 285491 2014-02-16 22:17 xms_export_1392634800024.xml
-rw-rw-r-- 1 admin xgusers 285491 2014-02-17 22:17 xms_export_1392721200003.xml
-rw-rw-r-- 1 admin xgusers 285491 2014-02-18 22:17 xms_export_1392807600003.xml
-rw-rw-r-- 1 admin xgusers 34588449 2014-01-28 05:24 xms_logs_1390932455121.tar.gz
-rw-rw-r-- 1 admin xgusers 34733218 2014-01-31 03:48 xms_logs_1391185843461.tar.gz
-rw-r--r-- 1 root xgusers 361027125 2013-02-16 17:58 xsigo-3.9.0-XGOS.xpf
-rw-r--r-- 1 root xgusers 361025099 2015-12-04 07:42 xsigo-3.9.1-XGOS.xpf
-rw-rw-r-- 1 admin xgusers 15870 2016-04-01 06:59 .xsigohistory

Export core files you want to save off to another system for safe keeping and then delete the core files from /var/log/coredumps:

Sample output (Example only) - logged in as user "root":

f1-4-sca11-a:/var/fsroot/admin# cd /var/log/coredumps
f1-4-sca11-a:/var/log/coredumps# ls -la
total 76296
drwxrwxrwx 2 root root 4096 2014-05-16 06:07 .
drwxr-xr-x 13 root root 4096 2016-04-01 07:00 ..
-rwxrwxrwx 1 root root 50075 2013-02-16 16:47 diag_fccard_1_ts_1361062018
-rwxrwxrwx 1 root root 79500 2012-05-21 15:45 diag_fccard_4_ts_1337639846
-rw-r--r-- 1 root root 11806864 2014-03-04 02:20 PGDATA.bad.1791.tar.gz
-rw-r--r-- 1 root root 12373087 2014-10-08 18:13 PGDATA.bad.1803.tar.gz
-rw-r--r-- 1 root root 11900471 2014-03-13 07:30 PGDATA.bad.1804.tar.gz
-rw-r--r-- 1 root root 12506859 2014-05-16 06:07 PGDATA.bad.1805.tar.gz
-rwxrwxrwx 1 root root 150913024 2012-10-15 08:58 systemcontrolle.2622.core
-rwxrwxrwx 1 root root 19251200 2012-05-02 14:37 vhbaagent.530-iop-XI1F82FQZZ-1.1.core
-rwxrwxrwx 1 root root 9569 2012-05-02 14:37 vhbaagent.530-iop-XI1F82FQZZ-1.1.crash
-rwxrwxrwx 1 root root 79638528 2013-01-29 09:21 xc_xsm.2103.core

Attachments

This solution has no attachment