Oracle ZFS Storage Appliance: How to Enable Oracle Intelligent Storage Protocol (OISP)

Asset ID:	1-71-1943618.1
Update Date:	2018-05-10
Keywords:

Solution Type Technical Instruction Sure

Solution 1943618.1 : Oracle ZFS Storage Appliance: How to Enable Oracle Intelligent Storage Protocol (OISP)

Applies to:

Oracle ZFS Storage ZS3-4 - Version All Versions and later
Oracle ZFS Storage ZS3-BA - Version All Versions and later
Oracle ZFS Storage ZS3-2 - Version All Versions and later
Sun ZFS Storage 7120 - Version All Versions and later
Sun ZFS Storage 7320 - Version All Versions and later
7000 Appliance OS (Fishworks)

Goal

This document describes how to set up the ZFS Storage Appliance to enable Oracle Intelligent Storage Protocol (OISP) with Oracle Database 12c.

Solution

What is Oracle Intelligent Storage Protocol ?

The Oracle Database has a layered architecture that includes the Oracle Disk Manager (ODM). The ODM provides a file management module that lets the Oracle Database use a local file system, a raw disk partition, or NFS server to store database information. To increase database performance, the ODM interface lets the Oracle Database pass information along with each I/O request. This information defines several attributes associated with the I/O such as the file type associated with the I/O request. This lets data file and database log file writes be handled differently.
The new Oracle Intelligent Storage Protocol allows the Oracle Database NFSv4 client to pass ODM optimization information to the NFSv4 server of the ZFS Storage Appliance. The ZFS Storage Appliance takes advantage of the ODM optimization information to simplify database configuration and to further increase database performance.

There are two Oracle Intelligent Storage Protocol features:

Automatically setting the Optimal file record size for new database files as well as setting the write bias (ZFS Latency or Throughput) for each write request
Providing ZFSSA NFSv4 Analytics broken down by Database ID.

Minimum Software

ZFSSA - OS8 (ak-2013.06.05.0.1)
Oracle Database 12c (12.1.0.1.0)

Additional Software for OISP Database Analytics

ZFSSA - OS8.3 (ak-2013.06.05.3)
Oracle Database 12c
- Oracle DB 12.1: 12.1.0.2 patch for Bug 19630940
- Oracle DB 12.2: No additional patches needed

Other Requirements
- Direct NFS (dNFS)
- Simple Network Mangement Protocol (SNMP) service enabled on ZFSSA

Steps to Enable OISP

1) Verify SNMP is enabled on ZFSSA.

se-alpha-1:configuration services snmp> show

Properties:
                      <status> = online
                       version = v1/2c
                     community = public
                       network = 0.0.0.0/0
                    syscontact = my.name@company.com
                      username =
                      password =
                authentication = MD5
                       privacy = None
                     trapsinks = 127.0.0.1
                      engineid = 0x80001f8880fbafb0014395865200000000

2) Verify SNMP returns a ZFS Storage identifier

# snmpget -v1 -c public <IP of ZFSSA> 1.3.6.1.4.1.42.2.225.1.4.2.0
SNMPv2-SMI::enterprises.42.2.225.1.4.2.0 = STRING: "Sun ZFS Storage 7420"

* Note that this step is optional and is used only as a secondary check. It may require installing further packages on your server such as net-snmp-utils for Linux. Installing these packages are outside the scope of this document.

3) Create minimum of 2 shares for Oracle Redo & Datafiles
All shares can have default properties for ZFS Recordsize and Logbias settings. OISP will handle correct settings on write.

Share1 - Redo
Share2 - Datafiles, Temp, Undo
Share3 - Archive/FRA (optional)

4) Mount NFS shares to client(s) per MOS 359515.1

* Note * Kernel NFS mount points will be NFSv3. When DNFS is enabled via the oranfstab, the nfs_version: 4 will override the kernel NFS version and NFS traffic will be NFSv4. This can be observed in the ZFSSA Analytics. Leave the fstab/vfstab NFS version at vers=3 for correct operation.

* Note * The example shown is Solaris but other OSs, such as Linux are also supported.

Solaris Example:

10.80.216.18:/export/oisp/fra    -       /zfssa/oisp/fra nfs     -       yes   rw,bg,hard,rsize=1048576,wsize=1048576,vers=3,nointr,forcedirectio,noac
10.80.216.19:/export/oisp/data   -       /zfssa/oisp/data nfs     -       yes   rw,bg,hard,rsize=1048576,wsize=1048576,vers=3 nointr,forcedirectio,noac
10.80.216.18:/export/oisp/redo   -       /zfssa/oisp/redo nfs     -       yes   rw,bg,hard,rsize=1048576,wsize=1048576,vers=3,nointr,forcedirectio,noac

5) Enable dNFS in Database

$ cd $ORACLE_HOME/rdbms/lib
$ make -f ins_rdbms.mk dnfs_on

6) Create $ORACLE_HOME/dbs/oranfstab file and enable nfsv4 for Direct NFS.

$ cat oranfstab
server: 10.80.216.18
path: 10.80.216.18
path: 10.80.216.19
nfs_version: nfsv4
export: /export/oisp/data mount: /zfssa/oisp/data
export: /export/oisp/redo mount: /zfssa/oisp/redo
export: /export/oisp/fra mount: /zfssa/oisp/fra

7) Start up Database, verify dNFS/OISP have been activated.

$ cd $ORACLE_BASE/diag/rdbms/?database?/trace

$ egrep -i 'Sun ZFS|Direct' alert_*.log
Found NAS server Sun ZFS Storage 7420
Oracle instance running with ODM: Oracle Direct NFS ODM Library Version 3.0
Direct NFS: channel id [0] path [10.80.216.18] to filer [10.80.216.18] via local [] is UP
Direct NFS: channel id [1] path [10.80.216.19] to filer [10.80.216.18] via local [] is UP
Direct NFS: mount complete dir /export/oisp/redo on 10.80.216.18 nfsport 2049 using NFS version 4
Direct NFS: mount complete dir /export/oisp/redo on 10.80.216.18 nfsport 2049 using NFS version 4

“Found NAS server” indicates SNMP has found the ZFSSA. Requirement for OISP.
ODM/Direct NFS indicates that dNFS has been activated using NFSv4.

8) Analytics can be used to monitor NFSv4/OISP database activity.

Since OS8.3, one can use NFSv4 drill downs such as :

NFSv4 Operations Broken Down by Application ID
NFSv4 Bytes Broken Down by Application ID

In OS8.7, you will be able to select a specific database and drill-down onto pluggable database, such as :

OISP operations per second broken down by database
OISP operations per second for Database 'CDB_10' broken down by pluggable database
OISP operations per second for Database 'CDB_10' for PluggableDB 'PDB_44' broken down by latency

See Bryce Cracco presentation (Senior Product Manager with Oracle Storage) : https://youtu.be/onz5T2Q3i6k?t=168

Analytics oisp

NOTE: dNFS uses unreserved ports for communication with NFS servers, so if the ZFSSA "Enforce reserved ports for system authentication" BUI option is checked, dNFS will not work.

Attachments

This solution has no attachment