Upgrading to Solaris 11.3 on Solaris x86-64 Exadata Compute nodes

Asset ID:	1-71-2121725.1
Update Date:	2017-11-13
Keywords:

Solution Type Technical Instruction Sure

Solution 2121725.1 : Upgrading to Solaris 11.3 on Solaris x86-64 Exadata Compute nodes

Applies to:

Exadata X3-2 Hardware - Version All Versions to All Versions [Release All Releases]
Exadata X4-2 Hardware - Version All Versions to All Versions [Release All Releases]
Exadata X5-2 Hardware - Version All Versions to All Versions [Release All Releases]
Oracle Exadata Storage Server Software - Version 11.2.3.3.1 to 12.1.2.2.2 [Release 11.2 to 12.1]
Exadata Database Machine X2-2 Hardware - Version All Versions to All Versions [Release All Releases]
Oracle Solaris on x86-64 (64-bit)

Goal

The goal of this document is how to upgrade Solaris to the current recommended Solaris Version on Exadata Compute Nodes.

Image Version 11.2.3.3.1 or 12.1.1.1.1 with Solaris 11.2 SRU 5.5 or SRU 12.7 are requirements resp. starting points.
For upgrading from previous Images review Upgrading to Solaris 11.2 on Solaris x86-64 Exadata Compute nodes <Document 1981473.1>.

Solution

Note: We recommend to use Solaris 11.3 with the supported SRU included in the latest QFSDP for Oracle SuperCluster (see <Document 2086278.1> and <Document 2045311.1> for details) as Solaris version for Exadata Database Server Version 12.1.1.1.1/11.2.3.3.1
It is recommended to upgrade Exadata Storage Server to minimum 12.1.1.1.1 previously to this procedure as well.

Note: X5-2 and later Hardware requires minimum 12.1.2.1.0 and only X5-2 and later cells can be added to rac running Solaris on compute nodes. X5-2 and later compute nodes can't be added.

For customers with no internet access, offline repositories available via ISO images can be used.

Where to download Oracle Solaris ISO images and Update Releases (<Document 1277964.1>)
Solaris 11.3 full repo

(root)# cd /u01; mkdir S11.3-repo

download 11.3 full repo in /u01

(root)# sh ./install-repo.ksh -d /u01/S11.3-repo -s /u01 -v -I -c
Solaris 11.3 SRU included in the latest QFSDP

(root)# cd /u01; mkdir S11.3-SRU-repo

download repo in /u01/S11.3-SRU-repo

(root)# sh ./install-repo.ksh -d /u01/S11.3-SRU-repo -s /u01/S11.3-SRU-repo -v -I -c

Assuming both ISOs are:

11.3 ISO repo is /u01/sol-11_3-repo.iso
11.3 SRU ISO repo is /u01/S11.3-SRU-inc-repo.iso

Ensure there is a valid, restorable backup of Exadata Database Machine database servers.

Create backup of the current boot environment additionally to the backup of Exadata Database Machine database servers before starting this procedure:

(root)# beadm create S11.2-`date +%m%d%y`

(root)# beadm list|grep S11.2-
S11.2-093016 - - 374.5K static 2016-09-30 01:11

The following steps can be run on one compute node at a time in rolling fashion or in parallel if downtime is acceptable.

On the node(s) being upgraded stop and disable CRS first before upgrade and enable and start CRS after upgrade completion.
To stop and disable CRS, you could use these commands (run as root, substitute <GRID_HOME> with your Grid Infrastructure ORACLE_HOME path):

(root)# <GRID_HOME>/bin/crsctl stop crs

(root)# <GRID_HOME>/bin/crsctl disable crs

To enable and start CRS, you could use these commands:

(root)# <GRID_HOME>/bin/crsctl enable crs

(root)# <GRID_HOME>/bin/crsctl start crs

Note: Customers already on 11.2 SRU 5.5+idr1861+idr1582+ must backout these idrs first>

setup online/offline 11.2 and 11.2-SRU5.5 repo: Upgrading to Solaris 11.2 on Solaris x86-64 Exadata Compute nodes <Document 1981473.1>

(root)#/usr/bin/pkg update --reject pkg://solaris/idr1582@2,5.11 pkg:/service/network/ntp@4.2.7.381,5.11-0.175.2.4.0.5.0:20141030T213821Z

(root)#/usr/bin/pkg update --reject pkg://solaris/idr1861@2,5.11 pkg:/driver/infiniband/connectx@0.5.11,5.11-0.175.2.3.0.2.2:20140912T210345Z pkg:/driver/network/ethernet/ixgbe@0.5.11,5.11-0.175.2.5.0.3.2:20141124T150724Z pkg:/system/header@0.5.11,5.11-0.175.2.5.0.3.2:20141124T151052Z pkg:/system/io/infiniband@0.5.11,5.11-0.175.2.4.0.4.2:20141027T155226Z pkg:/system/io/infiniband/ip-over-ib@0.5.11,5.11-0.175.2.0.0.42.2:20140624T185410Z pkg:/system/io/infiniband/open-fabrics@0.5.11,5.11-0.175.2.5.0.4.2:20141201T211040Z pkg:/system/io/infiniband/reliable-datagram-sockets-v3@0.5.11,5.11-0.175.2.4.0.4.2:20141027T155223Z pkg:/system/kernel/platform@0.5.11,5.11-0.175.2.5.0.4.2:20141201T211043Z pkg:/system/library@0.5.11,5.11-0.175.2.5.0.3.2:20141124T151339Z pkg:/system/linker@0.5.11,5.11-0.175.2.0.0.42.2:20140624T185945Z pkg:/system/storage/iscsi/iscsi-initiator@0.5.11,5.11-0.175.2.3.0.4.2:20141002T141200Z pkg:/system/storage/iscsi/iscsi-iser@0.5.11,5.11-0.175.2.0.0.42.2:20140624T190141Z pkg:/system/zones@0.5.11,5.11-0.175.2.4.0.5.2:20141030T213527Z

(root)#reboot

Upgrading Solaris 11.2 to the current recommended Solaris 11.3 Version

Verify the Solaris 11.2 image, version and status, depending on the starting point.

(root)# /opt/oracle.cellos/imageinfo -version
11.2.3.3.1.140529.1

resp.

(root)# /opt/oracle.cellos/imageinfo -version
12.1.1.1.1.140601.1

(root)# pkg list entire

NAME (PUBLISHER) VERSION IFO
entire 0.5.11-0.175.2.5.0.5.0 i--

resp.

(root)# pkg list entire

NAME (PUBLISHER) VERSION IFO
entire 0.5.11-0.175.2.12.0.7.0 i--

Note: Solaris 11.2.3.3.1/12.1.1.1.1 imaged server have different exa-family packages:

exa-family packages corresponding to Image 12.1.1.1.1

(root)# pkg list| grep exa

system/platform/exadata/compmon 0.5.11-12.1.0.34 i--

system/platform/exadata/firstrun 0.5.11-12.1.0.34 i--

system/platform/exadata/ipconf 0.5.11-12.1.0.34 i--

system/platform/exadata/utils 0.5.11-12.1.0.34 i--

system/platform/exadata/validations 0.5.11-12.1.0.34 i--

exa-family packages corresponding to Image 11.2.3.3.1

(root)# pkg list| grep exa

system/platform/exadata/compmon (exa-family) 0.5.11-11.2.0.34 i--

system/platform/exadata/firstrun (exa-family) 0.5.11-11.2.0.34 i--

system/platform/exadata/ipconf (exa-family) 0.5.11-11.2.0.34 i--

system/platform/exadata/utils (exa-family) 0.5.11-11.2.0.34 i--

system/platform/exadata/validations (exa-family) 0.5.11-11.2.0.34 i--

Setup publisher

online repos:
(root)# pkg set-publisher -G '*' -g http://pkg.oracle.com/solaris/support/ solaris

offline repos:
(root)# cd

(root)# mount -F hsfs /u01/sol-11_3-repo.iso /mnt

(root)# mkdir -p /mnt2

(root)# mount -F hsfs /u01/S11.3-SRU-inc-repo.iso /mnt2

(root)# pkg set-publisher -G '*' -g file:///mnt/repo/ solaris

(root)# pkg set-publisher -g file:///mnt2/repo/ solaris
Update to Solaris 11.3
(root)# pkg update --require-new-be --be-name S11.3.22.0.3.0 -v --accept pkg:/entire@0.5.11-0.175.3.22.0.3.0
reboot to the newly created boot environment

(root)# reboot
Create missing soft links

(root)# mkdir -p /opt/ipmitool/bin
(root)# ln -s /usr/sbin/ipmitool /opt/ipmitool/bin/ipmitool
Verify the update

(root)# pkg list entire
NAME (PUBLISHER) VERSION IFO
entire 0.5.11-0.175.3.22.0.3.0 i--

References

<NOTE:1981473.1> - Upgrading to Solaris 11.2 on Solaris x86-64 Exadata Compute nodes
<NOTE:2086278.1> - SuperCluster Recommended Custom Incorporations, IDRs, and CVEs Addressed
<NOTE:2045311.1> - Oracle Solaris 11.3 Support Repository Updates (SRU) Index
<NOTE:1277964.1> - Where to download Oracle Solaris ISO images and Update Releases

Attachments

This solution has no attachment