Upgrading to Solaris 11.2 on Solaris x86-64 Exadata Compute nodes

Asset ID:	1-71-1981473.1
Update Date:	2015-12-18
Keywords:

Solution Type Technical Instruction Sure

Solution 1981473.1 : Upgrading to Solaris 11.2 on Solaris x86-64 Exadata Compute nodes

Applies to:

Exadata Database Machine X2-2 Hardware - Version All Versions to All Versions [Release All Releases]
Exadata X3-2 Hardware - Version All Versions to All Versions [Release All Releases]
Exadata X4-2 Hardware - Version All Versions to All Versions [Release All Releases]
Oracle Solaris on x86-64 (64-bit)

Goal

The goal of this procedure is to upgrade Solaris to the current recommended Solaris Version on Exadata Compute Nodes.

Image Version 11.2.3.3.1 or 12.1.1.1.1 with Solaris 11.1 SRU 9.5.1 or SRU19.6 are requirements resp. starting points.
For upgrading from previous Images review Upgrading to Solaris 11.1 on Solaris x86-64 Exadata Compute nodes (Doc ID 1534482.1).

Solution

Note: We recommend to use Solaris 11.2 with the latest QFSDP supported SSC SRU (see Note 2086278.1 and Note 1672221.1 for details) as Solaris version for Exadata Database Server Version 12.1.1.1.1/11.2.3.3.1
It is recommended to upgrade Exadata Storage Server to minimum 12.1.1.1.1 previously to this procedure as well.

Note: X5-2 and later Hardware requires minimum 12.1.2.1.0 and only X5-2 and later cells can be added to rac running Solaris on compute nodes. X5-2 and later compute nodes can't be added.

For customers with no internet access, offline repositories available via ISO images can be used.

Where to download Oracle Solaris ISO images and Update Releases (Note 1277964.1)
Solaris 11.2 full repo

(root)# cd /u01; mkdir S11.2-repo

download 11.2 full repo in /u01

(root)# sh ./install-repo.ksh -d /u01/S11.2-repo -s /u01 -v -I -c

ISO repo is /u01/sol-11_2-repo.iso
Solaris 11.2 SRU 5.5

(root)# cd /u01; mkdir S11.2-SRU5.5-repo

download repo in /u01/S11.2-SRU5.5-repo

(root)# sh ./install-repo.ksh -d /u01/S11.2-SRU5.5-repo -s /u01/S11.2-SRU5.5-repo -v -I -c

ISO repo is /u01/S11.2-SRU5.5-repo/.iso

(root)# mv /u01/S11.2-SRU5.5-repo/.iso /u01/sol-11_2-sru-incr-repo.iso

Solaris 11.2 SRU 12.7

(root)# cd /u01; mkdir S11.2-SRU12.7-repo
download repo in /u01/S11.2-SRU12.7-repo

(root)# sh ./install-repo.ksh -d /u01/S11.2-SRU12.7-repo -s /u01/S11.2-SRU12.7-repo -v -I -c

ISO repo is /u01/S11.2-SRU12.7-repo/sol-11_2_12_7_0-incr-repo.iso

(root)# mv /u01/S11.2-SRU12.7-repo/sol-11_2_12_7_0-incr-repo.iso /u01/sol-11_2-sru-incr-repo.iso

Ensure there is a valid, restorable backup of Exadata Database Machine database servers.

Create backup of the current boot environment additionally to the backup of Exadata Database Machine database servers before starting this procedure:

(root)# beadm create S11.1-`date +%m%d%y`

(root)# beadm list|grep S11.1-
S11.1-021815 - - 1.01M static 2015-02-18 04:17

The following steps can be run on one compute node at a time in rolling fashion or in parallel if downtime is acceptable.

On the node(s) being upgraded stop and disable CRS first before upgrade and enable and start CRS after upgrade completion.
To stop and disable CRS, you could use these commands (run as root, substitute <GRID_HOME> with your Grid Infrastructure ORACLE_HOME path):

(root)# <GRID_HOME>/bin/crsctl stop crs

(root)# <GRID_HOME>/bin/crsctl disable crs

To enable and start CRS, you could use these commands:

(root)# <GRID_HOME>/bin/crsctl enable crs

(root)# <GRID_HOME>/bin/crsctl start crs

Note: Customers already on 11.1 SRU 9.5.1+idr679.2 must backout idr679.2 first>

setup offline repo: Upgrading to Solaris 11.1 on Solaris x86-64 Exadata Compute nodes (Doc ID 1534482.1)

(root)#/usr/bin/pkg update --reject pkg://solaris/idr679@2,5.11 \
pkg:/system/library@0.5.11,5.11-0.175.1.9.0.3.2:20130624T220452Z

Note: Customers already on 11.1 SRU 19.6 + idr1178 and idr1211 must backout them first:

setup offline repo: Upgrading to Solaris 11.1 on Solaris x86-64 Exadata Compute nodes (Doc ID 1534482.1)

(root)#/usr/bin/pkg update --reject pkg://solaris/idr1178@1,5.11 pkg:/driver/infiniband/connectx@0.5.11,5.11-0.175.1.19.0.5.2:20140505T164954Z pkg:/system/io/infiniband/ip-over-ib@0.5.11,5.11-0.175.1.18.0.2.2:20140317T181619Z pkg:/system/library@0.5.11,5.11-0.175.1.19.0.4.2:20140425T201846Z pkg:/system/io/infiniband@0.5.11,5.11-0.175.1.19.0.5.2:20140505T165701Z pkg:/system/network@0.5.11,5.11-0.175.1.16.0.2.2:20140121T215342Z pkg:/system/linker@0.5.11,5.11-0.175.1.13.0.1.2:20131004T215607Z pkg:/system/kernel/platform@0.5.11,5.11-0.175.1.19.0.5.2:20140505T165722Z pkg:/system/io/infiniband/open-fabrics@0.5.11,5.11-0.175.1.17.0.3.2:20140221T224457Z pkg:/system/kernel@0.5.11,5.11-0.175.1.19.0.4.2:20140425T201449Z

(root)#reboot

(root)# /usr/bin/pkg update --reject pkg://solaris/idr1211@1,5.11 pkg:/library/security/openssl@1.0.0.11,5.11-0.175.1.7.0.4.0:20130429T151253Z pkg:/library/security/openssl/openssl-fips-140@1.2,5.11-0.175.1.7.0.4.0:20130429T151231Z

Upgrading Solaris 11.1 to the current recommended Solaris 11.2 Version

Verify the Solaris 11.1 image, version and status, depending on the starting point.

(root)# /opt/oracle.cellos/imageinfo -version
11.2.3.3.1.140529.1

resp.

(root)# /opt/oracle.cellos/imageinfo -version
12.1.1.1.1.140601.1

(root)# pkg list entire

NAME (PUBLISHER) VERSION IFO
entire 0.5.11-0.175.1.9.0.5.1 i--

resp.

(root)# pkg list entire

NAME (PUBLISHER) VERSION IFO
entire 0.5.11-0.175.1.19.0.6.0 i--

(root)# pkg list| grep hmp

system/management/hmp/biosdrv 2.2.3 i--

system/management/hmp/hmp-hwmgmt 2.2.7.17734-1 i--

system/management/hmp/hmp-ipmiflash 1.8.10.5-4 i--

system/management/hmp/hmp-ipmitool 1.8.10.4-4 i--

system/management/hmp/hmp-libs 2.2.7.17734-1 i--

system/management/hmp/hmp-snmp 2.2.7.17734-1 i--

system/management/hmp/hmp-tools 2.2.7.17734-1 i--

system/management/hmp/hmp-tools-biosconfig 2.2.7.17734-1 i--

system/management/hmp/hmp-tools-ubiosconfig 2.2.7.17734-1 i--

Note: Solaris 11.2.3.3.1/12.1.1.1.1 imaged server have different exa-family packages:

exa-family packages corresponding to Image 12.1.1.1.1

(root)# pkg list| grep exa

system/platform/exadata/compmon 0.5.11-12.1.0.34 i--

system/platform/exadata/firstrun 0.5.11-12.1.0.34 i--

system/platform/exadata/ipconf 0.5.11-12.1.0.34 i--

system/platform/exadata/utils 0.5.11-12.1.0.34 i--

system/platform/exadata/validations 0.5.11-12.1.0.34 i--

exa-family packages corresponding to Image 11.2.3.3.1

(root)# pkg list| grep exa

system/platform/exadata/compmon (exa-family) 0.5.11-11.2.0.34 i--

system/platform/exadata/firstrun (exa-family) 0.5.11-11.2.0.34 i--

system/platform/exadata/ipconf (exa-family) 0.5.11-11.2.0.34 i--

system/platform/exadata/utils (exa-family) 0.5.11-11.2.0.34 i--

system/platform/exadata/validations (exa-family) 0.5.11-11.2.0.34 i--

Uninstall incompatible hmp packages

(root)# pkg uninstall -v \
system/management/hmp/hmp-ipmitool \
system/management/hmp/hmp-libs \
system/management/hmp/hmp-snmp \
system/management/hmp/hmp-tools-ubiosconfig \
system/management/hmp/hmp-tools-biosconfig \
system/management/hmp/hmp-tools \
system/management/hmp/hmp-hwmgmt \
system/management/hmp/biosdrv
reboot to the newly created boot environment

(root)# reboot
Step Update to S11.2 SRU supported on SSC

Setup publisher

online repos:

(root)# pkg set-publisher -G '*' -g http://pkg.oracle.com/solaris/support/ solaris

offline repos:

(root)# mount -F hsfs /u01/sol-11_2-repo.iso /mnt

(root)# mkdir -p /mnt2

(root)# mount -F hsfs /u01/sol-11_2-sru-incr-repo.iso /mnt2

(root)# pkg set-publisher -G '*' -g file:///mnt/repo/ solaris

(root)# pkg set-publisher -g file:///mnt2/repo/ solaris

Update to Solaris 11.2

Note: SRU5.5 is superseded by SRU12.7 and could be skipped
(root)# pkg update --require-new-be --be-name S11.2.5.0.5.0 -v --accept pkg:/entire@0.5.11-0.175.2.5.0.5.0

(root)# pkg update --require-new-be --be-name S11.2.12.0.7.0 -v --accept pkg:/entire@0.5.11-0.175.2.12.0.7.0
reboot to the newly created boot environment

(root)# reboot
Install hmp packs removed in previous step

Setup publisher

online repos:

(root)# pkg set-publisher -G '*' -g http://pkg.oracle.com/solaris/support/ solaris

offline repos:

(root)# mount -F hsfs /u01/sol-11_2-repo.iso /mnt

(root)# mkdir -p /mnt2

(root)# mount -F hsfs /u01/sol-11_2-sru-incr-repo.iso /mnt2

(root)# pkg set-publisher -G '*' -g file:///mnt/repo/ solaris

(root)# pkg set-publisher -g file:///mnt2/repo/ solaris

(root)# pkg install -v \
hmp-ipmitool \
hmp-libs \
hmp-snmp \
hmp-tools-ubiosconfig \
hmp-tools-biosconfig \
hmp-tools \
hmp-hwmgmt \
biosdrv
Download and install JIDR and CVE-relevant IDR(s)

Note: This Step is only relevant for SRU 5.5
Download the jumbo IDR for Solaris Exadata from <patch 20688770> to /tmp
Download CVE-relevant IDR(s) from <patch 20688774> to /tmp

(root)# mkdir -p /mnt3
(root)# pkg install --be-name S11.2.5.0.5.0-idr -v -g idr1861.2.p5p idr1861
(root)# beadm mount S11.2.5.0.5.0-idr /mnt3
(root)# pkg -R /mnt3 install -v -g idr1582.2.p5p idr1582
(root)# beadm umount S11.2.5.0.5.0-idr
reboot to the newly created boot environment

(root)# reboot
Create missing soft links

(root)# mkdir -p /opt/ipmitool/bin
(root)# ln -s /usr/sbin/ipmitool /opt/ipmitool/bin/ipmitool

(root)# ln -s /usr/lib/ssm/lib/libnnz11.so /lib/libnnz11.so
(root)# ln -s /usr/lib/ssm/lib/libclntsh.so.11.1 /lib/libclntsh.so.11.1
Verify the update

(root)# pkg list entire

NAME (PUBLISHER) VERSION IFO
entire 0.5.11-0.175.2.12.0.7.0 i--

resp. for SRU5.5

NAME (PUBLISHER) VERSION IFO

entire 0.5.11-0.175.2.5.0.5.0 i--

Note: relevant only for SRU5.5

(root)# pkg list idr*

NAME (PUBLISHER) VERSION IFO
idr1582 2 i--
idr1861 2 i--

(root)# pkg list |grep hmp

system/library/hmp-libs 2.3.2.4-0.175.2.12.0.3.0 i--

system/management/hmp-snmp 2.3.2.4-0.175.2.12.0.3.0 i--

system/management/hmp/hmp-ipmiflash (exa-family) 1.8.10.5-4 i--

resp. for SRU5.5

system/library/hmp-libs 2.2.8-0.175.2.2.0.4.0 i--

system/management/hmp-snmp 2.2.8-0.175.2.2.0.4.0 i--

system/management/hmp/hmp-ipmiflash (exa-family) 1.8.10.5-4 i--

(root)# pkg list |grep hwm

system/management/hwmgmtcli 2.3.2.4-0.175.2.12.0.3.0 i--

system/management/hwmgmtd 2.3.2.4-0.175.2.12.0.3.0 i--

resp. for SRU5.5

system/management/hwmgmtcli 2.2.8-0.175.2.2.0.4.0 i--

system/management/hwmgmtd 2.2.8-0.175.2.2.0.4.0 i--

(root)# pkg list |grep bios

system/management/biosconfig 2.3.2.4-0.175.2.12.0.3.0 i--

system/management/ubiosconfig 2.3.2.4-0.175.2.12.0.3.0 i--

resp. for SRU5.5

system/management/biosconfig 2.2.8-0.175.2.2.0.4.0 i--

system/management/ubiosconfig 2.2.8-0.175.2.2.0.4.0 i--

Attachments

This solution has no attachment