Private Cloud Appliance (PCA) 2.3.1 Upgrade: How to check the Oracle System Assistant (OSA) BIOS status on PCA nodes.

Asset ID:	1-71-2281943.1
Update Date:	2018-04-24
Keywords:

Solution Type Technical Instruction Sure

Solution 2281943.1 : Private Cloud Appliance (PCA) 2.3.1 Upgrade: How to check the Oracle System Assistant (OSA) BIOS status on PCA nodes.

Applies to:

Oracle Virtual Compute Appliance X4-2 Hardware - Version All Versions and later
Private Cloud Appliance X5-2 Hardware - Version All Versions and later
Oracle Virtual Compute Appliance X3-2 Hardware - Version All Versions and later
Information in this document applies to any platform.

Goal

Certain versions of the ILOM firmware installed on all OVCA / PCA compute and management nodes have Oracle System Assistant (OSA) enabled by default. In combination with Oracle PCA Controller Software Release 2.3.1, this setting is not permitted for Oracle PCA nodes, as it exposes an additional target disk for the operating system installation. During node provisioning, if the OSA is enabled, it will become corrupt and provisioning will fail.

This document describes how to check and to disable the OSA if needed. The example shown here is an x5-2 node as documented in the 2.3.1 Release notes:
4.1.12 Oracle Server X5-2 ILOM Firmware Causes Provisioning Failure and OSA Image Corruption with Oracle PCA Release 2.3.1 Controller Software

This check is needed for both compute and management nodes.

Solution

Note:
All solutions below contains steps that may require the node be shutdown. If a shutdown is needed, see:
Steps to Gracefully Shutdown and Power Off a Node in Oracle Private Cloud Appliance Prior to Maintenance (Doc ID 2256834.1)

Perform only one of these four solutions.

Solution #1 From the OS, use ubiosconfig to check and import
Solution #2 From the ILOM, export / Import BIOS xml file
Solution #3 Boot into system BIOS
Solution #4 Physically remove the OSA USB flash drive

Solution Details

Solution #1 use ubiosconfig to check and import

1. ssh to the node

2. Export the configuration

[root@oovcacn09r1~]# ubiosconfig export all -x /tmp/ovcacn09r1.xml

3. Check to see if the OSA is Enabled

[root@oovcacn09r1~]# grep -i OSA /tmp/ovcacn09r1.xml
    <OSA_Configuration>
    
    
    <OSA_Internal_Support>Enabled</OSA_Internal_Support>
    </OSA_Configuration>

4. If the OSA is enabled, Edit /tmp/ovcacn09r1.xml

Change this line from:
<OSA_Internal_Support>Enabled</OSA_Internal_Support>

to
<OSA_Internal_Support>Disabled</OSA_Internal_Support>

5. Import the changes

[root@oovcacn09r1 ~] #ubiosconfig import all -x /tmp/ovcacn09r1.xml
Are you sure you want to import the settings from the XML file to the BIOS? [y/n]? y
Preparing to restore XML file to BIOS...
Done preparing to restore settings in /tmp/shrek.xml to BIOS.
Restoring BIOS configuration (allow several minutes)................................
....................................................................................
....................................................................................
....................................................................................
....................................................................................
...........................................................................Done.

6. Repeat step #2 above and check if it is now disabled

Solution #2 From the ILOM, export / Import BIOS xml file

Note: The example below shows how to check compute node ovcacn09r1.
When you check the two management nodes in step 1, these commands will be used instead:

[root@ovcamn05r1 ~]# pca-admin list management-node | grep ovcamn05r1
[root@ovcamn05r1 ~]# pca-admin list management-node | grep ovcamn06r1

1. Find the node IP address...

[root@ovcamn05r1 ~]# pca-admin list compute-node --sorted-by=Compute_Node | grep ovcacn09r1
ovcacn09r1 192.168.4.6 RUNNING 00:10:e0:71:43:f3 running

...then add 100 to the last octet to determined the ILOM IP address.

192.168.4.6 + 100 = 192.168.4.106

2. ssh to the ovcacn09r1 ILOM (192.168.4.106) and export the BIOS configuration file into /tmp onto the management node.

[root@ovcamn05r1 ~]# ssh 192.168.4.106 -l root
Password:

Hostname: ILOM-ovcacn09r1

-> cd /System/BIOS/Config
/System/BIOS/Config

-> set dump_uri=sftp://root@192.168.4.3/tmp/ovcacn09r1.xml
Enter remote user password: ********
Dump successful

3. Search the file for "OSA_Internal_Support"

[root@ovcamn05r1 tmp]# grep OSA_Internal_Support ovcacn09r1.xml
<OSA_Internal_Support>Enabled</OSA_Internal_Support>

The field must say >Disabled<
If a change is needed, edit and save the file.

<OSA_Internal_Support>Disabled</OSA_Internal_Support>

4. Assure it is safe to stop the node, then stop it

-> stop /SYS

Are you sure you want to stop /SYS (y/n)? y
Stopping /SYS

[wait for the node to power off]

-> show /SYS power_state

/SYS
Properties:
power_state = Off

5. Load the updated configuration file

-> set load_uri=sftp://root@192.168.4.3/tmp/ovcacn09r1.xml
Enter remote user password: ********
Load successful.

6. Power the node back on.

-> start /SYS
Are you sure you want to start /SYS (y/n)? y
Starting /SYS

7. Repeat step #2 above (export the BIOS configuration file again) and check if it is now disabled.

If it is still "Enabled" then the OSA image is likely corrupt. Attempt Solution #2 to see if the BIOS setting is grayed out.

Solution #3 - Boot into system BIOS

Stop the node, boot into the BIOS to check and make changes if needed.

One example how to do this.

1. Configure a 'one time' boot device override to reboot the node into the BIOS.

-> cd /HOST
-> set boot_device=bios
Set 'boot_device' to 'bios'

2. Assure it is safe to stop the node, then stop it.

-> stop /SYS
Are you sure you want to stop /SYS (y/n)? y
Stopping /SYS

[wait until the node is off]

-> show /SYS power_state

/SYS
Properties:
power_state = Off

3. Once the node has stopped, power it on again and start the SP/console.

-> start /SYS
Are you sure you want to start /SYS (y/n)? y
Starting /SYS

-> show /SYS power_state
power_state = On

-> start /SP/console
Are you sure you want to start /SP/console (y/n)? y
Serial console started. To stop, type ESC (

3a. This is the first BIOS screen you will see after the node boot into the BIOS:

        Main Advanced IO Boot Exit
/----------------------------------------------------+-------------------------\
| Project Version 30.10.04.00                        |Set the Date. Use Tab    |
| System Date [Thu 06/29/2017]                       |to switch between Date   |
| System Time [17:41:41]                             |elements.              |
|                                                    |                         |
| QPI Link Speed 9.6 GT/s                            |                         |
| Total Memory 256 GB                                |                         |
| Current Memory Speed 2133 MT/s                     |                         |
| USB Devices:                                       |                         |
| 2 Hubs                                             |                         |
|                                                    |-------------------------|
| BMC Status BMC is working                          |><: Select Screen        |
| BMC Firmware Revision 3.2.8.24 r114580             |^v: Select Item          |
|                                                    |Enter: Select            |
|> Product Information                               |+/-: Change Opt.         |
|> CPU Information                                   |F1: General Help         |
|> DIMM Information                                  |F7: Discard Changes      |
|                                                    |F9: Optimized Defaults   |
|> Security                                          |F10: Save & Exit         |
|                                                    |ESC: Exit                |
\----------------------------------------------------+-------------------------/
          Version 2.16.1243. Copyright (C) 2013 American Megatrends, Inc.

4. Right arrow three times to highlight the 'Boot' screen and press the enter key.

Note: If the OSA Configuration setting in the following screens is "greyed out" you will not be able to toggle the Enabled/Disabled setting.
This is likely due to a corrupted OSA Image. It will been to be rebuilt. Afterwards, it should no longer be grayed out and then you can make the necessary changes.
Follow this process to rebuild the OSA:
Oracle® Private Cloud Appliance Administrator's Guide for Release 2.3
8.23 Rebuilding a Corrupted Oracle Server X5-2 OSA Image

        Main Advanced IO Boot Exit
/----------------------------------------------------+-------------------------\
| UEFI/BIOS Boot Mode [Legacy]                       |UEFI: Only UEFI Boot     |
| Retry Boot List [Enabled]                          |options are initialized |
| Network Boot Retry [Enabled]                       |and present to user.     |
|                                                    |Legacy: Only legacy      |
| Persistent Boot [Disabled]                         |boot options are         |
| Support                                            |initialized and present |
|                                    |to user.                 |
| NVMe Boot [Enabled]                                |                         |
|                                                    |                         |
|> OSA Configuration                                 |-------------------------|
|                                                    |><: Select Screen        |
| Legacy Boot Option Priority                        |^v: Select Item          |
| [RAID:PCIE4:(Bus 23 Dev 00)PCI RAID Adapter]       |Enter: Select            |
| [PXE:NET0:IBA XE Slot 3A00 v2320]                  |+/-: Change Opt.         |
| [PXE:NET1:IBA XE Slot 3A01 v2320]                  |F1: General Help         |
| [PXE:NET2:IBA XE Slot 8200 v2320]                  |F7: Discard Changes      |
| [PXE:NET3:IBA XE Slot 8201 v2320]    |F9: Optimized Defaults   |
|                                                    |F10: Save & Exit         |
|                                                    |ESC: Exit                |
\----------------------------------------------------+-------------------------/
          Version 2.16.1243. Copyright (C) 2013 American Megatrends, Inc.

5. Down arrow 5 times to 'OSA Configuration' then press the enter key to see the status.

                         Boot
/----------------------------------------------------+-------------------------\
| OSA Internal Support [Enabled] |Enable or Disable        |
|                                                    |Internal USB Ports for   |
|    |OSA boot                 |
|    |                         |
|    |                         |
|                                                    |                         |
|                                                    |                         |
|    |                         |
|                                                    |                         |
|                                                    |-------------------------|
|                                                    |><: Select Screen        |
|                                                  |^v: Select Item          |
|    |Enter: Select            |
|    |+/-: Change Opt. |
|                                                    |F1: General Help         |
|                                                  |F7: Discard Changes      |
|      |F9: Optimized Defaults   |
|              |F10: Save & Exit         |
|                                                    |ESC: Exit                |
\----------------------------------------------------+-------------------------/
          Version 2.16.1243. Copyright (C) 2013 American Megatrends, Inc.

6a. If you need to disable the OSA, press the enter key to see the Disabled/Enabled menu.

                         Boot
/----------------------------------------------------+-------------------------\
| OSA Internal Support [Enabled]                     |Enable or Disable        |
|                                                    |Internal USB Ports for   |
|                                                    |OSA boot                 |
|                                                    | |
|                                                    |                         |
|    |                         |
|    |                         |
|                       /---- OSA Internal Support ---\                        |
|                       | Disabled                  |    |
|                       | Enabled                     | ----------------------|
| \-----------------------------/   Select Screen        |
|                                                   Select Item          |
|        |Enter: Select            |
|                                                    |+/-: Change Opt.         |
|                                                    |F1: General Help         |
|    |F7: Discard Changes    |
|                                                    |F9: Optimized Defaults   |
|    |F10: Save & Exit         |
|                                                    |ESC: Exit    |
\----------------------------------------------------+-------------------------/
          Version 2.16.1243. Copyright (C) 2013 American Megatrends, Inc.

6b. Arrow up to highlight "Disabled" then press the enter key.

                         Boot
/----------------------------------------------------+-------------------------\
| OSA Internal Support [Disabled]                    |Enable or Disable        |
|                              |Internal USB Ports for   |
|    |OSA boot                 |
|                                                    |                         |
|                                                    |                         |
|                                                    |                         |
|                                                    |                         |
|    |                         |
|                                                    |                         |
|    |-------------------------|
|                                                    |><: Select Screen        |
|    |^v: Select Item          |
|                                                    |Enter: Select            |
|                                                    |+/-: Change Opt. |
|                                                    |F1: General Help         |
|    |F7: Discard Changes      |
|                                                    |F9: Optimized Defaults   |
|    |F10: Save & Exit         |
|                                                    |ESC: Exit                |
\----------------------------------------------------+-------------------------/
          Version 2.16.1243. Copyright (C) 2013 American Megatrends, Inc.

7. Press the ESC key to exit back to the Main Screen

        Main Advanced IO Boot Exit
/----------------------------------------------------+-------------------------\
| UEFI/BIOS Boot Mode [Legacy]                       |OSA Configuration Screen |
| Retry Boot List [Enabled]                          |                         |
| Network Boot Retry [Enabled]                       |                         |
|                                                    |                         |
| Persistent Boot [Disabled]                         | |
| Support    |                         |
|                                                    |                         |
| NVMe Boot [Enabled]                                |                         |
|                                                    |                         |
|> OSA Configuration                                 |-------------------------|
|                                                    |><: Select Screen        |
| Legacy Boot Option Priority                        |^v: Select Item          |
| [RAID:PCIE4:(Bus 23 Dev 00)PCI RAID Adapter]       |Enter: Select            |
| [PXE:NET0:IBA XE Slot 3A00 v2320]                  |+/-: Change Opt. |
| [PXE:NET1:IBA XE Slot 3A01 v2320]                |F1: General Help         |
| [PXE:NET2:IBA XE Slot 8200 v2320]            |F7: Discard Changes      |
| [PXE:NET3:IBA XE Slot 8201 v2320]                  |F9: Optimized Defaults   |
|                                                    |F10: Save & Exit         |
|                                                    |ESC: Exit                |
\----------------------------------------------------+-------------------------/
          Version 2.16.1243. Copyright (C) 2013 American Megatrends, Inc.

8. Arrow right once to highlight Exit. Make sure "Save Changes and Exit" is highlighted, then press the enter key

        Main Advanced IO Boot Exit
/----------------------------------------------------+-------------------------\
| Save Changes and Exit                              |Exit system setup after |
| Discard Changes and Exit                           |saving the changes.    |
| Discard Changes    |     |
| Restore Defaults                                   |     |
|                                                    |       |
|                                                    |     |
|                                                    |     |
|                                                    |                         |
|                                                    |       |
|                                                    |-------------------------|
|                                                    |><: Select Screen    |
|                                                    |^v: Select Item          |
|                                                    |Enter: Select            |
|                                                    |+/-: Change Opt.         |
|                                                    |F1: General Help         |
|                                                    |F7: Discard Changes      |
|                                                    |F9: Optimized Defaults   |
|                                                    |F10: Save & Exit         |
|    |ESC: Exit                |
\----------------------------------------------------+-------------------------/
          Version 2.16.1243. Copyright (C) 2013 American Megatrends, Inc

9. Answer yes.

        Main Advanced IO Boot Exit
/----------------------------------------------------+-------------------------\
| Save Changes and Exit                            |Exit system setup after |
| Discard Changes and Exit                           |saving the changes.      |
| Discard Changes                                    |                         |
| Restore Defaults                                   |                         |
|                                                    | |
| /----- Save & Exit Setup ------\                       |
|                       |                              |                       |
|                       | Save configuration and exit? |                       |
|                       |                              |                       |
|                       |------------------------------| ---------------------|
|                       |       Yes        No          | Select Screen         |
|                       \------------------------------/ Select Item           |
|                                                        r: Select             |
|    |+/-: Change Opt.         |
|                                                    |F1: General Help |
|                                                    |F7: Discard Changes      |
|    |F9: Optimized Defaults   |
|                                                    |F10: Save & Exit         |
|                                                    |ESC: Exit                |
\----------------------------------------------------+-------------------------/
          Version 2.16.1243. Copyright (C) 2013 American Megatrends, Inc.

10. The node will reboot if the OSA setting were changed, otherwise POST will continue and the OS will launch.

Solution #4 Physically remove the OSA USB flash drive
Shut down the node and remove the OSA USB flash drive. The PCA Product Development team has confirmed the flash drive is not needed in the chassis. The location of the OSA USB device (red) is near CPU "P0" (yellow).
If needed, see Remove an Internal USB Flash Drive in the Oracle® Server X5-2 Service Manual.

OSA

References

<BUG:25392805> - OVS SIZE AND PROVISIONING TIME

Attachments

This solution has no attachment