Asset ID: |
1-71-1447093.1 |
Update Date: | 2018-05-02 |
Keywords: | |
Solution Type
Technical Instruction Sure
Solution
1447093.1
:
Oracle Database Appliance - Steps to Generate a Key via MOS to change your CORE Count and apply this Core Key
Related Items |
- Oracle Database Appliance X4-2
- Oracle Database Appliance
- Oracle Database Appliance X3-2
- Oracle Database Appliance X5-2
- Oracle Database Appliance Software
|
Related Categories |
- PLA-Support>Eng Systems>Exadata/ODA/SSC>Oracle Database Appliance>DB: ODA_EST
- _Old GCS Categories>ST>Server>Engineered Systems>Oracle Database Appliance>Install
|
Steps to apply Core Key on the Oracle Database Appliance
In this Document
Applies to:
Oracle Database Appliance X3-2 - Version All Versions to All Versions [Release All Releases]
Oracle Database Appliance - Version All Versions to All Versions [Release All Releases]
Oracle Database Appliance X4-2 - Version All Versions to All Versions [Release All Releases]
Oracle Database Appliance Software - Version 2.1.0.3 to 12.1.2.9 [Release 2.1 to 12.1]
Oracle Database Appliance X5-2 - Version All Versions to All Versions [Release All Releases]
Linux x86-64
ODA, Core Key, X5-2, Key Generation
Goal
Steps by Step instructions to Configure the Oracle Database Appliance CPU Core Count for Oracle Database Appliance V1, X3-2, X4-2 and X5-2
For X6-2 and higher please refer to Note 2220572.1:
ODA: X6-2 Capacity-On-Demand : How To Change & Register CPU Cores For Single-Node ODA Lite X6-2(S,M,L) or the Dual-Node ODA HA
OVERVIEW
This document discusses how to configure the Oracle Database Appliance CPU core count. The CPU core count is the number of enabled CPU cores per server
This note provides step by step instructions from the graphic interface via My Oracle Support to change the CPU Core Count for your Oracle Database Appliance ( ODA )
To Trouble Shoot ODA Core Problems
Reference:
Note 1638577.1 for ODA Troubleshooting Core Key Generation and Application Problems
Note
2220572.1 ODA: X6-2 and Higher Capacity-On-Demand :
How To Change & Register CPU Cores For Single-Node ODA Lite X6-2(S,M,L) or the Dual-Node ODA HA X6-2 If you are using the X5-2 and unable to create a Core Key higher than 18 per server
Reference:2252677.1 ODA X5-2 MOS Core Key GUI Not Able To Generate a Core Key Above 18 per server. MOS Pull-down Only Goes up to 18 vs. 36
2254456.1 ODA Oracle Database Appliance Manual Core Key Generation Request Procedure for X5-2, X4-2 X3-2 and V1
Requirements:
- CSI created for the ODA and registered on MOS (My Oracle Support)
The Single ODA System Identifier / Serial Number for X3-2, X4-2 and X5-2 (There is one matching serial# on both physical ODA blades)
- ODA V1 uses different serial numbers found on each Node within the same physical box
For X5-2 X4-2 and X3-2 using 12.1.2.x.x and higher you can use the command oakcli show server on BOTH nodes as the serial numbers must match each other.
root@oda0 bin]# oakcli show server
Power State : On
Open Problems : 0
Model : ODA X5-2
Type : Rack Mount
Part Number : 12345632+1+1
Serial Number : 15126NNN1234 <<<<<<<<<<<< This serial MUST match on BOTH of the ODA servers
Primary OS : Not Available
ILOM Address : 10.199.yy.xx
ILOM MAC Address : 00:10:xx:xx:xx:5E
Description : Oracle Database Appliance X5-2 15126NNN1234 <<<< HW ODA Version Dependent
Locator Light : Off
Actual Power Consumption : 357 watts
Ambient Temperature : 28.000 degree C
Open Problems Report : System is healthy
NOTE: If you are not seeing the expected number of Cores in My Oracle Support (MOS) when generating a Core Key you may be encountering a known MOS bug.
Please create a SR with Oracle Support
For example: If you see MOS Core key pull-down does not show enough Cores (X4-2 and X5-2 bug) or increments of 2 on X3-2 (fixed as of 2.9)
Support will also need the following information to forward internally until such as as the MOS bugs are fixed
SUPPORT ONLY - SR Number: Account Name: CSI:
-----------
System Serial#: << oakcli show server - make sure that the serial# on both nodes are the same (unless this is V1 which should already have had a Core Key years ago)
Hardware Type: << oakcli show env_hw
Core Count per Node: << the MOS Core Key generation is based on Cores per node
Core Count Total for the ODA -- This is 2x the single-server count
Reason for the Request
Comments: -- e.g. why are you unable to generate their own Key? Missing choice, MOS account problem, other
Sometimes the customer will follow all steps in this note and still be unable to GENERATE a Core Key.
INTERNAL for SUPPORT Add:
- SR#
- Account Name and
- CSI#
Support: When requesting a new core key for a customer who is unable to GENERATE a Core Key please get the external and above information from the customer
Send the above information in an email requesting a new Core Key to chuck.lucas@oracle.com cc: jiong.dai@oracle.com ; David LaPoint@oracle.com
-
Optionally: If the Oakcli command is not working
For X5-2 X4-2 and X3-2 please issue the following on both Nodes of the ODA as root to confirm these are as expected
oakcli show server
Optionally
ipmitool -I open sunoem getval /X/system_identifier
Target Value: Oracle Database Appliance X4-2 1456ABC12A
For ODA V1 (SUN FIRE X4370 M2 SERVER) issue the following on both Nodes -- the V1 requires both unique serial numbers unlike the Single SYSTEM level Serial number for the newer ODA Versions
[root@oda1 ~]# dmidecode -t1 | grep Serial
Serial Number: 123ABC123 << Should be the same for each node
- Steps via MOS to find your Asset (using the serial # for the ODA box ) -- see the example
To determine your ODA HW version you can issue the following (as root)
fwupdate list sp_bios
ODA X5-2, X4-2 or X3-2
root@oda1 -- X4-3 Example
==================================================
SP + BIOS
==================================================
ID Product Name ILOM Version BIOS/OBP Version XML Support
---------------------------------------------------------------------------------------------------------------
sp_bios SUN SERVER X4-2 v3.1.2.30.a r83840 25010601 N/A
V1 (X4370 M2)
root@odav1
[root@oda1 ~]# fwupdate list sp_bios
==================================================
SP + BIOS
==================================================
ID Product Name ILOM Version BIOS/OBP Version XML Support
---------------------------------------------------------------------------------------------------------------
sp_bios SUN FIRE X4370 M2 SERVER v3.0.16.22.d r83408 12010311 N/A
- Choose your Core count to be set for the first time OR to increase your core count from an existing value
You should see the Core Key Generation option if you are the ODA MOS CSI admin
Serial Number
Hardware Type
Cores per Server In sets of 2
-- Generate Key
Cores per Appliance -- will be automatically calculated at 2x the above value
*
The ODA serial number should be associated with a single CSITo determine the HW version on ODA version 2.8 and higher issue:
oakcli show HW_ENV
Example on ODA X4-2
[root@oda1 ~]# oakcli show env_hw
BM ODA X4-2 -- BM stands for Bare Metal
Example on ODA V1
[root@oda1 ~]# oakcli show env_hw
BM ODA
You can have more than one product under a single CSI, but the Key Generation is unique to each ODA box and based on the serial# .
The Core count key generated is not interchangeable with other ODA boxes
The CSI and associated serial number should be registered during purchase.
Solution
Rules and Restrictions for Changing the CPU Core Count (Bare Metal)
- After you SET a CPU core count for the ODA, then you can only increase subsequent CPU core counts
- You can change the CPU core count to 2,4,6,8,10 or 12 per server on V1 for a total of 24 cores (default)
- You can change the CPU core count to 2,4,6,8,10,12 or 16** per server on X3-2 for a total of 32 cores (default)**
- You can change the CPU core count to 2,4,6,8,10,12,14,16,18,20,22 or 24 per server on X4-2 for a total of 48 cores (default)*
- You can change the CPU core count to increments of 2 from 2 up to 36 per server on X5-2 for a total of 72 Cores
- Core Counts should be the same (matched count) on each server
* If you are changing from Bare Metal to Virtualization on ODA you must remove the Core Key (see the associated patchset README for more details )
** If you are using an older ODA version X3-2 + 2.8 or older cpu counts are al 4 per server are required on the BARE METAL X3-2 due to a processor chip limitation. This was fixed in 2.9 and higher the X3-2 can update at increments of 2 CPUs per node.
2.8 or lower: sets of 4 per server
2.10 or higher: Does allow increments of two per server
http://docs.oracle.com/cd/E22693_01/doc.12/e25375/chapter2.htm#CMTLI2261
Each ODA consists of two servers ( for the ODA-HA series)
X5-2,X4-2 and X3-2 number of Cores and can be incremented in sets of 2 per server up to the maximum of 72,48 and 32 respectively per ODA (both servers) **
For Example:
If you change the CPU core count to 6 per server (12 total), then you can subsequently increase the CPU core count to 8, 10, or 12...etc
If you later change the CPU core count to 8, then you can subsequently increase the CPU core count to 10 or 12...etc
If your desired CPU core count is 12 per server (V1), then use the default configuration.
You do not need to follow the procedure in "Changing the CPU Core Count" to set the CPU core count to 12 per server.
Using the default configuration will allow you to later change the CPU core count to a number less than 12, if desired.
Two cores per server for X5-2, X4-2 or X3-2**
The virtualization option does not require or use a Core Key*
Note: If you mistakenly followed the procedure to generate a Core Key or apply a core key higher than expected then contact Oracle Support immediately to fix the problem.
Steps: Example of Creating or Changing the ODA CPU Core Count including generating a Core Key
If you change the core count after the initial deployment, be aware that changing the core count causes both servers to restart. After the initial deployment, plan and carry out the core count change at a suitable time where the availability impact is minimized.
To change the CPU core count:
- Log in to the My Oracle Support at: https://myoraclesupport.com

- Click the Settings tab and select Assets from the submenu.

- Search for the serial number of the appliance in the asset list. (If you cannot locate the serial number, then contact Oracle Support.)

- Select the serial number of the appliance and click on "Core Configuration"in the Asset Details Screen

- Select Manage Key... from the available actions.

- In the Manage Cores Configuration Key dialog box, you can view the serial number of the appliance. If a key was previously generated, then you can view the current configuration.
- In the Cores Per Server list, select the desired number of enabled CPU cores per server. The value you select will apply to both servers on the appliance. Initially, you can select 2, 4, 6, 8, 10, or 12.
Subsequently, you can only select a number that is greater than the current number.
- Click Generate Key to generate the key.
- Click Copy Key to Clipboard to copy the key to the clipboard.
- Paste the key into an empty text file and save the file to a location on the Oracle Database Appliance.
- Log in to the first node of the servers on the Oracle Database Appliance as root.
Note:
• Customer should not attempt editing the generated key using any tools
• Customer could move the key to the Appliance using scp in binary mode.
• Open a Terminal session or xterm and Login as root
• Execute the oakcli apply core_config_key command as root
- The command in this step will reboot the server to complete the reconfiguration.
Run the following command:
# /opt/oracle/oak/bin/oakcli apply core_config_key /key_file_location/core_key_filename
Where key_file_location is the full path name of the text file that you created in Step 6.
For example:
# /opt/oracle/oak/bin/oakcli apply core_config_key /tmp/dis/core_key4

- After the system restarts, Oracle Database Appliance will be reconfigured and both servers will be running with the specified CPU core count.
# /opt/oracle/oak/bin/oakcli show core_config_key
Host's serialnumber = 01234AB56C7
Configured Cores = 20
Note: The CPU’s in the Database Appliance are hyper threaded, so when verifying the number of CPU cores with the cpuinfo command, you will see two times (2X) the number of cores configured pre server. For example, In this note we configured 10 cores per server, for a total of 20 cores for the appliance, so the cpuinfo command will return the following:
# cat /proc/cpuinfo | grep -i processor
processor : 0
processor : 1
processor : 2
processor : 3
processor : 4
processor : 5
processor : 6
processor : 7
processor : 8
processor : 9
processor : 10
processor : 11
processor : 12
processor : 13
processor : 14
processor : 15
processor : 16
processor : 17
processor : 18
processor : 19
...
... -- The maximum number of cores available is HW version dependent
...
WARNING! Changing your Core count per CPU has a few IMPORTANT rules
- The Core Count is not registered when your ODA arrives: The default configuration is to use enable Cores
- Register the ODA as an asset via MOS using your CSI
- You must have ODA CSI admin privileges to generate a Core Key !!
- If you plan on using ALL cores on the ODA you do not need to generate a Core Key.
- You need to register your Core Count if you are not using all available cores.
- Once in MOS you will need to confirm your product Serial Number
- The HW version and Serial number should be registered and viewable to the CSI admin or their designated agents.
- Except for the ODA V1, the ODA HA (X3-2.;Assets on MOS include:
(1) System Identifier = One Serial number for the Servers and JBOD(s)
(2) Two-Servers showing as assets ( each with their respective serial#
(1) JBOD Asset serial number with an optional 2nd JBOD asset available if purchased.
- NOTE: If you do not find the Asset Serial Number listed in MOS and cannot see the Core Key Generation ICON you may not have the proper privileges.
The ODA ships X5-2, X4-2 and X3-2 servers in matched paired sets : Make sure you have the proper serial number - please check
- Once registered using the MOS key generation tool to set your Core count per server: The MOS generated key will apply this same count to both servers
- Once applied you cannot generate a lower number of Core
Keep in mind that ODA is an architected box: ODA is not just Oracle 11.2.0.x EE installed on Server hardware that you can buy off the shelf.
There are very strict rules regarding configuration: Matching Core counts, consistent disk configuration and One-Command patching are qualities of ODA which are not optional.
If you have problems generating your Core Key and you have checked all of the above please check the ODA Community Forum
and then create a SR with Oracle Support Services
FOR SUPPORT and SALES
----------------------------------
1. Customer Admin needs to add the Hardware CSI into the MOS Profile and choose the correct Company name [ For Global Organization] and then Click - Request Access-
2. Under Accounts and Privileges: The CSI Status turns to - Pending Oracle Approval -
[ The support SLA is from 2 hours to 24 hours]
a. Support checks that the CSI admin user email id has the same domain as the Company.
That means the Partners would not be able to generate the core key for their
customers using their email id.
b. It may be a good idea to call the Support Hotline and follow up on the status and advice
3. An email is sent to the Admin giving the details of the CSI Request and if it is Approved ?
4. If not logging out of the MOS , then remember to REFRESH the page
5. Once the CSI shows the status as -Approved- you are ready to generate the Core key
There has been a transition from MOS using FLASH vs. HTML. During the transition several users experienced problems altering the CORE COUNT using HTML. This problem has been fixed so it is no longer a problem creating the CORE COUNT KEY using HTML. Please report any new Core Key Count generation problems using HTML to the ODA email list
Note: ODAVP ( Virtualized ODA usage)
For Virtualized environments you do not need to generate a Core key.
Some Cores should be reserved exclusively for ODA_BASE
You can choose the licensed number of cores during ODA_BASE deployment. i.e. Use the oakcli configure oda_base command from DOM0 to change the core count for
database usage.
You can use the CPU cores not assigned to Oracle Database (ODA_BASE) for virtual machines,
It is currently
required to _remove_ the core count when moving from ODA (BM) Bare Metal
to ODAVP to avoid inadvertent CPU caps for subsequent CPU Core Count increases.*
On ODAVP environments, Database licensing is controlled by the number of cores allocated during the ODA_BASE deployment
This can be changed after the ODA deployment using oakcli configure ODA_BASE command
Please refer to the most current Documentation available at any of multiple locations including docs.oracle.com under Engineered Systems -> Oracle Database Appliance
- About CPU Pools on Oracle Database Appliance Virtualized Platform
- Managing CPU Pools on Oracle Database Appliance Virtualized Platform
- Impact of failing over using the CPU pool on the secondary node
- * Resizing ODA Base
http://docs.oracle.com/cd/E22693_01/doc.12/e55580/vmadmin.htm#CACBEGCD
|
V1 |
V2 (X3-2) |
X4-2 |
X5-2 |
Number of Cores per CPU |
6 |
8 |
12 |
18 |
Number of CPUs per Server |
2 |
2 |
2 |
2 |
CPU Cores per Server |
12 |
16 |
24 |
36 |
Total CPU Cores per ODA Appliance |
24 |
32 |
48 |
72 |
Core Increment per Server - Bare Metal |
2 |
2 (or 4 on ODA 2.8 and lower) |
2 |
2 |
Core Increment per Server - ODAVP |
2 |
2 |
2 |
2 |
Community Discussions
Still have questions? Use the communities window below to search for similar discussions or start a new discussion on this subject. (Window is the live community not a screenshot)
Click here to open in main browser window
References
<NOTE:1638577.1> - ODA Troubleshooting ODA Core Key Generation and Application Problems
<NOTE:2252677.1> - ODA X5-2 MOS Core Key GUI Not Able To Generate a Core Key Above 18 per server. MOS Pull-down Only Goes up to 18 vs. Up to 36
<NOTE:2254456.1> - ODA Oracle Database Appliance Manual Core Key Generation Request Procedure for X5-2, X4-2 X3-2 and V1
<NOTE:2220572.1> - ODA: X6-2 Capacity-On-Demand : How To Change & Register CPU Cores For Single-Node ODA Lite X6-2(S,M,L) or the Dual-Node ODA HA X6-2
Attachments
This solution has no attachment