Sun Microsystems, Inc.  Oracle System Handbook - ISO 7.0 May 2018 Internal/Partner Edition
   Home | Current Systems | Former STK Products | EOL Systems | Components | General Info | Search | Feedback

Asset ID: 1-71-1447093.1
Update Date:2018-05-02
Keywords:

Solution Type  Technical Instruction Sure

Solution  1447093.1 :   Oracle Database Appliance - Steps to Generate a Key via MOS to change your CORE Count and apply this Core Key  


Related Items
  • Oracle Database Appliance X4-2
  •  
  • Oracle Database Appliance
  •  
  • Oracle Database Appliance X3-2
  •  
  • Oracle Database Appliance X5-2
  •  
  • Oracle Database Appliance Software
  •  
Related Categories
  • PLA-Support>Eng Systems>Exadata/ODA/SSC>Oracle Database Appliance>DB: ODA_EST
  •  
  • _Old GCS Categories>ST>Server>Engineered Systems>Oracle Database Appliance>Install
  •  


Steps to apply Core Key on the Oracle Database Appliance

In this Document
Goal
 OVERVIEW 
Solution
 Rules and Restrictions for Changing the CPU Core Count (Bare Metal)
 
Steps: Example of Creating or Changing the ODA CPU Core Count including generating a Core Key
References


Applies to:

Oracle Database Appliance X3-2 - Version All Versions to All Versions [Release All Releases]
Oracle Database Appliance - Version All Versions to All Versions [Release All Releases]
Oracle Database Appliance X4-2 - Version All Versions to All Versions [Release All Releases]
Oracle Database Appliance Software - Version 2.1.0.3 to 12.1.2.9 [Release 2.1 to 12.1]
Oracle Database Appliance X5-2 - Version All Versions to All Versions [Release All Releases]
Linux x86-64
ODA, Core Key, X5-2, Key Generation

Goal

Steps by Step instructions to Configure the Oracle Database Appliance CPU Core Count for Oracle Database Appliance V1, X3-2, X4-2 and X5-2

For X6-2 and higher please refer to Note 2220572.1:
ODA: X6-2 Capacity-On-Demand : How To Change & Register CPU Cores For Single-Node ODA Lite X6-2(S,M,L) or the Dual-Node ODA HA

OVERVIEW 

This document discusses how to configure the Oracle Database Appliance CPU core count. The CPU core count is the number of enabled CPU cores per server

This note provides step by step instructions from the graphic interface via My Oracle Support to change the CPU Core Count for your Oracle Database Appliance ( ODA )

To Trouble Shoot ODA Core Problems

Reference:
Note 1638577.1 for ODA Troubleshooting Core Key Generation and Application Problems
Note 2220572.1 ODA: X6-2 and Higher Capacity-On-Demand :
                       How To Change & Register CPU Cores For Single-Node ODA Lite X6-2(S,M,L) or the Dual-Node ODA HA X6-2


If you are using the X5-2 and unable to create a Core Key higher than 18 per server

Reference:
2252677.1 ODA X5-2 MOS Core Key GUI Not Able To Generate a Core Key Above 18 per server. MOS Pull-down Only Goes up to 18 vs. 36
2254456.1 ODA Oracle Database Appliance Manual Core Key Generation Request Procedure for X5-2, X4-2 X3-2 and V1
 


Requirements:

  • CSI created for the ODA and registered on MOS (My Oracle Support)

The Single ODA System Identifier / Serial Number for X3-2, X4-2 and X5-2 (There is one matching serial# on both physical ODA blades)
- ODA V1 uses different serial numbers found on each Node within the same physical box

For X5-2 X4-2 and X3-2 using 12.1.2.x.x and higher you can use the command oakcli show server on BOTH nodes as the serial numbers must match each other.

root@oda0 bin]# oakcli show server

       Power State              : On
       Open Problems            : 0
       Model                    : ODA X5-2
       Type                     : Rack Mount
       Part Number              : 12345632+1+1
       Serial Number            : 15126NNN1234             <<<<<<<<<<<<  This serial MUST match on BOTH of the ODA servers
       Primary OS               : Not Available
       ILOM Address             : 10.199.yy.xx
       ILOM MAC Address         : 00:10:xx:xx:xx:5E
       Description              : Oracle Database Appliance X5-2 15126NNN1234    <<<< HW ODA Version Dependent
       Locator Light            : Off
       Actual Power Consumption : 357 watts
       Ambient Temperature      : 28.000 degree C
       Open Problems Report     : System is healthy

 

NOTE: If you are not seeing the expected number of Cores in My Oracle Support (MOS) when generating a Core Key you may be encountering a known MOS bug.
Please create a SR with Oracle Support
For example: If you see MOS Core key pull-down does not show enough Cores (X4-2 and X5-2 bug) or increments of 2 on X3-2 (fixed as of 2.9)

Support will also need the following information to forward internally until such as as the MOS bugs are fixed

SUPPORT ONLY - SR Number: Account Name: CSI:
-----------
System Serial#:                         << oakcli show server - make sure that the serial# on both nodes are the same (unless this is V1 which should already have had a Core Key years ago)
Hardware Type:                          << oakcli show env_hw
Core Count per Node:                 << the MOS Core Key generation is based on Cores per node
Core Count Total for the ODA    -- This is 2x the single-server count
Reason for the Request
   
Comments: -- e.g. why are you unable to generate their own Key? Missing choice, MOS account problem, other

Sometimes the customer will follow all steps in this note and still be unable to GENERATE a Core Key.

INTERNAL for SUPPORT Add:

  • SR#
  • Account Name and
  • CSI#

Support: When requesting a new core key for a customer who is unable to GENERATE a Core Key please get the external and above information from the customer
Send the above information in an email requesting a new Core Key to chuck.lucas@oracle.com cc:   jiong.dai@oracle.com ;  David LaPoint@oracle.com

 

  •  Optionally: If the Oakcli command is not working


    For X5-2 X4-2 and X3-2 please issue the following on both Nodes of the ODA as root to confirm these are as expected
         
    oakcli show server

          Optionally

    ipmitool -I open sunoem getval /X/system_identifier

        Target Value: Oracle Database Appliance X4-2 1456ABC12A


    For ODA V1 (SUN FIRE X4370 M2 SERVER) issue the following on both Nodes -- the V1 requires both unique serial numbers unlike the Single SYSTEM level Serial number for the newer ODA Versions

    [root@oda1 ~]# dmidecode -t1 | grep Serial

            Serial Number: 123ABC123               << Should be the same for each node


  • Steps via MOS to find your Asset (using the serial # for the ODA box ) -- see the example

    To determine your ODA HW version you can issue the following (as root)
    fwupdate list sp_bios
     

    ODA X5-2, X4-2 or X3-2
    root@oda1    -- X4-3 Example

    ==================================================
    SP + BIOS
    ==================================================
    ID               Product Name                  ILOM Version                  BIOS/OBP Version              XML Support
    ---------------------------------------------------------------------------------------------------------------
    sp_bios        SUN SERVER X4-2               v3.1.2.30.a r83840            25010601                            N/A 
      

    V1 (X4370 M2)
    root@odav1

    [root@oda1 ~]# fwupdate list sp_bios
    ==================================================
    SP + BIOS
    ==================================================
    ID        Product Name                  ILOM Version                  BIOS/OBP Version              XML Support
    ---------------------------------------------------------------------------------------------------------------
    sp_bios   SUN FIRE X4370 M2 SERVER      v3.0.16.22.d r83408           12010311                      N/A    
     

  • Choose your Core count to be set for the first time OR to increase your core count from an existing value

    You should see the Core Key Generation option if you are the ODA MOS CSI admin
    Serial Number
    Hardware Type
    Cores per Server     In sets of 2  
    -- Generate Key

    Cores per Appliance  -- will be automatically calculated at 2x the above value
     
* The ODA serial number should be associated with a single CSI

To determine the HW version on ODA version 2.8 and higher issue:
oakcli show HW_ENV
  
Example on ODA X4-2

  [root@oda1 ~]#  oakcli show env_hw

   BM ODA X4-2                         -- BM stands for Bare Metal


Example on ODA V1
  [root@oda1 ~]# oakcli show env_hw

   BM ODA
  

   You can have more than one product under a single CSI, but the Key Generation is unique to each ODA box and based on the serial# .
    The Core count key generated is not interchangeable with other ODA boxes
    The CSI and associated serial number should be registered during purchase.

 

 

Solution

Rules and Restrictions for Changing the CPU Core Count (Bare Metal)

  • After you SET a CPU core count for the ODA, then you can only increase subsequent CPU core counts
  • You can change the CPU core count to 2,4,6,8,10 or 12 per server on V1 for a total of 24 cores (default)
  • You can change the CPU core count to 2,4,6,8,10,12 or 16** per server on X3-2 for a total of 32 cores (default)**
  • You can change the CPU core count to 2,4,6,8,10,12,14,16,18,20,22 or 24 per server on X4-2 for a total of 48 cores (default)*
  • You can change the CPU core count to increments of 2 from 2 up to 36 per server on X5-2 for a total of 72 Cores
  • Core Counts should be the same (matched count) on each server



      * If you are changing from Bare Metal to Virtualization on ODA you must remove the Core Key (see the associated patchset README for more details )
    **  If you are using an older ODA version X3-2 + 2.8 or older cpu counts are al 4 per server are required on the BARE METAL X3-2 due to a processor chip limitation. This was fixed in 2.9 and higher the X3-2 can update at increments of 2 CPUs per node.
            2.8 or lower: sets of 4 per server
            2.10 or higher: Does allow increments of two per server
    http://docs.oracle.com/cd/E22693_01/doc.12/e25375/chapter2.htm#CMTLI2261

    Each ODA consists of two servers ( for the ODA-HA series)
         X5-2,X4-2  and X3-2 number of Cores and can be incremented in sets of 2 per server up to the maximum of 72,48 and 32 respectively per ODA (both servers) **


For Example:

If you change the CPU core count to 6 per server (12 total), then you can subsequently increase the CPU core count to 8, 10, or 12...etc

If you later change the CPU core count to 8, then you can subsequently increase the CPU core count to 10 or 12...etc
If your desired CPU core count is 12 per server (V1), then use the default configuration.
 You do not need to follow the procedure in "Changing the CPU Core Count" to set the CPU core count to 12 per server.
 Using the default configuration will allow you to later change the CPU core count to a number less than 12, if desired.
Two cores per server for X5-2, X4-2 or X3-2**
The virtualization option does not require or use a Core Key*

 

Note:  If you mistakenly followed the procedure to generate a Core Key or apply a core key higher than expected then contact Oracle Support immediately to fix the problem.

 


Steps: Example of Creating or Changing the ODA CPU Core Count including generating a Core Key


If you change the core count after the initial deployment, be aware that changing the core count causes both servers to restart. After the initial deployment, plan and carry out the core count change at a suitable time where the availability impact is minimized.

To change the CPU core count:

  1. Log in to the My Oracle Support at: https://myoraclesupport.com

    My Oracle Support Home Page
  2. Click the Settings tab and select Assets from the submenu.

    Click on More and Choose System on the Sub Menu
  3. Search for the serial number of the appliance in the asset list.  (If you cannot locate the serial number, then contact Oracle Support.)
    Search Assets

  4. Select the serial number of the appliance and click on "Core Configuration"in the Asset Details Screen

    Navigate to
  5. Select Manage Key... from the available actions.

    Manage Core Configuration Key
  6. In the Manage Cores Configuration Key dialog box, you can view the serial number of the appliance. If a key was previously generated, then you can view the current configuration. 
    1. In the Cores Per Server list, select the desired number of enabled CPU cores per server. The value you select will apply to both servers on the appliance. Initially, you can select 2, 4, 6, 8, 10, or 12.

      Subsequently, you can only select a number that is greater than the current number.

    2. Click Generate Key to generate the key.

    3. Click Copy Key to Clipboard to copy the key to the clipboard.

  7. Paste the key into an empty text file and save the file to a location on the Oracle Database Appliance.
  8. Log in to the first node of the servers on the Oracle Database Appliance as root.

    Note:
    • Customer should not attempt editing the generated key using any tools
    • Customer could move the key to the Appliance using scp in binary mode.
    • Open a Terminal session or xterm and Login as root
    • Execute the oakcli apply core_config_key command as root

  9. The command in this step will reboot the server to complete the reconfiguration.

    Run the following command:

    # /opt/oracle/oak/bin/oakcli apply core_config_key /key_file_location/core_key_filename
     
    Where key_file_location is the full path name of the text file that you created in Step 6.

    For example:

    # /opt/oracle/oak/bin/oakcli apply core_config_key /tmp/dis/core_key4


    Removed dmidecode and oakgen

  10. After the system restarts, Oracle Database Appliance will be reconfigured and both servers will be running with the specified CPU core count.

    # /opt/oracle/oak/bin/oakcli show core_config_key
    Host's serialnumber = 01234AB56C7
    Configured Cores = 20

    Note: The CPU’s in the Database Appliance are hyper threaded, so when verifying the number of CPU cores with the cpuinfo command, you will see two times (2X) the number of cores configured pre server. For example, In this note we configured 10 cores per server, for a total of 20 cores for the appliance, so the cpuinfo command will return the following:


# cat /proc/cpuinfo | grep -i processor
processor : 0
processor : 1
processor : 2
processor : 3
processor : 4
processor : 5
processor : 6
processor : 7
processor : 8
processor : 9
processor : 10
processor : 11
processor : 12
processor : 13
processor : 14
processor : 15
processor : 16
processor : 17
processor : 18
processor : 19
...
...    -- The maximum number of cores available is HW version dependent
...

 

WARNING! Changing your Core count per CPU has a few IMPORTANT rules
  • The Core Count is not registered when your ODA arrives: The default configuration is to use enable Cores

  • Register the ODA as an asset via MOS using your CSI
    - You must have ODA CSI admin privileges to generate a Core Key !!
    - If you plan on using ALL cores on the ODA you do not need to generate a Core Key.
    - You need to register your Core Count if you are not using all available cores.

  • Once in MOS you will need to confirm your product Serial Number
    - The HW version and Serial number should be registered and viewable to the CSI admin or their designated agents.
    - Except for the ODA V1, the ODA HA (X3-2.;Assets on MOS include:
       (1) System Identifier = One Serial number for the Servers and JBOD(s)
       (2) Two-Servers showing as assets ( each with their respective serial#
       (1) JBOD Asset serial number with an optional 2nd JBOD asset available if purchased.

  • NOTE: If you do not find the Asset Serial Number listed in MOS and cannot see the Core Key Generation ICON you may not have the proper privileges.
    The ODA ships X5-2, X4-2 and X3-2 servers in matched paired sets : Make sure you have the proper serial number - please check

  • Once registered using the MOS key generation tool to set your Core count per server: The MOS generated key will apply this same count to both servers
    - Once applied you cannot generate a lower number of Core

Keep in mind that ODA is an architected box:

ODA is not just Oracle 11.2.0.x EE installed on Server hardware that you can buy off the shelf.
There are very strict rules regarding configuration: Matching Core counts, consistent disk configuration and One-Command patching are qualities of ODA which are not optional.

If you have problems generating your Core Key and you have checked all of the above please
 check the ODA Community Forum
and then create a SR with Oracle Support Services

2254456.1 
2252677.1




FOR SUPPORT and SALES
----------------------------------
1. Customer Admin needs to add the Hardware CSI into the MOS Profile
and choose the correct Company name [ For Global Organization] and then Click - Request Access-

2. Under Accounts and Privileges: The CSI Status turns to - Pending Oracle Approval -

         [ The support SLA is from 2 hours to 24 hours]

    a. Support checks that the CSI admin user email id has the same domain as the Company.
       That means the Partners would not be able to generate the core key for their
       customers using their email id.
    b. It may be a good idea to call the Support Hotline and follow up on the status and advice

3. An email is sent to the Admin giving the details of the CSI Request and if it is Approved ?

4. If not logging out of the MOS , then remember to REFRESH the page 

5. Once the CSI shows the status as -Approved- you are ready to generate the Core key

 There has been a transition from MOS using FLASH vs. HTML. During the transition several  users experienced problems altering the CORE COUNT using HTML. This problem has been fixed so it is no longer a problem creating the CORE COUNT KEY using HTML. Please report any new Core Key Count generation problems using HTML to the ODA email list

Note:  ODAVP ( Virtualized ODA usage)

  For Virtualized environments you do not need to generate a Core key.
  Some Cores should be reserved exclusively for ODA_BASE
  You can choose the licensed number of cores during ODA_BASE deployment. i.e. Use the oakcli configure oda_base command from DOM0 to change the core count for database usage.
  You can use the CPU cores not assigned to Oracle Database (ODA_BASE) for virtual machines,
  It is currently required to _remove_ the core count when moving from ODA (BM) Bare Metal to ODAVP to avoid inadvertent CPU caps for subsequent CPU Core Count increases.*

  On ODAVP environments, Database licensing is controlled by the number of cores allocated during the ODA_BASE deployment
  This can be changed after the ODA deployment using oakcli configure ODA_BASE command

Please refer to the most current Documentation available at any of multiple locations including docs.oracle.com under Engineered Systems -> Oracle Database Appliance
  • About CPU Pools on Oracle Database Appliance Virtualized Platform
  • Managing CPU Pools on Oracle Database Appliance Virtualized Platform
  • Impact of failing over using the CPU pool on the secondary node
  • * Resizing ODA Base
http://docs.oracle.com/cd/E22693_01/doc.12/e55580/vmadmin.htm#CACBEGCD

 

 
  V1 V2 (X3-2) X4-2 X5-2
Number of Cores per CPU 6 8 12 18
Number of CPUs per Server 2 2 2 2
CPU Cores per Server 12 16 24 36
Total CPU Cores per ODA Appliance 24 32 48 72
Core Increment per Server - Bare Metal 2 2 (or 4 on ODA 2.8 and lower) 2 2
Core Increment per Server - ODAVP 2 2 2 2

Community Discussions

Still have questions? Use the communities window below to search for similar discussions or start a new discussion on this subject. (Window is the live community not a screenshot)

Click here to open in main browser window

References

<NOTE:1638577.1> - ODA Troubleshooting ODA Core Key Generation and Application Problems
<NOTE:2252677.1> - ODA X5-2 MOS Core Key GUI Not Able To Generate a Core Key Above 18 per server. MOS Pull-down Only Goes up to 18 vs. Up to 36
<NOTE:2254456.1> - ODA Oracle Database Appliance Manual Core Key Generation Request Procedure for X5-2, X4-2 X3-2 and V1
<NOTE:2220572.1> - ODA: X6-2 Capacity-On-Demand : How To Change & Register CPU Cores For Single-Node ODA Lite X6-2(S,M,L) or the Dual-Node ODA HA X6-2

Attachments
This solution has no attachment
  Copyright © 2018 Oracle, Inc.  All rights reserved.
 Feedback