How to Perform Exalogic Preventive Maintenance Service

Asset ID:	1-71-1502179.1
Update Date:	2017-08-22
Keywords:

Solution Type Technical Instruction Sure

Solution 1502179.1 : How to Perform Exalogic Preventive Maintenance Service

Applies to:

Oracle Exalogic Elastic Cloud X2-2 One-Eighth Rack - Version X2 to X2 [Release X2]
Exalogic Elastic Cloud X4-2 Hardware - Version X4 to X4 [Release X4]
Exalogic Elastic Cloud X3-2 Half Rack - Version X3 to X3 [Release X3]
Oracle Exalogic Elastic Cloud X2-2 Half Rack - Version X2 to X2 [Release X2]
Oracle Exalogic Elastic Cloud X2-2 Qtr Rack - Version X2 to X2 [Release X2]
Information in this document applies to any platform.

Goal

Canned Action Plan to Perform Exalogic Preventive Maintenance Service

Solution

DISPATCH INSTRUCTIONS:

Follow normal Dispatch process. However, since this is relating to a Preventive Maintenance activity, do not close this task until you get confirmation from the SR owner
or from a Field Engineer that the activity is completed (successfully). (i.e., under no circumstances should Dispatch close or cancel this task due to unresponsiveness from the customer. Thank you).

WHAT SKILLS DOES THE ENGINEER NEED:

- Exalogic trained

- TIME ESTIMATE: 720 Minutes

- TASK COMPLEXITY: 3

Time Estimate above is total including both initial on-site visit and any subsequent visits for parts replacements.

FIELD ENGINEER INSTRUCTIONS:

- PROBLEM OVERVIEW: Preventative Maintenance

The Engineered Systems Preventative Maintenance (PM) process consists of a mandatory initial Pre-PM activity (for visual inspection and for determining parts needed, etc)

as well as at least one onsite task for the actual PM activity (parts replacements at a later date).

This CAP details the PM task created by an Oracle Support engineer for standard PM tasks/activities.

Please note that the PM Process was recently updated (July 2016). Therefore, refer to the PM Desk Manual http://deskmanual.oraclecorp.com/html/PRSRM050.htm?version=1#tasks

if you need clarification of the overall PM process especially as it relates to responsibilities of Field Engineers.

If you are assigned this task, you may assume Oracle has already communicated the need for Preventative Maintenance to take place on this Engineered System, to the primary customer contact specified on the Service Request.

You may also assume that the customer has given their agreement for us to carry out the Preventative Maintenance service.

Important note: This CAP is used for both the initial Pre-PM activity, as well as the actual PM activity.

So depending on the situation, the FSE needs to refer to either the first Action Plan section titled "Pre-PM Activity" (visual inspection, etc) or to the second Action Plan section titled "PM Activity" (for PM parts replacement visits).

Also for clarification (snipet from PM Desk Manual), the Field Engineer is responsible for:

Undertaking a Pre-PM visit (first mandatory task)
Performing and clearly documenting the outcome of the Pre-PM activity (via the Pre-PM template)
Establishing all part numbers and all part quantities, required to fully implement the PM activity on the designated system.
Where possible, obtaining the customer’s initial preferred date/time for the PM activity.
Providing Dispatch with details of all required parts, and (where known) customer preferred date/time for PM activity.
If Domain Engineer analysis of a healthcheck bundle found additional faults that must be rectified prior to completion of PM activity (if required, an additional, third task would be created and assigned)
Performing the actual PM activity (second mandatory task)
Providing confirmation that the PM activity has been completed successfully, to the Customer and Domain Engineer.

- WHAT STATE SHOULD THE SYSTEM BE IN TO BE READY TO PERFORM THE RESOLUTION ACTIVITY?

If the rolling method is used, then each node will need to be shut down one at a time. If the complete shutdown method is used, then the entire rack is shutdown – typically during a single maintenance window arranged by the customer.

PM Tasks for FSE:

Prior to going on-site

1. If unfamiliar with the PM process, refer to all related documentation and review the PM Desk Manual.

2. If needed, review the overview presentations and technical instructions attached below. (Exalogic PM Overview, PM Procedures, PM Customer Ready).

3. Contact the customer to confirm the preferred date/time for the on-site visit. Follow Field "Customer Call Process".

Refer to the Field Service Engineer Desk Manual: https://stbeehive.oracle.com/content/dav/st/GDMI/Public/FIELD_SERVICE_ENGINEER.htm

Pre-PM Activity [Action Plan for Initial PM Onsite Visit - for Visual Inspection and Determining Parts Required]

1. Visually inspect all components in the Engineered System rack that is scheduled for PM.

2. Check specifically for any broken Cable Management Arms (CMAs) or cables. Make a note of quantity and type of CMA if any need to be replaced.

3. Establish customer’s preferred maintenance method (rolling or with down time). Note that with a rolling PM Service review Oracle knowledge Doc Id 1356432.1 to understand the implications.

Note, the next steps are taken directly from the PM Desk Manual:

4. Obtain and upload healthcheck bundle for entire ES rack, if possible.

5. Establish all part number(s) and all part quantity/quantities, required to complete PM on the specified ES (physical rack).

6. Discuss, and if possible obtain, customer’s initial preferred date/time for the PM activity.

7. Do not yet commit to the customer’s preferred date/time – explain parts availability and ETA must be confirmed by Dispatch.

8. Be aware that in some (exceptional) situations, delivery of standalone Lithium Ion batteries may take longer than expected.
    In particular, if (despite material steps by Logistics Planning to pre-position stock) insufficient batteries are available
    in-country to support PM activity for this customer, parts may need to be moved from the regional warehouse, via surface
    transportation.

9. Maximum battery lead-times, by location, are shown in supporting document:
    Lithium Ion Battery Surface Transportation Lookup Table
    This information may help the customer decide on a realistic preferred date/time for the PM activity (maintenance window
    should not be sooner than parts can be delivered). Do not share the document with the Customer.

10. Complete all sections of the Pre-PM visit Template contained within this action plan.

Here is the Template:

----- TEMPLATE BEGIN -----
Account Name:
Rack SN:
Product (e.g., Exalogic):
SR #:
FE that performed the Pre-PM activity:
FE email address:
Should this same FE be assigned to the actual PM Task? [Yes, or TBD]
Date when customer has agreed to begin the PM Service:

If HBA Batteries are due to be replaced during this scheduled PM:
• Quantity of Batteries needed:
• Part number of Batteries:
Other HW issues observed? [Yes, No]
If yes, list part descriptions, quantities, and part numbers.
----- TEMPLATE END -----

12. Add completed template to the task as an internal “Action Required” note.

Note, performing “Action Required” will close out your Task, so make sure you update it as necessary before using Action Required.

Also note that this will change the sub-status of the SR to “Review Task”. This sub-status change will alert the SR owner of your update, which is important.

13A. For reference, Dispatch is now ordering parts; FSEs are no longer doing this.

13B. Contact Dispatch and

State that you are calling to provide important details from an onsite Pre-PM inspection visit, to allow planning of Engineered Systems Preventative Maintenance (ES-PM) activity.
State all part number(s) and all part quantity/quantities required for the PM activity.
State clearly if standalone Lithium Ion batteries are required.
State customer’s preferred date/time for PM activity (explain that this date/time has not been committed to the customer).
State expected duration of the onsite PM activity (will be used by Dispatch to set duration of PM task).

PM Activity [Action Plan for PM Parts replacements]

Note: the specific procedures and commands from the PM Process document that require the customer to complete should be shared with the customer for the sole purpose of completing the PM process. The PM Process document as a whole however, should not be left with the customer.

This document is located in the "Attachments" section of the document. Please use attachment PM_PROCEDURES_V20 to see how to perform the full preventive maintenance procedure on Exalogic .

1. If your customer’s ES is ASR-enabled, ensure that the customer’s system is properly configured for ASR. While on-site, check for any ASR misconfiguration issues and work with the customer and attempt to correct them. Refer to Oracle knowledge Doc ID 1450112.1 for details. Carefully document any aspects of ASR misconfiguration that you find in your debrief notes, including whether you were able to correct these or not.

2. If systems have ASR enabled, make sure ASR is disabled during PM activities, so that ASR SRs are not generated unintentionally.

3. With the customer’s assistance, prepare the system(s) for the PM activity.

4. Replace all faulty components.

5. Ensure that all nodes and components come back on-line and are healthy.

6. If this PM was a Rolling Method, please ensure that this Task remains open or that a Copy Task is created for additional work.

7. When all PM activities are complete, alert the SR owner that the PM activity was successful and that it is 100% completed - this is important for tracking purposes.

8. When using Debrief notes, please clearly state that the PM was completed successfully (or not).

9. Create a task note, and select “Action Required”. Insert a note like this:

“PM Task/Visit was completed successfully and SR can be closed”.

Note, performing “Action Required” will close out your Task, so make sure you update it as necessary before using Action Required.

Also note that this will change the sub-status of the SR to “Review Task”. This sub-status change will alert the SR owner of your update, which is important.

REFERENCE INFORMATION:

Oracle knowledge Doc ID 1947296.1 (Gathering HW and ASR data on nodes within an ES Rack during Preventive Maintenance activity).

Oracle knowledge Doc ID 1449226.1 (Exachk Health-Check Tool for Exalogic).

Oracle knowledge Doc ID 1437353.1 (Exalogic Battery Check and Replacement Guidelines).

Oracle knowledge Doc ID 1347313.1 (How to Replace an X4170/X4270/X4275 SAS RAID HBA Battery).

References

<NOTE:1437353.1> - Exalogic Battery Check and Replacement Guidelines
<NOTE:1527626.1> - How to Replace a HBA Battery Backup Unit (BBU) on Exadata Database Machine (V2, X2-2, X2-8) [VCAP]
<NOTE:1449226.1> - Exachk Health-Check Tool for Exalogic

Attachments

This solution has no attachment