EIS Installation Checklist “No Pre-Installed OS Image”

Supplement for the

Exadata Database Machine X6-2 & X6-8

Customer:

TASK Number:

Technician:

Date:

• This checklist contains references to the “original” Exadata-X6 installation

checklist (Vn 1.1).
• It is not intended that this checklist be handed over to the customer.
• Feedback is welcome – refer to the last page of this document.

The following additional EIS Installation Checklists will be required:

• EIS Installation Checklist for the ORACLE® Exadata Database Machine X6-2 &
X6-8 – referred to as the “Exadata Checklist” in the document.
• EIS Installation Checklist Supplement for the ORACLE® Exadata Database
Machine X6-2 & X6-8 (With Extensions for Remote ACS Install Engagements) –
referred to as the “Exadata 1Eng Supplement” in this document.

The following additional EIS Installation Checklist may also be required:

• Oracle Advanced Support Gateway (OASG) Server

An Exadata that has been ordered and shipped without a pre-installed OS image will
be in the following state:
• The switches will be normal, firmware bootable and configurable at defaults.
• The servers will have no bootable OS on the disks. ILOM will be bootable and
configurable.

Oracle Internal and Approved Partners Only Page 1 of 8 Vn 1.1 Created: 22 Jul 2016
 ENGINEERED SYSTEMS ENTERPRISE SUPPORT TEAM EEST
If a Field Support Engineer (FSE) requires assistance while installing an Engineered
System, a streamlined method of engaging an Engineered Systems Enterprise
Support Team (EEST) engineer when the SR owner is not available is described
below.
The SR referred to is the installation SR.
An FSE would use this option if they are onsite and require immediate assistance
from EEST. This process is specifically for FSE Callbacks for hardware,
installation and Field Change Order (FCOs) support and should NOT be used by
ACS or partners.
The complete process is described in this Oracle-internal link under the Tasks tab.
Ensure that you understand the contents before going onsite.

Task Comment Check

PREPARATION (PRIOR TO GOING ONSITE)

Follow the instructions in the Exadata Checklist (pages 4 – 5) which will
also lead you to the instructions in the Exadata 1Eng Supplement (pages 2 –
4).
Use of a laptop or similar system is essential for carrying out the activities in
this checklist.
DOWNLOAD THE PXE VM
To download the PXE VirtualBox VM from My Oracle Support (MOS):
1. Go to https://support.oracle.com/ & sign in,
2. Click on the Patches & Updates tab (on the top),
3. In the Patch Search box on the right side, ensure that Number/Name or
Bug Number (Simple) is selected – should be default,
4. To the right of Patch Name of Number enter 21518839,
5. Click Search.
6. A new screen will appear with the Patch Search Results. Click on the
Patch Name for the most recent release in the list (currently 12.1.2.3.1).
Download and save the README file.
Download the three files for Linux, currently (names may change):
• p21518839_121231_Linux-x86-64_1of3.zip (3.4 GB)
• p21518839_121231_Linux-x86-64_2of3.zip (3.4 GB)
• p21518839_121231_Linux-x86-64_3of3.zip (2.3 GB)
The FSE should download and unzip the above files into the same directory
which they created to only have these 3 files in it. Follow the README
instructions to concatenate the unzipped files. Validate the MD5 checksums
to ensure you have a good resulting file.

Oracle Internal and Approved Partners Only Page 2 of 8 Vn 1.1 Created: 22 Jul 2016
 Task Comment Check
OTHER DOWNLOADS / ACTIONS
If VirtualBox is installed already make sure it is a recent version 4.3.26 or
above, otherwise download the Oracle VirtualBox for your
laptop/workstation OS, from http://www.virtualbox.org – for a Windows
system the download size is about 100 MB.
Install the VirtualBox and start the application.
Import the Virtual Machine created above. Once the VM is up, ensure that
the networking is correct. The steps for this are also in the README.

Oracle Internal and Approved Partners Only Page 3 of 8 Vn 1.1 Created: 22 Jul 2016
 Task Check

ACTIONS COMMON TO EIS CHECKLIST FOR EXADATA X6

REFER TO EIS CHECKLIST FOR EXADATA X6-2 & X6-8 FOR:
Unpacking: page 12.
Initial Cabling: pages 13 – 14.
Configuring Cisco switch: pages 15 – 24.
Configuring IB Leaf switches: pages 25 – 30.
Configuring PDUs: pages 31 – 33.
Then continue below

Oracle Internal and Approved Partners Only Page 4 of 8 Vn 1.1 Created: 22 Jul 2016
 Task Comment DB Node
1 2 3 4

IMAGING ACTIVITIES: ORACLE DATABASE SERVERS 1 – 4

The Oracle Exadata Database Machine can have 3 different types of database server:
• X6-2 with 2 to 19 Oracle Server X6-2 database servers.
• X6-8 with 2 to 4 Oracle Server X5-8 database servers.
When connecting to the ILOM Serial Management port on the Database Nodes with
SW ≥12.1.2.1.1 the baud rate setting on the servers is 9600,8,N,1.
For customers planning to use OVS, do most of the checklist below as Linux and
then convert the DB nodes to OVS later by ACS or as part of the 1-Eng process.
The first DB node will be in RU 16 working upwards. For “Base Config” racks
only DB Nodes 1 & 2 are present (this section of the checklist is laid out for up to 4
DB nodes). For additional DB Nodes use the additional “swim-lanes” on page 6 of
this checklist.
If any of the profile checks fail and any firmware needs to be reflashed, then contact
the Exadata Enterprise Support Team (EEST) to open a collaboration SR to TSC
x86 task from the Install SR. Follow the process described on page 2 of this
checklist.
Connect the laptop to the Cisco switch with the pre.installed cable on the
Cisco switch.
Follow the PXE Imaging VM README instruction details to:
• prepare the configuration files with the node mac addresses,
• prepare the PXE imaging files needed for this rack.
Power on all servers in the rack (Power button on front panel).
For each DB server in turn: Refer to the table of factory default settings
in the Exadata Checklist pages 8-9.
Use a laptop connected to the
Cisco switch on 192.168.1.x to
SSH to the DByy ILOM.
Once the ILOM has booted -> set /HOST boot_device=pxe
successfully log into the ILOM
and set the host to PXE boot:
Reset the system: -> reset /SYS
The system will start PXE booting from the
laptop VM and start imaging.
Open the graphics console: Click on the "Launch" button next to
"Remote Console" on the Summary front
page of ILOM, or select "Use video
redirection" option and the "Launch
Remote Console" button from the ILOM
"Remote Control -> Redirection" menu
option in the ILOM web GUI.
Watch the server boot from the
network and image.

Oracle Internal and Approved Partners Only Page 5 of 8 Vn 1.1 Created: 22 Jul 2016
 Task Comment DB Node
1 2 3 4
Once imaging is complete, login to The system should be waiting at the Linux
the host (example for DB01 X6-2 login prompt.
Node): Example:
node2.my.company.com login:
user=root
pwd=welcome1
You may have to press Enter to wake up the
system first.
Initiate the elastic configuration # touch /.elasticConfig
# reboot
and reboot the server.
During the reboot the server
should go through the elastic
configuration process and end with
a "nodeXX" login prompt as if it
was factory pre-installed.
ONCE RE-IMAGING IS COMPLETED
Continue with the instructions in the Exadata Checklist as of page 34
(Initial Activities: Oracle Database Servers).

Check Swim Lanes for DB Nodes 5 - 19

DB Node
Action (from above) 1 1 1 1 1 1 1 1 1 1
5 6 7 8 9 0 1 2 3 4 5 6 7 8 9
Connect from Laptop to DB Node ILOM n.
Set host to PXE boot.
Reset the system.
Open graphics console & watch server boot.
Once imaging is complete, login to DB Node n.
Initiate the elastic configuration and reboot the
server.
Continue with the instructions in the Exadata
Checklist as of page 34.

Oracle Internal and Approved Partners Only Page 6 of 8 Vn 1.1 Created: 22 Jul 2016
 Task Comment Cell
1 2 3

INITIAL ACTIVITIES: EXADATA STORAGE CELLS 1 – 3

The Oracle Server X6-2L systems are referred to as "Exadata Storage Cells":
• HC = High Capacity (physical disk media)
• EF = Extreme Flash (uses only flash “disk” media, either 8 or 12 “disks”)
When connecting to the ILOM Serial Management port on the Database
Nodes with SW ≥12.1.2.1.1 the baud rate setting on the servers is
9600,8,N,1.
Storage cell numbering starts with 1 at the rack bottom working upwards.
For “Base Config” racks only storage cells 1 – 3 are present for which this
section of the checklist is laid out. For additional storage cells use the
additional “swim-lanes” on page 8 of this checklist.
If any of the profile checks fail and any firmware needs to be reflashed, then
contact the Engineered Systems Enterprise Support Team (EEST) to open a
collaboration SR to TSC x86 task from the Install SR. Follow the process
described on page 2 of this checklist.
The storage servers will have been powered on on page 5.
For each Storage Cell in turn: Refer to the table of factory default
settings in the Exadata Checklist pages 8-
Use a laptop connected to the Cisco 9.
switch on 192.168.1.x to SSH to the
CELLyy ILOM.
Once the ILOM has booted successfully -> set /HOST boot_device=pxe
log into the ILOM and set the host to
PXE boot:
Reset the system: -> reset /SYS
The system will start PXE booting from
the laptop VM and start imaging.
Open the graphics console: Click on the "Launch" button next to
"Remote Console" on the Summary front
page of ILOM, or select "Use video
redirection" option and the "Launch
Remote Console" button from the ILOM
"Remote Control -> Redirection" menu
option in the ILOM web GUI.
Watch the server boot from the network
and image.
Once imaging is complete, login to the The system should be waiting at the Linux
host (example for DB01 X6-2 Node): login prompt.
Example:
node2.my.company.com login:
user=root
pwd=welcome1
You may have to press Enter to wake up
the system first.

Oracle Internal and Approved Partners Only Page 7 of 8 Vn 1.1 Created: 22 Jul 2016
 Task Comment Cell
1 2 3
Initiate the elastic configuration and # touch /.elasticConfig
# reboot
reboot the server.
During the reboot the server should go
through the elastic configuration
process and end with a "nodeXX" login
prompt as if it was factory pre-installed.
ONCE RE-IMAGING IS COMPLETED
Continue with the instructions in the Exadata Checklist as of page 40 (Initial
Activities: Exadata Storage Cells).

Additional "Swim Lanes" for Storage Cells 4 - 18

Storage Cell
Action (from above) 1 1 1 1 1 1 1 1 1
4 5 6 7 8 9 0 1 2 3 4 5 6 7 8
Connect from Laptop to Storage Cell ILOM n.
Set host to PXE boot.
Reset the system.
Open graphics console & watch server boot.
Once imaging is complete, login to Storage Cell
n.
Initiate the elastic configuration and reboot the
server.
Continue with the instructions in the Exadata
Checklist as of page 40.

Copies of the checklists are available on the EIS web pages or on the EIS-DVD. We recommend that
you always check the web pages for the latest version.

Comments & RFEs welcome. Oracle staff should mail to EIS-SUPPORT_WW_GRP@oracle.com .

Partners should mail to: SUPPORT-PARTNER-QUESTIONS_WW_GRP@oracle.com .

Oracle Internal and Approved Partners Only Page 8 of 8 Vn 1.1 Created: 22 Jul 2016