Академический Документы
Профессиональный Документы
Культура Документы
Maintenance Manual
Abstract
This manual is for authorized service personnel who are responsible for the maintenance of the HP 3PAR Storage System and
its service processor. Use this manual to perform removal and replacement procedures on the storage system components when
online guided maintenance is not available.
Contents
Introduction..................................................................................................5
Related Documentation..............................................................................................................5
A Precautions..............................................................................................87
General Precautions................................................................................................................87
Disk and Drive Magazine Precautions.......................................................................................87
Controller Node Precaution......................................................................................................88
Clock Battery Precaution..........................................................................................................88
Drive Chassis and Node Power Supply Precaution......................................................................88
Battery Module Precautions......................................................................................................88
Power Distribution Unit Precautions............................................................................................88
AC Cord Precaution................................................................................................................88
B Tools.......................................................................................................89
Tools Required to Perform Maintenance.....................................................................................89
C Guided Maintenance...............................................................................90
Overview..............................................................................................................................90
Accessing Guided Maintenance...............................................................................................90
Contents
Introduction
Use this manual to perform removal and replacement procedures on the HP P10000 3PAR Storage
System. The maintenance procedures described here should only be used in instances where online
guided maintenance is not available for the hardware that requires servicing. See Guided
Maintenance for a list of Field Replaceable Units (FRUs) with available guided maintenance. To
access guided maintenance via SPOCC, refer to Connecting to the Maintenance PC.
Before beginning the procedures in this manual, you must read the Appendices at the end of the
manual and connect your maintenance PC to the node or Service Processor (SP). After connecting
the storage system to the maintenance PC, you can then perform the procedures listed in this
manual. This manual also references storage system component LED indicators.
NOTE: The InServ Storage Server has been rebranded as HP 3PAR Storage System. There are
instances in this document where menu items and command output refer to the HP 3PAR Storage
System as InServ or InServ Storage Server.
Related Documentation
The following related documents also provide information related to the HP 3PAR Storage Systems
and the InForm OS environment:
Table 1 Related Documentation
For Information About
Read the
Using the InForm Management Consoles (IMC) user interface HP 3PAR InForm Management Console Online Help
to configure and manage the HP 3PAR Storage System
Identifying storage system components, detailed alert
information, and service messages
Related Documentation
For a failed disk, issue servicemag start -log -pdid <disk_id> command,
where <disk_id> is the ID of the failed disk.
1204]
1205]
1206]
1207]
diskpos
diskpos
diskpos
diskpos
[0]
[1]
[2]
[3]
background.
For a failed drive magazine, issue servicemag start -log -nodisks <cage_id>
<mag_id>.
NOTE:
The servicemag start command moves all the required, used chunklets on the
magazine. This is executed simultaneously for each hard drive and takes approximately 20
seconds for each used chunklet.
...
valid disks: WWN [5000C50002841761] Id [56] diskpos
....................
WWN [5000C500028486F2] Id [57] diskpos
....................
WWN [5000C5000284173F] Id [58] diskpos
....................
WWN [5000C50002841675] Id [59] diskpos
...
not valid disks:
The servicemag start operation will continue in the background.
5.
[0]
[1]
[2]
[3]
To monitor progress, issue the servicemag and identify the drive magazine containing the
pdid to be replaced.
When the command completes successfully, Succeeded displays, the hot-plug LED illuminates
and the drive magazine status LEDs blink slowly (DC4 Drive Magazine LEDs (page 8)).
Figure 1 DC4 Drive Magazine LEDs
6.
Issue the locatecage cage <ID> command to turn on all LEDs for a short duration (DC4
Drive Magazine Locations in the Drive Cage (page 8)) to locate the drive caged to be
replaced.
Figure 2 DC4 Drive Magazine Locations in the Drive Cage
7.
Wearing a wrist- grounding strap, use a #2 Phillips screwdriver to loosen the captive screw
that secures the drive magazine to the chassis (Loosening the Captive Screw on the Drive
Magazine (page 9)).
8.
9.
With your right hand on the handle of the drive magazine and your left hand supporting the
drive magazine from beneath, slide the magazine out of the chassis and place it on an
ESD-safe, level work surface with the solid back panel facing down.
To remove a drive magazine:
a. Remove the replacement magazine from its protective packaging and set aside any
electrostatic preventative packing material protecting the magazine. It will be used to
package the replaced drive magazine.
b. Place the replacement magazine on the ESD-safe work surface next to the failed magazine.
c. Perform step 11 through step 13 for each disk.
10. To replace a failed disk, identify the disk requiring replacement. The disk status LEDs numbered
on the front of the drive magazine corresponds to the disks mounted on the drive magazine.
The numbers are also indicated along the side of the drive magazine (Numbering of Disks
on a DC4 Magazine (page 10)).
11. Use a #2 Phillips screwdriver to remove the screws from the drive mount on a DC4 drive
magazine (Figure 5 (page 10)).
For DC4 drive magazines, unscrew and remove each screw securing the disk drives.
10
12. Slide it out of the magazine (Sliding a Disk Out of the Magazine (page 11)). Avoid touching
the exposed underside of the disk.
Figure 6 Sliding a Disk Out of the Magazine
13. Remove the replacement disk from its protective packaging and avoid touching the exposed
underside of the replacement disk.
14. Replace the disk into the new drive magazine:
a. Carefully insert the replacement disk into the same opening in the drive magazine.
b. Slide the disk down until the screw holes align with the screw holes in the drive mount.
At this point, the drive should be seated in its connector and the top of the disk should
be near flush with the top of the drive magazine and should lay flat within the magazine.
c. Secure the disk to the drive mount with the screws. Do not overtighten the screws.
15. Remove all disks from the failed drive magazine and transfer them to the replacement drive
magazine.
11
CAUTION: The drive magazines should slide in-and-out easily. If a magazine does not
insert smoothly, do not force it. Confirm whether the magazine is properly aligned with
the guide notch at the top of the chassis housing and apply moderate pressure toward
the left side of the magazine while inserting. If you have difficulty inserting magazines
into the chassis that also have magazine filler panels installed, it may be necessary to
remove the adjacent filler panel to insert the magazine more easily.
b.
c.
When the drive magazine slides to a stop, quickly lift the ejector handle up to engage
the magazine into the drive chassis midplane.
Secure the magazine to the chassis by tightening the captive screw at the front of the
magazine. Do not overtighten the screw.
NOTE: After inserting the magazine into the chassis, allow approximately one minute
for the disks on the magazine to spin up before checking the magazine LEDs. If any disks
in the drive magazine fail to spin up, reseat the drive magazine and be sure to close the
ejector handle quickly.
17. Place the removed disk or disk magazine in the protective packaging for return to HP.
18. Verify all disk status LEDs on the drive magazine appear steady green and the hot-plug LED
is not illuminated.
19. In the SP window, issue the showpd command and verify that the removed disk is listed as
failed and the replacement disk is listed as new.
NOTE:
The new disk appears at the top of the disk list in the showpd command output.
20. Issue the servicemag resume <cage_id> <mag_id> where <cage_id> is the drive
cage number and <mag_id> is the location of the drive magazine in the drive chassis.
cli% servicemag resume 0 3
Are you sure you want to run servicemag?
select q=quit y=yes n=no: y
servicemag resume 0 3
... mag 0 3 already onlooped
... firmware is current on pd WWN [20000024B6284FE8] Id [933]
12
The servicemag resume process may take several hours or more to complete, depending on
the number of chunklets to be relocated. Once servicemag status shows chunklets have begun
relocating from spare space, issue the servicemag status command (the -d is optional for
additional detailed information) to monitor the servicemag completion.
21. Issue the servicemag status -d <cage_id> <mag_id> command.
cli% servicemag status -d
Cage 0, magazine 3:
The magazine is being brought online due to a servicemag resume.
The last status update was at Thu Feb 11 11:09:21 2011.
Unable to provide a relocation estimate
The cumulative output so far is:
servicemag resume 0 3
... mag 0 3 already onlooped
... firmware is current on pd WWN [20000024B6284FE8] Id [933]
... firmware is current on pd WWN [2000001D38B11AC7] Id [1204]
... firmware is current on pd WWN [2000001D38B114FE] Id [1205]
... firmware is current on pd WWN [2000001D38B119AB] Id [1207]
... firmware is current on pd WWN [2000001D38B11277] Id [1206]
... checking for valid disks...
...
disks in mag : 0 3
...
normal disks: WWN [20000024B6284FE8] Id [933] diskpos [2]
....................
WWN [2000001D38B11AC7] Id [1204] diskpos [0]
....................
WWN [2000001D38B114FE] Id [1205] diskpos [1]
....................
WWN [2000001D38B119AB] Id [1207] diskpos [3]
... not normal disks: WWN [2000001D38B11277] Id [1206]
... verifying spare space for disks 1204 and 1204
... verifying spare space for disks 1205 and 1205
... verifying spare space for disks 1207 and 1207
... playback chunklets from pd WWN [20000024B6284FE8] Id [933]
... playback chunklets from pd WWN [2000001D38B11AC7] Id [1204]
... playback chunklets from pd WWN [2000001D38B114FE] Id [1205]
... playback chunklets from pd WWN [2000001D38B119AB] Id [1207]
... 170 chunklets still waiting to be played back or relocating...
... All chunklets played back / relocated.
... relocating chunklets from raid set to new disk
... relocating chunklets from spare space
13
Issue the dismisspd <PD_ID>command to remove the replaced disk, where <PD_ID>
is the ID of the replaced physical disk.
Issue the showpd <PD_ID> command and verify if the replaced disk is removed.
23. Issue the checkhealth -svc -detail command to verify the system is healthy.
24. In the SP window, issue the exit command and select X to exit from the 3PAR Service Processor
Menu and to log out of the session.
25. Disconnect the serial cable from the maintenance PC or the red cross-over Ethernet cable from
the laptop and coil and replace the cable behind the SP.
26. Close and lock the rear door.
Planning
Preparation prior to completing the physical replacement procedure can take between:
The table below shows examples of the time allotment needed for running the CLI command
servicemag on disks or drive magazines at or near capacity and estimate times for migrating data.
Drive Magazine Size
50GB
1 Hour or less
300GB
6 Hours
500GB or larger
10-12 Hours
Logging Mode
For slower or large disks and when replacing a drive magazine, use the -log option with the CLI
servicemag command.
Conditions for using logging mode:
Conditions when logging mode is not recommended and should not be used:
servicemag start -log -pdid <pd_id> . Use the -pdid option in conjunction to
specify the disk to be replaced. This ensures the data vacates from the disk to be replaced.
1.
2.
3.
Connect the maintenance PC to the SP using the serial connection and start an spmaint
session.
In the 3PAR Service Processor Menu, select option 7 Interactive CLI for an InServ, then select
the desired system.
Issue the servicecage startfc <x> <cage> command, where <x> is the SFP module
to be replaced and <cage> is the name of the drive cage to be serviced.
4.
5.
To locate the drive cage, issue the locatecage t 15 <cage> command to turn on all
LEDs for a short duration, where 15 is the number of seconds the LEDs are illuminated and
<cage> is the cage number.
Issue the showcage d <cage> command, where <cage>is the cage name and verify
that the FC-AL hot-plug LED is Amber.
cli% showcage -d cage4
Id Name LoopA Pos.A LoopB Pos.B Drives Temp RevA RevB Model Side
4 cage4 2:2:1
0 3:2:1
0
8 30-38 2.37 2.37 DC4
n/a
-----------Cage detail info for cage4 --------Position: --Fibre Channel Info PortA0 PortB0 PortA1 PortB1
Link_Speed 4Gbps
--- 4Gbps
----------------------------------SFP Info----------------------------------FCAL SFP -State- --Manufacturer-- MaxSpeed(Gbps) TXDisable TXFault RXLoss DDM
0
0 OK
FINISAR CORP.
4.1 No
No
No
Yes
1
1 OK
FINISAR CORP.
4.1 No
No
No
Yes
Interface Board Info
FCAL0
FCAL1
Link A RXLEDs
Green
Off
Link A TXLEDs
Green
Off
Link B RXLEDs
Off
Green
Link B TXLEDs
Off
Green
LED(Loop_Split)
Off
Off
LEDS(system,hotplug) Green,Off Green,Amber
6.
Verify that the FC-AL module hot-plug LED is amber and ready to service.
15
7.
8.
9.
10.
11.
12.
13.
14.
15.
Squeeze the tabs on the sides of the Fibre Channel cable and pull to disconnect from the SFP.
Wearing a wrist-grounding strap, lift the retaining clip of the defective SFP module and slide
the defective SFP module out of the SFP slot.
Remove the replacement SFP module from its protective packaging.
Place the removed SFP module into the protective packaging for return to HP.
Insert the replacement SFP module into the FC-AL until fully seated.
Lock the SFP retaining clip in place.
Reconnect the Fibre Channel cable.
Verify that the TX (Transmit) and RX (Receive) LEDs are illuminated.
Issue the servicecage endfc <x> <cagename> command, where <x>is the FC-AL
module and <cagename> is the name of the drive cage.
cli% servicecage endfc 1 cage4
16. Issue theshowpd command and verify that the port for the replaced SFP is now active and
the disks are on the loop.
cli% showpd
---Size(MB)---- ----Ports---Id CagePos Type RPM State
Total
0 0:4:0
FC
15 normal 279808
1 0:0:1
FC
15 normal 279808
2 0:0:2
FC
15 normal 279808
3 0:0:3
FC
15 normal 279808
4 0:1:0
FC
15 normal 279808
5 0:1:1
FC
15 normal 279808
6 0:1:2
FC
15 normal 279808
7 0:1:3
FC
15 normal 279808
16
Free
250112
262400
250112
262656
250112
262656
250368
262912
A
0:3:1*
0:3:1
0:3:1*
0:3:1
0:3:1*
0:3:1
0:3:1*
0:3:1
B
1:4:1
1:4:1*
1:4:1
1:4:1*
1:4:1
1:4:1*
1:4:1
1:4:1*
17. Issue the showcage d <cagename> command and verify that the SFP hot-plug LED is
Green.
cli% showcage -d cage1
Id Name LoopA Pos.A LoopB Pos.B Drives Temp RevA RevB Model Side
1 cage1 0:3:4
0 1:4:4
0
16 30-38 2.37 2.37 DC4
n/a
-----------Cage detail info for cage1 --------Position: --Fibre Channel Info PortA0 PortB0 PortA1 PortB1
Link_Speed 4Gbps
--- 4Gbps
----------------------------------SFP Info----------------------------------FCAL SFP -State- --Manufacturer-- MaxSpeed(Gbps) TXDisable TXFault RXLoss DDM
0
0 OK
FINISAR CORP.
4.2 No
No
No
Yes
1
1 OK
FINISAR CORP.
4.2 No
No
No
Yes
Interface Board Info
FCAL0
FCAL1
Link A RXLEDs
Green
Off
Link A TXLEDs
Green
Off
Link B RXLEDs
Off
Green
Link B TXLEDs
Off
Green
LED(Loop_Split)
Off
Off
LEDS(system,hotplug) Green,Off Green,Off
18. Issue the checkhealth -svc -detail command to verify the system is healthy.
19. In the SP window, issue the exit command and select X to exit from the 3PAR Service Processor
Menu and to log out of the session.
20. Disconnect the serial cable from the maintenance PC and coil and replace the cable behind
the SP.
21. Close and lock the rear door.
4.
Issue the showcage d <cagename> command, where <cagename>is the cage name and
verify the FC-AL hot-plug LED is Amber by checking the LED system,hotplug line:
cli% showcage -d cage1
Id Name LoopA Pos.A LoopB Pos.B Drives Temp RevA RevB Model Side
1 cage1 0:3:4
0 1:4:4
0
16 30-38 2.37 2.37 DC4
n/a
-----------Cage detail info for cage1 --------Position: --Fibre Channel Info PortA0 PortB0 PortA1 PortB1
Link_Speed 4Gbps
--- 4Gbps
----------------------------------SFP Info----------------------------------FCAL SFP -State- --Manufacturer-- MaxSpeed(Gbps) TXDisable TXFault RXLoss DDM
0
0 OK
FINISAR CORP.
4.2 No
No
No
Yes
1
1 OK
FINISAR CORP.
4.2 No
No
No
Yes
17
5.
6.
7.
Note the location of all Fibre Channel cables to be reconnected after FC-AL replacement. If
necessary, mark the cables that connect to the FC-AL before removing them. The drive-side
Fibre Channel cables are marked to simplify this task.
Squeeze the tabs on the sides of the Fibre Channel cables and pull to disconnect them from
the SFP.
Wearing a wrist-grounding strap, remove the FC-AL module:
a. Pull down the retaining clip of the SFP module (Figure 9 (page 18)).
Figure 9 SFP Module
b.
c.
18
Holding the retaining clip, slide the SFP module out of the defective FC-AL.
Use a #2 Phillips screwdriver to loosen the captive screw that secures the FC-AL (Figure 10
(page 19)).
d.
Pull the FC-AL handle down and slide the FC-AL module out of the drive chassis using the
handle on the side of the module.
8.
Remove the replacement FC-AL module from its protective packaging and electrostatic packing
material and set aside.
9. Place the removed FC-AL module into the protective packaging for return to HP.
10. Replace the FC-AL module:
a. Insert the replacement FC-AL module into the drive chassis and lift up the FC-AL handle
until fully seated.
CAUTION: Drive cage FC-AL modules should slide in and out smoothly. If an FC-AL
module does not easily insert, do not force it. Before continuing, confirm that the FC-AL
module is properly aligned with the card guides at the top and bottom of the drive chassis
housing.
b.
c.
d.
Tighten the screw that secures the FC-AL module to the drive chassis housing. Do not
overtighten the screw.
Insert the SFP module into the FC-AL until fully seated.
Lock the retaining clip in place.
19
13. Issue the showcage d <cagename> command, where <cage> is the name of the drive
cage where the FC-AL module is replaced and verify that the drive cage now includes the
correct firmware level shown below RevA and RevB.
cli% showcage -d cage1Id Name LoopA Pos.A LoopB Pos.B Drives Temp RevA RevB
Model Side
1 cage1 0:3:4
0 1:4:4
0
16 30-38 2.37 2.37 DC4
n/a
-----------Cage detail info for cage1 --------Position: --Fibre Channel Info PortA0 PortB0 PortA1 PortB1
Link_Speed 4Gbps
--- 4Gbps
----------------------------------SFP Info----------------------------------FCAL SFP -State- --Manufacturer-- MaxSpeed(Gbps) TXDisable TXFault RXLoss DDM
0
0 OK
FINISAR CORP.
4.2 No
No
No
Yes
1
1 OK
FINISAR CORP.
4.2 No
No
No
Yes
Interface Board Info
FCAL0
FCAL1
Link A RXLEDs
Green
Off
Link A TXLEDs
Green
Off
Link B RXLEDs
Off
Green
Link B TXLEDs
Off
Green
LED(Loop_Split)
Off
Off
LEDS(system,hotplug) Green,Off Green,Off
-----------Midplane Info----------Firmware_status
Old
Product_Rev
2.37
State
Normal Op
Loop_Split
0
VendorId,ProductId
3PARdata,DC4
Unique_ID 10620300000B6300
14. Issue the showpd command to verify that the port for the replaced FC-AL module is now active
and the disks are on the loop.
cli% showpd
Id
0
1
2
3
4
5
6
7
CagePos
0:0:0
0:0:1
0:0:2
0:0:3
0:1:0
0:1:1
0:1:2
0:1:3
----Size(MB)----- ----Ports---Total
Free A
B
279808 250112 0:3:1* 1:4:1
279808 262400 0:3:1 1:4:1*
279808 250112 0:3:1* 1:4:1
279808 262656 0:3:1 1:4:1*
279808 250112 0:3:1* 1:4:1
279808 262656 0:3:1 1:4:1*
279808 250368 0:3:1* 1:4:1
279808 262912 0:3:1 1:4:1*
15. Issue the checkhealth -svc -detail command to verify the system is healthy.
16. In the SP window, issue the exit command and select X to exit from the 3PAR Service Processor
Menu and to log out of the session.
17. Disconnect the serial cable from the maintenance PC and coil and replace the cable behind
the SP.
18. Close and lock the rear door.
3.
Issue the showport command and view the node:slot:port information to identify the location
of the cable to be replaced.
a. Issue the showcage command to identify the FC-AL module location.
cli% showcage
Id Name LoopA Pos.A LoopB Pos.B Drives Temp RevA RevB Model Side
0 cage0 0:3:1
0 1:4:1
0
16 29-35 2.37 2.37 DC4
n/a
1 cage1 0:3:4
0 1:4:4
0
16 27-36 2.37 2.37 DC4
n/a
b.
4.
5.
6.
7.
8.
9.
10.
To locate the drive cage, issue the locatecage cage <ID> command to turn on all
LEDs for a short duration.
Physically identify the cable and remove it from the node port.
Physically identify the cable and remove it from the cage port (FC-AL module).
Carefully remove the cable from the cabinet/rack.
Install and neatly dress the new cable along the same route.
Connect the cable at both ends.
Verify the appropriate LEDs on the controller node and cage ports illuminate.
Issue the showport command to view the ports state.
root@inoded1040:~# showport
N:S:P
Mode
State
0:3:1 initiator
ready
0:3:2 initiator
loss_sync
0:3:3 initiator
loss_sync
0:3:4 initiator
ready
0:9:1
peer
offline
11. Issue the checkhealth -svc -detail command to verify the system is healthy.
12. In the SP window, issue the exit command and select X to exit from the 3PAR Service Processor
Menu and to log out of the session.
13. Disconnect the serial cable from the maintenance PC and coil and replace the cable behind
the SP.
21
1.
2.
Note the location of all Fibre Channel cables to be reconnected after FC-AL replacement. If
necessary, mark the cables that connect to the FC-AL before removing them. The drive-side
Fibre Channel cables are marked to simplify this task.
Squeeze the tabs on the sides of the Fibre Channel cables and pull to disconnect them from
the SFP.
Use a #2 Phillips screwdriver to loosen the screws that secure the two FC-AL modules to the
drive cage, then slide the boards out slightly to disengage from the midplane.
Use a #2 Phillips screwdriver to loosen the captive screw that secures the drive magazine to
the chassis.
Pull each drive magazine out slightly to disengage from the drive cage.
Use a #1 Phillips screwdriver to remove the four screws and spacers that secure the assembly
to the drive chassis housing and grasp the midplane bracket at the middle to pull the assembly
out of the drive chassis (Removing the Midplane Assembly (page 22)).
3.
4.
5.
6.
7.
8.
22
Use a #1 Phillips screwdriver to remove the eight screws that attach the midplane to the
midplane assembly (Midplane Removal (page 23)).
11. Place the removed midplane into the container for return to HP.
12. Use a #1 Phillips screwdriver to attach the new midplane to the midplane assembly by securing
the eight screws previously removed.
13. Slide the replacement drive cage midplane assembly into the drive chassis until it is fully
seated.
14. Reinstall and tighten the screws that secure the drive cage midplane assembly to the drive
chassis housing. Do not overtighten the screws.
Replacing a Midplane Assembly
23
15. At the front of the system, slide each drive magazine back into the drive cage and tighten the
captive screw. Do not overtighten the screws.
16. Slide the two FC-AL cards back into the drive cage and tighten the screws securing them to
the drive cage. Do not overtighten the screws.
17. Reconnect the Fibre Channel cables to their respective FC-AL modules in the drive chassis.
18. Replace the drive chassis power supplies:
a. Slide the replacement power supply into the rear of the drive chassis until fully seated.
b. Use a #1 Phillips screwdriver to tighten the screws that secure the power supply to the
drive chassis housing. Do not overtighten the screws.
c. Reconnect the AC cord and fasten the strap around the cord and cord lock.
d. Set the power supply to the ON position and verify that the power supply LEDs are green.
19. Verify that all LEDs in the drive magazines and FC-AL modules appear green or flashing green
and the hot-plug LEDs on the drive magazines and drive cage FC-AL modules are not lit.
20. After completing the drive cage midplane replacement procedure, migrate data back onto
the system. See Migrating Data Back to the Drive Cage (page 25).
6.
CagePos
0:0:0
0:0:1
0:0:2
0:0:3
0:1:0
0:1:1
0:1:2
0:1:3
---Size(MB)---- -----------Ports----------Total
Free A
B
279808 250112 0:3:1* 1:4:1
279808 262400 0:3:1 1:4:1*
279808 250112 0:3:1* 1:4:1
279808 262656 0:3:1 1:4:1*
279808 250112 0:3:1* 1:4:1
279808 262656 0:3:1 1:4:1*
279808 250368 0:3:1* 1:4:1
279808 262912 0:3:1 1:4:1*
Issue the servicemag start <X Z> command, where X is the drive cage number and
Z is the location of the drive magazine in the drive chassis.
NOTE:
The servicemag start command moves all used chunklets on the magazine.
This is executed simultaneously for each disk drive and takes approximately 20 seconds for
each used chunklet.
24
servicemag start 0 1
... servicing disks in mag: 0 1
...
normal disks: WWN [5000C50002841761] Id [56] diskpos
....................
WWN [5000C500028486F2] Id [57] diskpos
....................
WWN [5000C5000284173F] Id [58] diskpos
....................
WWN [5000C50002841675] Id [59] diskpos
...
not normal disks:
The servicemag start operation will continue in the background.
7.
[0]
[1]
[2]
[3]
Issue the servicemag status -d <X Z> command to monitor progress, where X is the
drive cage number and Z is the location of the drive magazine from the previously issued
servicemag start command.
8.
Repeat step 6 for all drive magazines in the cage then continue to Replacing a Midplane
Assembly (page 21).
NOTE: Up to five servicemag -start commands may be running at once. Ensure one
is proceeding before starting the next.
When the command completes successfully, Succeeded displays, the hot-plug LED illuminates
and the drive magazine status LEDs blink slowly.
NOTE: Servicemag cannot bypass and set the hot-plug LED on the last drive magazine
because the system does not want to lose communication with the cage. Consequently, the
last ESI drive magazine will not have the hot-plug LED illuminated, but three of the four disks
should be spundown. If this is the case and all other servicemag operations in the cage are
successful, the midplane may be replaced.
NOTE: Allow two minutes for the disks on the magazine to spin up before checking the
magazine LEDs.
25
2.
Issue the showpd command and check that all drive magazines are in a valid state.
cli% showpd
---Size(MB)---- ----Ports---Id CagePos Type RPM State
Total
0 0:0:0
FC
15 degraded 279808
1 0:0:1
FC
15 normal
279808
2 0:0:2
FC
15 normal
279808
3 0:0:3
FC
15 normal
279808
3.
Free
250112
262400
250112
262656
A
0:3:1*
0:3:1
0:3:1*
0:3:1
B
1:4:1
1:4:1*
1:4:1
1:4:1*
Issue the servicemag resume <X Z> command, where X is the new drive cage number
and Z is the location of the drive magazine in the drive chassis.
The servicemag resume process can take several hours or more to complete, depending on
the number of chunklets to be relocated. Once servicemag status shows that chunklets are
being relocated from spare space, continue to start the next servicemag. Servicemag
completion may be monitored with the servicemag status command.
NOTE: Up to five servicemag -resume commands may be running at once. Ensure one
is proceeding before starting the next.
4.
Issue the servicemag status -d <X Z> command where X is the drive cage number
and Z is the location of the drive magazine from the previously issued servicemag start
command.
Repeat step 3 until all drive magazines in the cage have been restored then continue to the
next step.
Issue the showcage -d command and check all the ports and connections are in operable
condition.
cli% showcage -d cage0
Id Name LoopA Pos.A LoopB Pos.B Drives Temp RevA RevB Model Side
0 cage0 0:3:1
0 1:4:1
0
16 32-38 2.37 2.37 DC4
n/a
7.
When all servicemag -resume operations have successfully completed, the old cage name
should be removed from the systems memory. Enter servicecage remove <cage_name>
where cage_name is the old (missing) cage number (name) to remove the old cage name.
8. Issue the checkhealth -svc -detail command to verify the system is healthy.
9. In the SP window, issue the exit command and select X to exit from the 3PAR Service Processor
Menu and to log out of the session.
10. Disconnect the serial cable from the maintenance PC or the red cross-over Ethernet cable from
the laptop and coil and replace the cable behind the SP.
11. Close and lock the rear door.
27
2.
3.
In the 3PAR Service Processor Menu, select option 7 Interactive CLI for an InServ, then select
the desired system.
Issue the showcage d <cageID> command to verify the power supply LED and power
supply state.
cli% showcage -d cage0
-----LoopA----- -----LoopB----Id Name A0
A1
Pos B0
B1
Pos Drives Temp RevA RevB Model Side
0 cage0 0:0:1 1:0:1
0 2:0:1 3:0:1
0
1I though6 31-35 08
08
DC4
-----------Cage detail info for cage0 --------Position: -------------Midplane Info-----------VendorId,ProductId
3PARdata,DC4
Serial_Num OPS69907C0149F3
Node_WWN 20000050CC0149F3
TempSensor_State
OK
TempSensor_Value
39
OpsPanel_State
OK
Audible_Alarm_State
Muted
ID_Switch
1
Cage_State
OK
Interface Board Info
LoopA
LoopB
Firmware_status Current Current
Product_Rev
08
08
IFC_State
OK
OK
ESH_State
OK
OK
Master_CPU
Yes
No
Loop_Map
valid
valid
Link_Speed
4Gbps
4Gbps
Port0_State
OK
OK
Port1_State No_SFP No_SFP
Port2_State No_SFP No_SFP
Port3_State
OK
OK
Power Supply Info State Fan State AC
Model
ps0 Failed Med Speed Failed -ps1
OK Med Speed OK
--
4.
28
n/a
d.
Pull the handle to remove the power supply from the drive chassis.
Figure 14 Removing a Power Supply
5.
6.
7.
8.
Remove the replacement power supply from its protective packaging and verify that the power
supply is set to the OFF position.
Place the removed power supply into the protective packaging for return to HP.
Replace a power supply:
a. Slide the replacement power supply into the rear of the drive chassis until fully seated.
b. Use a #1 Phillips screwdriver to tighten the screws that secure the power supply to the
drive chassis housing. Do not overtighten the screws.
c. Reconnect the AC cord and fasten the strap around the cord and cord lock.
d. Set the power supply to the ON position and verify that the power supply LEDs are green.
In the SP window, issue the showcage d <cageID> command to verify the power status
of the drive cage power supply is OK.
29
Product_Rev
08
08
IFC_State
OK
OK
ESH_State
OK
OK
Master_CPU
Yes
No
Loop_Map
valid
valid
Link_Speed
4Gbps
4Gbps
Port0_State
OK
OK
Port1_State No_SFP No_SFP
Port2_State No_SFP No_SFP
Port3_State
OK
OK
Power Supply Info State Fan State AC Model
ps0
OK MedSpeed OK
-ps1
OK MedSpeed OK
--
9. Issue the checkhealth -svc -detail command to verify the system is healthy.
10. In the SP window, issue the exit command and select X to exit from the 3PAR Service Processor
Menu and to log out of the session.
11. Disconnect the serial cable from the maintenance PC and coil and replace the cable behind
the SP.
12. Close and lock the rear door.
30
Identify the fan to remove and verify that the service LED is blue.
Pull the node fan lever outward to disengage the node fan and gently pull the lever and node
fan out of the chassis (Figure 15 (page 31)).
Figure 15 Removing the Controller Node Fan
7.
8.
31
11. Issue the checkhealth -svc -detail command to verify the system is healthy.
12. In the SP window, issue the exit command and select X to exit from the 3PAR Service Processor
Menu and to log out of the session.
13. Place the removed fan into protective packaging for return to HP.
4.
-PSStateOK
OK
OK
OK
FanState
OK
OK
OK
OK
ACState
OK
OK
OK
OK
DCState
OK
OK
OK
OK
Issue the servicenode start -ps <psID> <nodeID> command to prepare the power
supply for service.
NOTE: The system will light the service LED blue when there is a failure, but the
servicenode start command confirms the correct component is being serviced.
5.
6.
32
Identify the power supply that requires replacement and verify that the service LED next to it
is blue, indicating the power supply is ready to be serviced.
Rotate the cable manager tray towards the nodes in order for the power supplies to be serviced.
7.
b.
c.
33
1
1
0 091392-00FLJ OK
1 091392-00FN0 OK
OK
OK
OK
OK
OK
OK
15. Issue the servicenode end <nodeID> command to end servicing mode.
16. Issue the checkhealth -svc -detail command to verify the system is healthy.
17. In the SP window, issue the exit command and select X to exit from the 3PAR Service Processor
Menu and to log out of the session.
18. Disconnect the serial cable from the maintenance PC and replace the cable behind the SP.
19. Close and lock the rear door.
4.
Issue the servicenode start -bat <nodeID> command to prepare the battery module
for service.
NOTE: The system will light the service LED blue when there is a failure, but the
servicenode start command confirms the correct component is being serviced.
5.
6.
7.
At the front of the system, identify the battery module that requires replacement and verify that
the service LED is blue.
Remove the bezel that covers the battery module to be replaced.
Loosen the captive screw in the center of the battery module.
Figure 18 Loosening the Battery Module Screw
8.
Grab the handle and pull the battery module out of the chassis. Removing the battery module
automatically turns off all LEDs.
CAUTION: The battery module weighs approximately 20 pounds. Use caution when removing
the module from the battery compartment.
NOTE: If you attempt to close the handle, but if the handle starts deforming (for example,
the top moves but the bottom does not), push in at the center of the battery module while gently
pushing the handle closed to overcome the resistance between the guide pins and the holes
in the battery module.
11. Tighten the captive screw that secures the battery module to the battery compartment. Do not
overtighten the screw.
12. Place the removed battery module into the protective packaging for return to HP.
CAUTION:
13. Issue the servicenode end <nodeID> command to end servicing mode.
14. Issue the showbattery command to verify that the battery module information is properly
set.
cli% showbattery
Node Serial -State- ChrgLvl(%) -ExpDate- Expired Testing
0 00000153 OK
100
05/03/2013 No
No
1 00000147 OK
100
05/03/2013 No
No
NOTE:
The serial number and expiration date is read by the system and automatically set.
15.
16.
17.
18.
4.
5.
Issue the servicenode start <nodeID> command to service the node. The node LEDs
will appear blue.
Type exit to end the CLI session and return to the 3PAR Service Processor Menu.
35
6.
Before disconnecting the cables from the front of the controller node, note the locations ot the
cables, or note or label them. The drive-side Fibre Channel cables are marked to simplify this
task.
7. Select option 4 InServ Product Maintenance.
8. Select option 6 Halt an InServ cluster/node, then select the desired system.
9. Select the desired node and confirm all prompts to halt the node.
10. Allow 2-3 minutes for the node to halt, then verify that the node status LED is flashing green
and the node service LED is blue indicating that the node has been halted.
11. Set the node power switch to the OFF position to turn off power on the node.
36
b.
c.
Pull the controller node insertion/removal lever out to disengage the node from the chassis
midplane.
Slide the node part way out of the chassis and hold the node by the bottom and top to
remove and carry (Figure 20 (page 37)) and place it on an ESD-safe work surface.
Figure 20 Removing the Controller Node from the Chassis
37
13. Remove the replacement controller node from its protective packaging and place it onto an
ESD-safe work surface next to the failed node.
14. Because the replacement node will not contain any node-disk (SSD), PCI adapters or memory,
the following must be performed:
a. One at a time, remove the node-disk and PCI adapters from the failed node and install
them in the same slots in the replacement node. See Replacing a Node Disk (page 40)
and Replacing a PCI Adapter (page 44).
NOTE: It may be necessary to remove some blank PCI slot covers from the replacement
node to install PCI adapters. Install these slot covers in the failed node for return to HP.
b.
Remove the top cover from both nodes and move the four control cache DIMMs and the
eight data cache DIMMs to the replacement node, see Replacing a Cache DIMM
(page 47). Reinstall the top covers on both nodes.
15. Properly install the blank disk into the failed node. Refer to Replacing a Node Disk (page 40)
for more information. If the disk in the failed node is questionable, replace the node disk and
perform node rescue on the blank disk in the replacement node to install necessary software.
When the node disk is being replaced, you must perform node rescue. See Performing Node
Rescue (page 93).
16. Properly secure the parts and cover on the failed controller node then place it into the protective
packaging for return to HP.
WARNING! Make sure the node power switch is set to the OFF position before inserting
the node into the node chassis.
38
b.
Push the insertion levers in quickly until the node is seated securely.
Figure 22 Pushing the Node Insertion Levers
WARNING!
18. Set the node power switch to the ON position to turn on power on the node.
Replacing a Controller Node
39
NOTE: Once power is applied to the node, it begins to boot. This process can take
approximately 5-10 minutes. When complete, the node becomes part of the cluster.
19. Verify that the node LED is blinking green indicating that the node has joined the cluster.
20. In the 3PAR Service Processor Menu, select option 7 Interactive CLI for an InServ, then select
the desired system.
21. Issue the shownode command to verify the node has joined the cluster.
cli% shownode
Control
Data
Cache
Node --Name--- -State-- Master InCluster ---LED--- Mem(MB) Mem(MB) Available(%)
0 1400510-0 OK
Yes
Yes
GreenBlnk
16384
32768
100
1 1400510-1 OK
No
Yes
AmberBlnk
16384
32768
100
22. Reboot the replaced node one more time to synchronize software and hardware values by
issuing the shutdownnode reboot <node_ID> command.
23. After the node reboots a second time, monitor the node status LED and verify again that all
nodes have joined the cluster by issuing the shownode command.
24. Reconnect the customers Ethernet cable, if applicable, and all other cables to the node once
the node has rebooted.
CAUTION:
properly.
Do not reconnect host cables without verifying the controller node is functioning
25. Issue the checkhealth -svc -detail command to verify the system is healthy.
26. In the SP window, issue the exit command and select X to exit from the 3PAR Service Processor
Menu and to log out of the session.
27. Disconnect the serial cable from the maintenance PC and replace the cable behind the SP.
28. Close and lock the rear door.
6.
7.
40
Select the desired node and confirm all prompts to halt the node.
Allow 2-3 minutes for the node to halt, then verify that the node status LED is flashing green
(three blinks per second) and the node service LED is blue indicating that the node has been
halted.
Set the node power switch to the OFF position to turn off power on the node.
Loosen the captive screw on the node disk and pull the disk from the node to remove.
41
4.
Issue the showport -sfp command to verify which SFP requires replacement.
cli% showport -sfp
N:S:P -State- -Manufacturer- MaxSpeed(Gbps) TXDisable TXFault RXLoss DDM
0:3:1 OK
FINISAR_CORP.
8.3 No
No
No
Yes
0:3:2 DEGRADED AVAGO
8.3 No
No
Yes
Yes
0:3:3 OK
AVAGO
8.3 No
No
Yes
Yes
0:3:4 OK
FINISAR_CORP.
8.3 No
No
No
Yes
0:9:1 OK
FINISAR_CORP.
8.3 No
No
No
Yes
5.
6.
7.
8.
42
Issue theservicenode start -pci <slot> <nodeID> command to prepare the SFP
for service. Verify that the service LED for the PCI adapter is blue.
Identify the SFP module that requires replacement.
Wearing a wrist-grounding strap, disconnect the cable from the SFP.
Lift out the retaining clip of the SFP and carefully slide it out of the slot.
14. Issue the showport -sfp command to verify that the replaced SFP is connected and the
State is listed as OK (not degraded).
cli% showport
N:S:P -State0:3:1 OK
0:3:2 OK
0:3:3 OK
0:3:4 OK
0:9:1 OK
-sfp
-Manufacturer- MaxSpeed(Gbps) TXDisable
FINISAR_CORP.
8.3 No
AVAGO
8.3 No
AVAGO
8.3 No
FINISAR_CORP.
8.3 No
FINISAR_CORP.
8.3 No
TXFault
No
No
No
No
No
RXLoss
No
Yes
Yes
No
No
DDM
Yes
Yes
Yes
Yes
Yes
15. Issue the servicenode end <nodeID> command to end servicing mode.
16. Issue the checkhealth -svc -detail command to verify the system is healthy.
17. In the SP window, issue the exit command and select X to exit from the 3PAR Service Processor
Menu and to log out of the session.
18. Disconnect the serial cable from the maintenance PC and replace the cable behind the SP.
19. Close and lock the rear door.
43
Connect the maintenance PC to the SP using the serial connection and start an spmaint
session.
In the 3PAR Service Processor Menu, select option 7 Interactive CLI for an InServ, then select
the desired system.
Issue the servicenode start -pci <slot> <nodeID> command to prepare the PCI
adapter for service.
NOTE: The system will light the service LED blue when there is a failure, but the
servicenode start command confirms the correct component is being serviced.
4.
5.
6.
44
Identify the PCI adapter to remove and verify that the service LED is blue (located on the slot
above or below the adapter).
In the SP window, issue the exit command to return to the 3PAR Service Processor Menu.
Before disconnecting the cables from the front of the controller node, note the locations of the
cables, or note and label them. The drive-side Fibre Channel cables are marked to simplify
this task.
7.
8.
9.
10.
PCI adapters are not hot pluggable. You must turn off power on the node.
12. Press your thumb at the base of the adapter and press in on the ejector handle release trigger
while pulling the ejector handle outward to remove the PCI adapter from the slot.
Figure 27 Removing the PCI Adapter
45
23. Issue the showport command to verify the ports that are connected are ready.
NOTE: A port must be connected and correctly communicating to be ready. Verify if the
port (State column) is ready.
cli% showport
N:S:P
Mode
0:3:1 initiator
0:3:2 initiator
0:3:3 initiator
0:3:4 initiator
State
ready
loss_sync
loss_sync
ready
24. Issue the showport -i command to verify that the correct card is installed in the correct
slot.
cli% showport -i
N:S:P Brand Model
46
Rev Firmware
Serial
HWType
0:3:1
0:3:2
0:3:3
0:3:4
EMULEX
EMULEX
EMULEX
EMULEX
LPe12004
LPe12004
LPe12004
LPe12004
03
03
03
03
2.00.X.1
2.00.X.1
2.00.X.1
2.00.X.1
BT94849061
BT94849061
BT94849061
BT94849061
FC
FC
FC
FC
25. Issue the servicenode end <nodeID> command to end servicing mode.
26. Issue the checkhealth -svc -detail command to verify the system is healthy.
27. In the SP window, issue the exit command and select X to exit from the 3PAR Service Processor
Menu and to log out of the session.
28. Disconnect the serial cable from the maintenance PC and replace the cable behind the SP.
29. Close and lock the rear door.
47
2 J4400
4096
1 3 J4500
4096
1 0 J10700
0100 4096
1 1 J10900
0100 4096
1 2 J10800
0100 4096
1 3 J11000
0100 4096
1 4 J11300
0100 4096
1 5 J11500
0100 4096
1 6 J11400
0100 4096
1 7 J11600
0100 4096
DIMM2
DIMM3
4.
Issue the servicenode start <nodeID> command to service the node. The node LEDs
will appear blue.
5. Type exit to end the CLI session and to return to the 3PAR Service Processor Menu.
6. Before disconnecting the cables from the front of the controller node, note the locations ot the
cables, or note or label them. The drive-side Fibre Channel cables are marked to simplify this
task.
7. Select option 4 InServ Product Maintenance.
8. Select option 6 Halt an InServ cluster/node, then select the desired system.
9. Select the desired node and confirm all prompts to halt the node.
10. Allow 2-3 minutes for the node to halt, then verify that the node status LED is flashing green
and the node service LED is blue indicating that the node has been halted.
11. Set the node power switch to the OFF position to turn off power on the node.
12. Wearing a wrist-grounding strap, remove the node:
a. Pull the insertion/removal levers out to release the node.
b. Pull the controller node insertion/removal lever out to disengage the node from the chassis
midplane.
c. Slide the node part way out of the chassis and hold the node by the bottom and top to
remove and carry, and place it on an ESD-safe work surface.
13. Loosen the captive screw then slide and lift the controller node cover to remove.
48
15. To remove, press outward on the two tabs on the sides of the DIMM.
49
18. Insert the DIMM by pushing downward on the edge of the DIMM until the tabs on both sides
snap into place.
50
b.
51
27. Issue the servicenode end <nodeID> command to end servicing mode.
28. Issue the checkhealth -svc -detail command to verify the system is healthy.
29. In the SP window, issue the exit command and select X to exit from the 3PAR Service Processor
Menu and to log out of the session.
30. Disconnect the serial cable from the maintenance PC and replace the cable behind the SP.
31. Close and lock the rear door.
52
7.
8.
Select the desired node and confirm all prompts to halt the node.
Allow 2-3 minutes for the node to halt, then verify that the node status LED is flashing green
and the node service LED is blue indicating that the node has been halted.
Before disconnecting the cables from the front of the controller node, note the locations ot the
cables, or note or label them. The drive-side Fibre Channel cables are marked to simplify this
task.
Set the node power switch to the OFF position to turn off power on the node.
Wearing a wrist-grounding strap, remove the node:
a. Pull the insertion/removal levers out to release the node.
b. Pull the controller node insertion/removal levers out to disengage the node from the
chassis midplane.
c. Slide the node part way out of the chassis and hold the node by the bottom and top to
remove and carry, and place it on an ESD-safe work surface.
9. Loosen the captive screw then slide and lift the controller node cover to remove.
10. Locate the clock battery.
11. Remove the clock battery by pulling aside the retainer clip and pulling the battery up from the
battery holder (Figure 35 (page 53)). Avoid touching the internal node components when
removing the battery.
Figure 35 Removing the Clock Battery
53
12. Insert the replacement 3-V lithium coin battery into the clock battery slot with the positive-side
facing away from the retaining clip.
13. Install the node cover:
a. Align the controller node cover with the pegs in their grooves, then slide the cover until
it is properly sealed.
b. Tighten the captive screw on the node cover.
14. Install the node:
a. Align the bottom of the node with the grooves in the slot and slide the node into the node
chassis.
b. Close the insertion levers in quickly until the node is seated securely.
15. Set the node power switch to the ON position to turn on power on the node.
NOTE: Once power is applied to the node, it begins to boot. This process can take
approximately 5-10 minutes. When complete, the node becomes part of the cluster.
16. While the node is booting, connect the Fibre Channel cables and Ethernet cables to the node,
if applicable.
17. Verify that the node LED is blinking green indicating that the node has joined the cluster.
18. In the SP window, select option 7 Interactive CLI for an InServ, then select the desired system.
19. Issue the shownode command to verify that the node has joined the cluster.
20. Issue the showdate command to confirm the clock setting is correct.
21. Issue the checkhealth -svc -detail command to verify the system is healthy.
22. In the SP window, issue the exit command and select X to exit from the 3PAR Service Processor
Menu and to log out of the session.
23. Disconnect the serial cable from the maintenance PC and replace the cable behind the SP.
24. Close and lock the rear door.
54
5.
6.
Slide the assembly into the slots in the node chassis and hand-tighten the captive screws to
secure it.
Verify that the appropriate LEDs illuminate.
NOTE: The controller node status LEDs on the front of the system should match the node
status LED of each individual controller node, as seen from the rear of the storage system.
7.
8.
9.
Place the removed LED status board into protective packaging for return to HP.
Connect the maintenance PC to the SP using the serial connection and start an spmaint session.
In the 3PAR Service Processor Menu, select option 7 Interactive CLI for an InServ, then select
the desired system.
10. Issue the checkhealth -svc -detail command to verify the system is healthy.
11. Disconnect the serial cable from the maintenance PC and replace the cable behind the SP.
12. In the SP window, issue the exit command and select X to exit from the 3PAR Service Processor
Menu and to log out of the session.
Connect the maintenance PC to the SP using the serial connection and start an spmaint session.
In the 3PAR Service Processor Menu, select option 7 Interactive CLI for an InServ, then select
the desired system.
3. Shutdown the system and remove power from the storage system. Refer to Powering Off the
Storage System (page 79).
4. Remove the node power supplies and set them aside for reuse. Refer to step 7 in Replacing
a Controller Node Power Supply (page 32).
5. Remove the battery modules and set them aside for reuse. Refer to Replacing a Battery
Module (page 34).
6. Remove the controller node fan modules and set them aside for reuse. Refer to Replacing a
Controller Node Fan Module (page 31).
7. Before disconnecting the cables from the front of the controller node, note the locations ot the
cables, or note or label them. The drive-side Fibre Channel cables are marked to simplify this
task.
8. Note the location of all controller nodes in the chassis and mark the controller nodes with
these locations.
9. Move the cable manager tray in service position to clear space to ensure that no cables will
be obstructing the path of the chassis that you are removing. You may need to remove the
cable manager tray from the chassis by removing the screws.
10. Remove the nodes from the chassis. Refer to zstep 12 inReplacing a Controller Node
(page 35).
11. Use a #2 Phillips to loosen the panhead screws that secure the chassis to the rack.
CAUTION: To prevent damage to the controller node chassis, do not hold or lift the chassis
by the top cover.
12. With the help of another person, carefully slide the chassis out of the cabinet. Use caution
when lifting, as the chassis is heavy.
55
Use a slotted screwdriver or crowbar to pry off the four spring clamps that secure the
crate door.
Remove the crate cover from the base by using the wooden side rails and remove any
packing material that surrounds the controller node chassis.
CAUTION: To prevent damage to the controller node chassis, do not hold or lift the
chassis by the top cover.
c.
With the help of another person, lift the chassis to remove it from the crate.
NOTE: After unpacking the replacement controller node chassis, place the failed
node-chassis into the crate for return to HP.
24. Issue the checkhealth -svc detail command to verify the system is healthy.
25. In the SP window, issue the exit command and select X to exit from the 3PAR Service Processor
Menu and to log out of the session.
26. Disconnect the serial cable from the maintenance PC and replace the cable behind the SP.
27. Close and lock the rear door.
56
3.
Use a #2 Phillips screwdriver to loosen the silver captive screws and remove the power cord
retaining brackets from the PDU. Set the retaining brackets aside.
57
4.
Disconnect the AC cords that connect the power supplies to the failed PDU:
a. Note the numbers indicated on the AC cords labels and the PDU circuit breakers to which
they connect (Figure 38 (page 58)).
Figure 38 PDU Circuit Breakers
b.
5.
Tuck the disconnected AC cords out of the way so that the PDU can be removed.
Use a #2 Phillips screwdriver to loosen the black captive screws on the top right and bottom
left of the PDU.
Figure 39 Loosening the PDU Captive Screws
6.
58
Grab the handle and pull the PDU out of the cabinet to remove.
7.
On the back of the PDU, twist the connector counter-clockwise (1) to disconnect the AC cord
(2) (Figure 41 (page 59)).
Figure 41 Disconnecting the Main AC Cord from the PDU
8.
Use a #2 Phillips screwdriver to disconnect the green/yellow wire from the back of the failed
PDU. The wire should hang from the cabinet.
9. Remove the replacement PDU from its protective packaging.
10. Use a #2 Phillips screwdriver to remove the green/yellow wire from the back of the replacement
PDU.
11. Place the failed PDU into the packaging for return to HP.
59
12. Use a #2 Phillips screwdriver to connect the green/yellow wire (in the cabinet) to the back of
the replacement PDU.
13. Confirm the power breakers on the replacement PDU are set to the OFF position before
reconnecting any AC cords.
14. On the back of the replacement PDU, twist the connector counter-clockwise to reconnect the
AC cord.
15. Align the two tabs on the PDU with the two notches on the left side of the cabinet and slide
the PDU into the cabinet.
Figure 42 Replacing the PDU
16. Finger-tighten the black captive screws on the top left and bottom right of the PDU, securing
the PDU to the cabinet.
17. Reconnect the AC cords that connect the power supplies to the PDU in the order that they were
disconnected.
18. Use a #2 Phillips screwdriver to reinstall the power cord retaining brackets and secure them
to the PDU.
19. Set the PDU circuit breakers to the ON position.
20. Verify that the status LEDs on the PDU, and power supplies connected to the PDU, are green.
21. Connect the maintenance PC to the SP using the serial connection and start an spmaint
session.
22. In the 3PAR Service Processor Menu, select option 7 Interactive CLI for an InServ, then select
the desired system.
23. Issue the checkhealth -svc -detail command to verify the system is healthy.
24. In the SP window, issue the exit command and select X to exit from the 3PAR Service Processor
Menu and to log out of the session.
25. Disconnect the serial cable from the maintenance PC and replace the cable behind the SP.
26. Replace the storage system rear door.
Replacing an AC Cord
To replace a PDU:
1. For drive chassis power supplies, turn off the power supply that connects to the AC cord.
2. Locate the faulty cable in the cable bundles secured to the frame and make note of its location.
3. Unfasten the strap that secures the faulty cable to the frame.
4. Use a #2 Phillips screwdriver to loosen the silver captive screws of the power cord retaining
bracket and remove from the PDU. Set the retaining bracket aside.
5. Unplug the AC cord from the PDU.
60
6.
7.
8.
9.
10.
Unfasten the strap that secures the AC cord to the power supply cord lock.
Disconnect the damaged AC cord from the power supply.
Remove the faulty cord from the cabinet.
Remove the replacement AC cord from its packaging.
Locate the cable bundle from which the faulty cable was removed and add the replacement
cable to the bundle.
11. Label the replacement cable to correspond with the cable being replaced and then route the
replacement through the frame. If possible, reuse the labels from the failed AC cord.
12. Connect the replacement AC cord to the power supply and fasten the strap around the cord
and cord lock.
13. Connect the replacement AC cord to the PDU receptacle previously occupied by the damaged
cord and reinstall the power cord retaining brackets to the PDU using a #2 Phillips screwdriver.
Figure 43 Securing the AC Cord to the PDU
Replacing an AC Cord
61
17. At the front of the storage system, press the power button. On the SP, verify that the power
LED is illuminated.
62
18. Initialize software on the SP. Refer to the HP P10000 3PAR Storage System Installation and
Deinstallation Guide to begin the Moment of Birth (MOB) process.
63
64
Appearance
Indicates
RX
No light
No light
TX
FC-AL status
65
Appearance
Indicates
FC-AL module error or other cage error.
If both FC-AL modules have a steady
light, the temperature of a disk drive in
the drive-cage has exceeded its
high-level threshold, or a power supply
has failed.
Hot plug
4GB/s
66
No light
No light
Appearance
Indicates
Disk status
Hot plug
Quick flashing, or 20 percent on, 80 The disk is not spun up but has power.
percent off green light
Steady green light
No light
No disk is present.
No light
67
NOTE: You can issue the locatenode command to flash all service LEDs associated to a
controller node blue. This includes the power supplies, battery modules, and fan module LEDs.
Table 4 Controller Node LEDs
LED
Appearance
Indicates
Node Disk
No light
Normal operation.
Node Service
Steady blue
Node Status
68
No light
Normal operation.
HBA Service
Appearance
Indicates
Blue
69
Appearance
Indicates
Status
Green
Amber
Solid Blue
Blue Blinking
Off
Service
70
Appearance
Indicates
Port 1-4
No light
(Port speed)
Not connected.
Connected at 4GB/sec.
Connected at 8GB/sec.
(Link status)
71
Appearance
Indicates
Link
No light
Link down
Link up
No light
No activity.
Activity
ACT (Activity)
72
Ethernet LEDs
The controller node has two built-in Ethernet ports and each port contains two LEDs:
Figure 51 Ethernet LEDs
Appearance
Indicates
Data activity
No light
ACT/LNK is off
1000Mb/sec mode
100Mb/sec mode
No light
10Mb/sec mode
Ethernet LEDs
73
Appearance
Indicates
Power is on.
No light
Broken connection.
No light
AC
74
The power supply service LED is located on the dividers between the power supplies.
Figure 54 Controller Node Power Supply Service LED
Appearance
Indicates
Power Status
Power is on.
No light
Broken connection.
No light
Fault
Service
Blue
AC Status
75
Appearance
Indicates
Charging
Green
Amber
Off
Green
Off
Blue
Off
Discharging
Service LED
76
Appearance
Indicates
Lamp
Off
77
Table 13 SP LEDs
LED
Appearance
Indicates
Power
No light
No light
No light
Port is connected.
Network activity.
No light
Overheat
78
79
NOTE: A cable with adapter (P/N 180-0055) should be connected to the SP. Disconnect
the Ethernet cable from the RJ-45 to DB-9 adapter attached to the SP (P/N 180-0059).
2.
Attach the RJ 45 adapter assembly (P/N 180-055) to the PC serial port or USB to serial
adapter (Triplite USA-19HS is recommended).
Figure 59 Connecting the Ethernet Cable
3.
4.
Once you are connected to the SP using an serial or Ethernet connection, there are two SP user
interfaces, SPOCC and SPMAINT, that you can use to perform various administrative and diagnostic
tasks to support of both the system and the SP.
Refer to Connecting to the CLI (page 82) to start an SPMAINT session or Logging into SPOCC
(page 85).
NOTE: Connecting to the SP through the LAN (Ethernet) requires establishing a Secure Shell
Session (SSH). Refer to Using PuTTY (page 84).
If you do not have SSH, connect to the serial port of the SP. Refer to Serial Settings (page 81)
See Serial Cable Pinouts (page 85) for serial cable pinout diagrams.
3.
4.
Serial Settings
To connect to the SP using a terminal emulator, such as HyperTerminal, Attachmate Reflection X,
SecureCRT, or TeemTalk:
1. Establish a serial connection to the SP. Refer to Using a Serial Connection (page 81).
2. Open HyperTerminal, Attachmate Reflection X, SecureCRT, or TeemTalk. For this example,
Reflection X is used:
3. On the menu bar, select Connection and select from the Connection Setup drop-down list.
4. In the Connection Setup window, select the Serial Port radio button:
a. In the Communications Port field, select the port being used by the USB adapter (COMx).
b. Select 38400 (for SP, for node 57600) for the Baud Rate.
5.
Parity - None
Word Length - 8
81
6.
7.
8.
Stop Bits - 1
Click the More settings button to open the More Settings Window, confirm the following
settings:
Transmit: Xon/Xoff
Receive: Xon/Xoff
Click OK.
Enter your user name and password. Proceed to connect to the CLI. If you want to log your
session, see Enabling Session Logging.
Connect to the SP using a terminal emulator. Refer to Serial Settings (page 81).
The 3PAR Service Processor Menu appears. Select option 7, Interactive CLI for an InServ, then
select the desired system.
Proceed to the drive and node chassis maintenance procedures in this document.
2.
3.
82
Connect the free end of the crossover Ethernet cable to the Ethernet port in the maintenance
PC.
Power on the maintenance PC.
4.
Configure the LAN settings on the maintenance PC. See Configuring the LAN Settings on the
Maintenance PC (page 83).
4.
The Internet Protocol (TCP/IP) Properties dialog box appears (Figure 63 (page 84)). Select
the Use the following IP address button and then type the following IP addresses, then click
OK.
IP address - 10.255.155.49
83
5.
6.
Click OK in the Advanced TCP/IP Settings dialog box to finish configuring the LAN connection.
Establish a SSH using PuTTY. Refer to Using PuTTY (page 84).
Using PuTTY
After you have configured LAN settings and established an Ethernet connection, use PuTTY to
initiate a secure shell session between the maintenance PC and the SP.
To use PuTTY:
1. Double-click the putty.exe file in its permanent location on your PC.
2. In the PuTTY Configuration dialog box, type the SP IP address in the Host Name (or IP address)
field, select the SSH radio button, then click Open (Figure 64 (page 84)).
Figure 64 PuTTY Configuration Dialog Box
3.
84
If you are connecting to the SP for the first time, the PuTTY Security Alert dialog box appears.
Click Yes.
4.
In the PuTTY main window, type your user ID and press enter, then type your password and
press enter.
If you do not have a user ID and password, contact your Authorized Service Provider.
RJ45 Pin
Black
Orange
Green
Figure 65 (page 85) illustrates the pin locations and connections for the crossover DB9 female
serial to RJ45 adapter assembly (P/N 1800055).
Figure 65 Crossover DB9 Female Serial to RJ45 Serial Connector Pinouts
85
Straight-Through Adapter
The following table lists connector pinouts for the straight-through DB9 to RJ45 adapter (P/N
1800059). This connector inserts into the COM port on the SP.
Table 15 Straight-Through DB9 to RJ45 Adapter Serial Cable Pinouts
Color
RJ45 Pin
Orange
Black
Green
Figure 66 (page 86) illustrates the pin locations and connections for the straight-through DB9 to
RJ45 adapter (P/N 1800059).
Figure 66 Straight-Through DB9 to RJ45 Serial Connector Pinouts
86
A Precautions
General Precautions
Follow these general precautions when servicing the storage system to avoid injury, data loss and
damage:
CAUTION: Field Replaceable Units (FRUs) should be within 10 C (18 F) of the temperature of
the computer room before power is applied to them in a storage system. This is especially true for
disk drives. The maximum rate of change (gradient) in temperature for the FRU should be 10 C
(18 F) per hour. See Table 16 (page 87) for additional environmental specifications.
Table 16 Environmental Specifications
Specification
Value
Relative humidity
CAUTION: Using improper tools can result in damage to the storage system. See the tools list in
Tools (page 89).
Always use a wrist-grounding strap. A wrist-grounding strap is provided with the storage
system. Attach the grounding strap clip directly to an unpainted surface of the rack.
Avoid contact between electronic components and clothing, which can carry an electrostatic
charge.
If applicable, ensure all cables are properly labeled and easily identifiable prior to removing
a component.
General Precautions
87
To avoid potential damage to equipment and loss of data, handle controller nodes
WARNING!
CAUTION: Verify the storage system cabinet is completely immobilized before removing battery
modules. For storage systems with HP 3PAR cabinets, confirm that the leveling feet at the bottom
of the cabinet rest firmly on the ground before removing a battery module.
One battery module is connected to each controller node and supplies enough power for the node
to write unwritten data-cache to the node's internal disk during a loss of AC power. Following an
AC loss or the replacement of a battery module, the level of the battery module's charge cannot
be fully determined so the system limits and continuously adjusts the amount of available write-cache.
The battery module is considered fully charged and write-cache is 100% available after 24 hours.
AC Cord Precaution
When handling an AC cord, observe the following precaution:
WARNING! To avoid serious injury, never touch a damaged power cord before switching off
the PDU and power supply connected to the damaged cord.
88
Precautions
B Tools
Tools Required to Perform Maintenance
The following tools may be required to perform the maintenance procedures on a storage system
as described in this manual:
#1 Phillips screwdriver
#2 Phillips screwdriver
Adjustable wrench
89
C Guided Maintenance
Overview
Guided maintenance scripts are provided with the service processor to help facilitate the removal
and replacement of Field Replaceable Units (FRUs). The maintenance scripts execute all CLI
commands and, in some cases, select the appropriate failed component to minimize user error
when performing maintenance procedures. Guided maintenance is currently available for the
following FRUs:
Controller node
Battery module
SFP
Fan modules
Drive magazine
Power supply
FC-AL module
SFP
Drive
AC power cord
90
Guided Maintenance
3.
On the Service Processor - Support page, under the Action column, click Guided Maintenance
to perform maintenance (Figure 68 (page 91)).
Figure 68 SPOCC Support Page
91
4.
In the Guided Maintenance window, select the guided maintenance procedure to start a
replacement activity (Figure 69 (page 92)).
Figure 69 Guided Maintenance Window
92
Guided Maintenance
2.
3.
4.
5.
6.
7.
8.
9.
Connect the maintenance PC to the SP using the serial connection and start an spmaint session.
In the 3PAR Service Processor Menu, select option 4, InServ Product Maintenance.
Select option 11, Node Rescue.
Select option 1, Configure Node Rescue, then select the desired system.
Select option 3, Automatic Node Rescue.
Enter the desired node number.
Turn the node power switch to the ON position.
Select y to confirm the correct node number. When communication from the SP to the node
is established, output similar to the following appears:
root@1200163-0 Tue Apr 01 16:53:19:~# beginning rescue function...
.255.248 -s 10.255.155.54155.53 -m 255.255
Informing system manager to not autoreset node1
Resetting node 1
Attempting to contact node 1 via internal serial port
Waiting for node to respond (10 seconds elapsed)...
Waiting for node to respond (20 seconds elapsed)...
Waiting for node to respond (30 seconds elapsed)...
=Successfully started inter-node serial link communication
Starting Whack, setting values, and loading image:
Interacting with CBIOS on the node...
.
.
.
Booting from net...
TFTP "install" from 10.255.155.54................................complete
mknbi-1.2-7/first32.c (GPL)
93
NOTE: This process takes approximately 15 minutes. When complete, the node reboots
and becomes part of the cluster. If this takes longer than twenty minutes, problems may exist
and the node rescue process needs to be corrected.
10. After the node has booted, verify that the node status LED is blinking green in unison with the
other node LEDs, indicating that the node has joined the cluster, then press ENTER to continue.
11. Select 1, Deconfigure <name of cluster> Node Rescue.
12. Select x Return to previous menu until you return to the main menu.
13. Select option 7, Interactive CLI for an InServ, then select the desired system.
14. Issue the shownode command to verify that all nodes have joined the cluster.
cli% shownode
Control
Data
Cache
Node --Name--- -State- Master InCluster ---LED--- Mem(MB) Mem(MB) Available(%)
2 1201553-2 OK
No
Yes
GreenBlnk
4096
12288
100
3 1201553-3 OK
Yes
Yes
GreenBlnk
4096
12288
100
15. Issue the checkhealth -svc -detail command to verify the system is healthy.
16. In the SP window, issue the exit command and select X to exit from the 3PAR Service Processor
Menu and to log out of the session.
17. Disconnect the serial cable from the maintenance PC and the red cross-over Ethernet cable
from the node and coil and replace the cables behind the SP. If applicable, reconnect the
customer's network cable and any other cables that may have been disconnected.
18. Close and lock the rear door.
94
2.
3.
Connect the maintenance PC to the SP using the serial connection and start an spmaint session.
In the 3PAR Service Processor Menu, select option 4, InServ Product Maintenance.
NOTE:
cluster.
4.
5.
6.
Manual node rescue builds the node disk so it contains the proper software for the
7.
8.
Disconnect the blue Ethernet (serial) cable from the adapter on the SP.
Connect the cable to the serial port (S0) on the node being rescued.
95
96
11. After the node status LED starts rapidly blinking green (approximately 40 seconds), press
CTRL+W.
a. Type boot rescue and press enter.
b. The node will continue to run POST then it will stop and display instructions for running
node-rescue (see output on the following page). Select y to continue.
The node will continue to run POST then it will stop and display instructions for running
node-rescue (see output on the following page). Select y to continue.
The system installs the base OS and InForm OS.
NOTE: This process takes approximately 10 to 15 minutes (rescue and rebuild of disk = 5
minutes) + (reboot = 5-10 minutes). When complete, the node restarts and becomes part of
the cluster.
Whack>boot rescue
This is the procedure for manually rescuing a 3PAR InServ node (i.e.,
rebuilding the software on the node's internal disk). The system will install
the base OS, BIOS, and InForm OS for the node before it joins the cluster.
You must first connect a Category 5 crossover Ethernet cable between the SP's
private/internal network (ETH-1) and the "E0" Ethernet port of the node to be
rescued. Note that the diagram below does not represent the physical port
numbers or configuration of all node types.
New Node
Service Processor
+------------+
+-----------------+
|||||||
|
|
|
|||||||
|
|ETH-0 ETH-1(Int) |
||||||| E0 C0|
+-----------------+
+------------+
^
^ ^
|____Crossover ETH____| |__Maintenance PC (serial connection)
This procedure will execute the following Whack commands:
1. net addr 10.255.155.53
2. net netmask 255.255.255.248
3. net server 10.255.155.54
4. boot net install ipaddr=10.255.155.53 nm=255.255.255.248
rp=10.255.155.54::rescueide
This operation will completely erase and reinstall the node's local disk.
Are you sure? (Y/N) Yes
TFTP "install" from 10.255.155.54
....
12. After 10 to 15 minutes, verify that the node status LED is slowly blinking green in unison with
the other node LEDs, which indicates the node has joined the cluster.
13. Disconnect the blue Ethernet cable (serial) from the node and reconnect to the adapter on the
SP.
14. Change the baud rate of the maintenance PC to 38400.
15. Log into spmaint. When you log in, you are prompted to confirm that node rescue is complete.
16. Select option 1, Deconfigure Node Rescue.
17. Select option X Return to previous menu until you return to the main menu.
18. Select option 7, Interactive CLI for an InServ, then select the desired system.
19. Issue the shownode command to verify that all nodes have joined the cluster.
cli% shownode
Control
Data
Cache
Node --Name--- -State- Master InCluster ---LED--- Mem(MB) Mem(MB) Available(%)
97
0 1000163-0 OK
1 1000163-1 OK
No
Yes
Yes
Yes
GreenBlnk
GreenBlnk
4096
4096
6144
6144
100
100
20. Issue the checkhealth -svc -detail command to verify the system is healthy.
21. In the SP window, issue the exit command and select X to exit from the 3PAR Service Processor
Menu and to log out of the session.
22. Disconnect the serial cable from the maintenance PC and the red cross-over Ethernet cable
from the node and coil and replace the cable behind the SP. If applicable, reconnect the
customer's network cable and any other cables that may have been disconnected.
23. Close and lock the rear door.
98
Material Number
Description
Qty.
657885-001
up to 8
657886-001
657911-001
up to 16
Not shown
657893-001
up to 8
657894-001
657895-001
657896-001
up to 24
1
99
Material Number
Description
Qty.
641719-001
SPS- PROCESSOR 1U
SUPERMICRO II
Not shown
657897-001
657898-001
Qty.
Material Number
Description
657901-001
Material Number
Description
Qty.
657887-001
101
Material Number
Description
Qty.
657902-001
Not shown
657884-001
657883-001
657904-001
up to 9
657903-001
up to 9
657909-001
657910-001
Figure 76 DIMMs
Material Number
Description
A-H
657899-001
657908-001
Qty.
642702-001
I-L
657900-001
657907-001
Material Number
Description
672608-001
up to 10
649998-001
up to 10
649996-001
4,5
657888-001
up to 40
up to 40
657891-001
6,7
657890-001
677194-001
8, 9 (not used)
657892-001
up to 40
10
657905-001
up to 8
11
657906-001
up to 8
12
640842-001
SPS-SFP TRANSCEIVER
4GBIT LC
Material Number
Description
640843-001
Miscellaneous Components
Figure 79 Storage System Cables
Material Number
Description
Qty.
659061-001
Configuration Dependent
649991-001
649993-001
649994-001
649992-001
Not shown
F1800055
F1800059
F8500033