Академический Документы
Профессиональный Документы
Культура Документы
- Boards - Documentation
- MXB
- ILB
- DSIB
- PDB
- FANs
- Disks
- LCP
- Power Supply
- PCIe boards
Itanium Itanium
Next Next
Glue vs. Glueless or or
SNC Itanium Itanium
SMP Xeon Xeon
Core-4
Core-5
Core-6
Core-7
Core-8
Core-1
Core-3
L3 L3
Core-3 Core-4
6 MB 6 MB
2 nd level Cache
- New cache introduced in Nehalem
- Unified (holds code and data)
- 256 kB per core
- Performance : Very low latency
- Scalability : As core count increases, reduce pressure on shared cache
3 rd level cache
- Shared across all cores
- Size depends on # of cores
- 8 cores: Up to 24MB
- Scalability:
- Built to vary size with varied core counts
- Built to easily increase L3 size in future parts
- Inclusive cache policy for best performance
- Data residing in L1/L2 must be present in 3 rd level cache
Not in catalog
BASE DRAWER :
- 4 Nehalem-EX (Expandable)
- 3U large configuration
- 32 DDR3 + 16 MillBrook
- QPI links @ 6.4 GT/s
- 2 IOH (Boxboro)
- 6 PCIe slots Gen2
- HDD SAS or SATA
. 4 or 8 SAS HDD
. 6 SATA HDD
- “BCS Ready”
Nehalem-EX (up to 4)
4
Ethernet
ports
Disks (up to 8)
Hot swap
(2 x 4) SATA/SAS
45 Up to
0 135
m 32 Dimms
2 power supplies m mm
W e ig h t fu lly p o p u la te d : ~ 3 5 K g
6 PCI-e Gen2 slots P o w e r c o n s u m p t io n m a x lo a d : ~ 1 3 2 5 W
2-x16, 4-x8 P o w e r c o n s u m p t io n id le : ~ 7 4 0 W
11 ©Bull, 2010 © Bull Confidentiel - Reproduction interdite sans accord préalable
BOARDS mechanics 4S3U
PDU DSIB
LCP NHM
Power Distribution Board
Local Control Pannel Dummy BCS Interconnect Board
- Board (ILB)
ILB IO Legacy Board
- I/O attachment (Boxboro IO Hub for PCIe slots –ICH10)
- IBMC : Based on nuvoTon BMC chip for PlatformManagement access over LA
- Board (PDBU)
PDBU for power distribution
- Local Control Panel (LCP)
- Board (FDB) Fan Distribution Board : Belongs to Fan Box
- Dummy SIB (DSIB)
DSIB to provide QPI connection in configuration without
BCS
- DSIBs will be used in place of SIB
- Board (SIB)
SIB for BCS and interconnect support
- 1 BCS chip
- Box (HDX)
HDX for HDD (4xSAS) connection
iBMC
nuvoTon
Block F: Block D
ILB_CLK
ILB ILB_MNG
HDB HDB
optional
Status led
IOH IOH
CSI0 CSI0
I0 I1
CSI1 CSI1
G3 G4
CPU CPU
DSIB DSIB
MTB
CPU CPU G1 G2
IOH IOH
Processor P0
Processor P2
Processor P1
Processor P3
CSI0 CSI1 CSI0 CSI1 CSI0 CSI1 CSI0 CSI1
For 4 socket-only systems CSI4 CSI5 CSI4 CSI5 CSI4 CSI5 CSI4 CSI5
Loosen the two large screws(A) securing the DSIB to the rear of the server drawer
alternatively, beginning with the screwdriver and ending manually.
Nehalem
NHM NHM
socket
IO/BCS interface
FBDIMM ARRAY
Nehalem
NHM NHM
socket
DSIB
IOH IOH
Nehalem
socket
For 4 socket-only systems
- Functions
- Processor NEHALEM
- DC/DC converters
- Debug interface (XDP)
- Interfaces (per NHM)
- 4 QPI links : High speed links (6.4 GT/s) for :
• interconnecting to other processors
• Connecting Node controller (BCS) or IOH (4.8 GT/s)
- 2x FBDIMM for each MemChannel
• GEN1 (533 -- 667 – 800 MHz)
- SPI FLASH (1 per socket) for boot firmware
- FAN connection
- Order for populating: (A0 and B0), then (C0 and D0),
then (A1 and B1), then (C1 and D1)
- 8 DDR3 / Socket
- 2 MillBrook attached by memory controller
- 2 DDR3 per MillBrook
CPU IDs P0 P1 P2 P3
MC1 MC0 MC1 MC0 MC1 MC0 MC1 MC0
CH CH CH CH CH CH CH CH CH CH CH CH CH CH CH CH
C D A B C D A B C D A B C D A B
MB MB MB MB MB MB MB MB
#C #B #C #B #C #B #C #B
RDIMM #1
RDIMM #0
RDIMM #0
RDIMM #1
RDIMM #1
RDIMM #0
RDIMM #1
RDIMM #1
RDIMM #0
RDIMM #0
RDIMM #1
RDIMM #1
RDIMM #0
RDIMM #0
RDIMM #1
RDIMM #0
RDIMM #0
RDIMM #0
RDIMM #1
RDIMM #1
RDIMM #0
RDIMM #1
RDIMM #1
RDIMM #1
RDIMM #0
RDIMM #0
RDIMM #0
RDIMM #0
RDIMM #1
RDIMM #1
RDIMM #1
RDIMM #0
MB MB MB MB MB MB MB MB
#D #A #D #A #D #A #D #A
DIMM IDs 00 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31
. Fully open the lever arm (A) and open the load plate (B) by
pressing on the tail.
x16
PE1 PCIe x16
CSI0
x8
PCIe x8
QPI Full width
PE0 x8
IOH1 PCIe x8
Block B
CSI1
x4
LAN
kAWELA
RMII
LAN
x16
PE1 PCIe x16
CSI0 x8
QPI Full width PCIe x8
Legacy x8
PE0 PCIe x8
CSI1 IOH0
x4 LAN
kAWELA
RMII LAN
ESI
LPC TPM
Serial
LPC
to ILB_MNG
SIO Serial
Flash Spi
USB(2)
Block C
Sata DRAM
Sata ICH10
PCI VGA
ES1000 Video
USB
DVO
- Functions
- IO Hubs (Boxboro for MESCA-X)
- ethernet controller (KAWELA)
- Interfaces
- PCIe slots (GEN2 = 5GT/s)
• 2 slots x16
• 4 slots x8
• Internal connections :
KAWELA Dual ethernet controller 10-100-1000
(connected on 1 x4 PCIe)
4X
Legacy HP 16X
4X
Boxboro-MC
IOH0 4X
4X
ConnectX HP 8X
4X
4X
8X
4X
Block B2
ESI 4X
/PCi-e1
4X Kawela
4X
4X
Boxboro-MC
16X
4X
IOH1
4X
4X
8X
4X
4X
8X
4X
Block B1
1x = 10Gb/s bidir
Video in
(DVI) rev3
33 ©Bull, 2010 © Bull Confidentiel - Reproduction interdite sans accord préalable
South Bridge ICH10 Overview
• Features • Features
– 6 PCI Express x1 ports – SMBus 2.0 / SMLINK
Boxboro
– Integrated 10/100/1000 GbE – Up to 4 PCI 2.3 Masters
MAC GbE PHY – Flexible GPIO usage
• Optimized GbE & x4 ESI CLink – VT-d virtualized IO support
WLAN i/f LCI
– 6 SATA ports (AHCI, 3 Gb/s) GLCI
– 12 High-Speed USB 2.0 Ports
– High Definition Audio – System Management
– Serial Peripheral Interface PCIe x1 (6 Lanes)
(SPI) ICH10 – Storage e-SATA port multiplier
– Legacy BIOS support – Quiet System Technology
– Interrupt controllers SPI LPC • Fan Speed Control
– Power Management
SPI PCIe x1 • ACPI 3.0
Flash WLAN – Halogen free package chip
CLink
TPM1.2
Super I/O
BMC
CLink:controller Link
RMII RAM
USB
SATA
FLASH
LPC Private
VRAM
iBMC Manageme
Super nt LAN
SuperI/O
I/O
SATA
IPMB (I2C)
Disks Ethernet to remote BMC
x8 x8 x8 x8 x4 x8 x8 x8 x8 x4
data + cmd data + cmd data + cmd data + cmd data + cmd data + cmd data + cmd data + cmd
1a 1b
3a 3b
2a 2b
data
cmd
Con-
Kawela Kawela
nectX
Ext.
Ext.
Connector Connector
for cable for cable
Slot x16
Slot x16
to PCI-e boards to PCI-e boards
in x16 slot for in x16 slot for
bifurcable bifurcable
extension extension
Slot x8
Slot x8
Slot x8
Slot x8
to 2 times x8 to 2 times x8
ILB-002
G4 G3
ICH10
Slot #2
Slot #5
QPI1 QPI1
QPI0
Slot #1
Slot #0
Slot #4
Slot #3
QPI0
IOH #1 IOH #0
Kawela Kawela
PCIe #1 #0 PCIe
Ch. B A ConnectX
Ch. B A IB
Slot #3
Slot #0
Slot #4
Slot #1
Slot #5
Slot #2
Ch. A B
• 1 ICH10
• 2 IOH
• 1 iBMC
• 6 slots PCIe (5 slots x8 and 1 slot x16)
• 1 internal connector for x4 SATA
• 1 internal connector for x2 SATA
• 2 IB ports
• 4 1GbE ports
• 1 ethernet ports 100Mbps reserved
for administration
• 2 USB ports
• 1 VGA port
Hot-plug
Rewrite some FRUs with Fructose: System Serial Number / Chassis serial number / Product name /Model
Check the QPI links speed (with the EMM hidden page)
Check the QPI links health (with the tool CheckLink)
An EFI drivers exists for ICH chip, but without RAID support.
The ICH EFI driver is integrated in the system Bios.
SATA disks are usable for booting, but without the support of the RAID function.
ethernet
DVI φ sdram flash mux
DVO
KAWELA 6 x I2C
FPGA
(SMBus) +5VSB
ES1000 toward ILBC
(I2C)
the rest of
+3.3VS
the
- Functions
- Distribute 12V and 3.3V Stand-By generated by
AC/DC block
- Provides power supply for Processors
- Handle UltraCapa module
- Interfaces
- 12V and 3v3STBY to ILB and MXB
- 12V to HDB
H D B
12V
M TB 12V 12V
H D B
12V
3 .3 V S ta n d B y
1 2 V S IB P W R
PDB 12V
12V S IB 12V
1 2 V S IB P W R 12V
12V 12V
12V
IL B
G IG 3 .3 V S ta n d B y
3 .3 V S ta n d B y
12V
3 .3 V S ta n d B y
12V
12V
A C /D C A C /D C A C /D C
0 1 2
Loosen the captive screw (A) located on the left of
the PSU to be serviced.
Pull the PSU carefully out of its slot using the black
handle.
PSU#0
PSU#0 PSU#1
PSU#1
(1) :default password = admin ; Check QPI speed with the Hidden page in SHC
55 ©Bull, 2010 © Bull Confidentiel - Reproduction interdite sans accord préalable
Rear Connections
0 2 3 0 2 3
P0 P3 P0 P3
2 0 2 0
1 3 1 1 2 1 3 1 1 2
4 4
6 0 9 6 0 5 9
5
3 0 3 0 3 0 3 0
2 3 1 2 3 1
P1 P2 P1 P2
7 8 1 7 8 2
1 2
0 1 2 3
1 0 1 0
IO H # 0 IO H # 1 IO H # 0 4 BCS 5 IO H # 1
0 1 0 A B 1
IC H 1 0 IC H 1 0
- W ith in e a c h M e s c a m o d u le ( 4 S 3 U d r a w e r )
- E a c h N e h a le m - E X p r o c e s s o r P i h a s 4 Q P I p o r t s n u m b e r e d P i –
Q P I0 /1 /2 /3
- E a c h B o x b o ro IO H i h a s 2 Q P I p o rts n u m b e re d IO H i – Q P I0 /1
- E a c h B C S h a s 6 Q P I p o rts n u m b e re d B C S – Q P I0 /1 /2 /3 /4 /5
L o g ic a l Q P I# P ro c e s s o r - Q P I # P ro c e s s o r - Q P I # C o m m e n ts
Q P0 P 0 – Q P I3 P 1 – Q P I3 L a n e re v e rs a l
Q P1 P 0 – Q P I2 P 2 – Q P I3 L a n e re v e rs a l
Q P2 P 0 – Q P I0 P 3 – Q P I3
Q P3 P 1 – Q P I2 P 2 – Q P I1
Q P4 P 1 – Q P I0 P 3 – Q P I0 L a n e re v e rs a l
Q P5 P 2 – Q P I0 P 3 – Q P I1 L a n e re v e rs a l
11008109C-000
21005177-000 PSUS400-1540
MC000623-000
21005429-000 CKTU401-EX1M Intel PRO/1000 PT Single Port Gigabit Copper (PCI-Express) #868970
CKTU400-0060 Adaptec RAID SAS ADAPTER 5805-SLG (BBU not include with
spare)
F/C 4Gb/s 1 port LPe1150-F4 PCI-e HBA 21005431-000 CKTU301-EX4M Emulex PCIe LPe1150-F4
F/C 4Gb/s 2 port LPe 11002-M4 PCI-e HBA 21005435 -000 CKTU302-EX4D Emulex PCIe LPe11002-M4
11016428-000
set of 2 DDR3 SDRAM 1066MHz 2GB Micron 22005327M12-000 CMMU600-0004 Ref Micron : MT18JSF25672PDZ-1G1F1
set of 2 DDR3 SDRAM 1066MHz 2GB Samsung 22005327S12-000 CMMU600-0004 Ref Samsung : M393B5673EH1-CF8
set of 2 DDR3 SDRAM 1066MHz 4GB Micron 22006326M12-000 CMMU600-0008 Ref Micron : MT36JSZF51272PY-1G1D2 or
MT36JSZF51272PZ-1G1F1
Set of 2 DDR3 SDRAM 1066MHz 8GB QR 21005415S11-000 CMMU700-0016 Ref Samsung : M393B1K73CH0-CF8
Samsung
21005050-000
11002062-000
2.5" 500GB SATA2 7.2Krpm 14.8mm 21005233-000 MSUU303-0072 Seagate Constellation ST9500530NS
11002016-000 DRWU700-0000
11016561-000
PDU (7 outlet x C13) - 2.5m cable w/ 32A PDUH006-M700 PDUH006-M700 ATOS 6901758