Вы находитесь на странице: 1из 69

Engineering IT Infrastructure

Capitoline LLP
Engineering IT Infrastructure

www.Capitoline.eu
p

www.Capitoline.eu
Engineering IT Infrastructure

What do we do
Computer
p room audits
Computer room/data centre designs
Assistance in the specification, purchase, project
management and project acceptance off computer
rooms
Seminars to assist end users to understand and define
their computer room/data centre requirements

www.Capitoline.eu
Engineering IT Infrastructure

Introduction to
Data Centre Design
Barry Elliott BSc RCDD MBA CEng

Introduction

June 08
www.Capitoline.eu
Engineering IT Infrastructure

Introduction to Data Centre Design


Agenda & Objectives
Introduction and objectives Standards
Understanding the bigger picture TIA 942
The new TIA 942 framework standard CENELEC EN 50173-5
European standards and directives
The design audit
British standards and the Building
Location Regulations
g
Architectural and structural issues Project management and design exercise
External power supply Project management issues
Standby power supplies Sizing an example data centre
Air conditioning requirements (HVAC) Calculating air conditioning
Sizing
Si i and d llocating
ti racks
k and d other
th requirements
equipment Calculating power requirements
Fire detection, alarm and suppression Considering and designing
system redundancy and back-up
Security,
y access control and CCTV Sizing racks
Integration with Building Management
Systems (BMS)
Information technology equipment
External communications and interfaces
Structured
St t d cabling bli

www.Capitoline.eu
Engineering IT Infrastructure

What is a Data Centre?


A building or portion of a
building
g whose pprimary y function
is to house a computer room
and its support
pp areas, ,
according to TIA 942

www.Capitoline.eu
Engineering IT Infrastructure

simplicity, flexibility, scalability,


modularity..
d l i
Enterprise Data Center Design and Methodology

The functional requirements of the data center are:


A place to locate computer, storage, and networking
d i
devices safely
f l andd securely
l
To provide the power needed to maintain these
devices
To provide a temperature-controlled environment
within the parameters needed to run these devices
To provide connectivity to other devices both inside
and outside the data center

www.Capitoline.eu
Engineering IT Infrastructure

Rack Location Unit concept


A non application-specific working space
Identifyy an area of the computer
p room floor e.g.
g
600 x 1000 mm
Supply adequate power and air conditioning to
that location
Provide generic interconnectivity to that location

www.Capitoline.eu
EN1047

Certified IT Security Installations must have:

Control Raised floor Ventilation Early fire


Risk-Management IT-Security system Cable management devices warning
systems

Fire
e detect
detection
o Water warning Access UPS & generator External
& extinguishing systems control systems monitoring
Engineering IT Infrastructure

Market Drivers
Disaster backup
9/11,
9/11 Buncefield
B fi ld Oil depot,
d t Hurricane
H i"43%
"43%K
Katrina
oftf icompanies
i experiencing
i i
Data protection legislation disasters never recover."
Sarbanes-Oxley, Basel II
"90% of businesses that lose data from
Civil Contingencies Act
a disaster are forced to shut within two
Growth in online businesses years of the disaster"
Mail-order, internet gambling
Growth in financial sector Source: London Chamber of Commerce
Share dealing, internet banking,and Industry,
credit 2003
card transactions
Competition amongst universities for distance-learning
students
Corporates requiring security, storage, resilience and back-up
EU Data Retention Directive (Aug 2007), 2 years of call records

www.Capitoline.eu
Engineering IT Infrastructure

External factors - Energy reduction


2001 European Directive on Energy
performance in Buildings
2006 Building Regulations Part L
2006 EU EEnergy S
Services
i Di
Directive
ti
2007 Climate Change Bill
Server and Data Center Energy Efficiency
Efficiency,
Public Law 109-431, April 2007

Code of Conduct on Data


Centres Version 0.7

www.Capitoline.eu
Engineering IT Infrastructure

Comments by His Highness Shaikh


Mohammed bin Rashid Al Maktoum
30-03-2007 Gulf Times

Dubais electricity demand will double by 2015


Power consumption rose by 30% in 2006
Economic growth of 11% is the target
14% energy savings are required
D b i has
Dubai h one off theth highest
hi h t per-capita
it energy
consumptions in the world
Dubai must consider solar and wind power
p

www.Capitoline.eu
Engineering IT Infrastructure

The Emirates Green Building Council (EmiratesGBC) is a not-


for-profit organisation. The EmiratesGBC was formed in July
2006 with the goal of advancing green building principles for
protecting the environment and ensuring sustainability in the
United Arab Emirates.

www.Capitoline.eu
Engineering IT Infrastructure

LEED
The Leader Environmental Design
(LEED) Green Building Rating
System encourages and accelerates
global adoption of sustainable green
building and development practices
through the creation and implementation
of universally understood and accepted
tools and performance criteria. ship in
Energy and The BREEAM family of assessment
methods and tools are all designed
to help construction professionals
understand and mitigate the
environmental impacts of the
developments they design and
build.

www.Capitoline.eu
Engineering IT Infrastructure

Energy performance
certificates for
Buildings required
under EU Energy
Performance of
Buildings Directive

www.Capitoline.eu
Engineering IT Infrastructure

Intel model for data centre efficiencyy initiatives

Complexity

Application &
Low voltage Virtualisation
Direct Current
Server
Consolidation

Economiser High voltage


Technology Direct Current

Improved cooling
infrastructure
Active thermal
separation

Return

www.Capitoline.eu
Engineering IT Infrastructure

Data Centre market

$4
$ billion market today
yggrowing
g to $
$8bn by
y 2007 ((IDC))
$15.6 billion in 2007 (Infonetics)
50% of IT Managers
g budgets
g will likely
yggo to this area
Data Center Space will grow 40%/year (Source - IDC)
Server
Server Units up 12
12.7%/year
7%/year (IDC)

www.Capitoline.eu
Engineering IT Infrastructure

www.Capitoline.eu
Engineering IT Infrastructure

www.Capitoline.eu
Engineering IT Infrastructure

www.Capitoline.eu
Engineering IT Infrastructure

www.Capitoline.eu
Engineering IT Infrastructure

Virtualisation
Run manyy applications
pp on one server
Take advantage of lightly loaded processors
yp
Consolidation ratios of 20:1 typical ((BMC
Software)
Less servers, in the short term
Servers will run hotter
All eggs in one basket

IBM HP Dell,
IBM, Dell VMWare,
VMWare Virtuozzo,
Virtuozzo Microsoft,
Microsoft Zen

www.Capitoline.eu
Engineering IT Infrastructure

Report to Congress on Server and Data


Center Energy Efficiency,
Efficiency Public Law 109-
431, April 2007

Data center floor space is expected to grow at (only)


5-10% per year because of virtualization
it was estimated
ti t d th thatt currentt trends
t d toward
t d server
virtualization would lead to about a 7% decrease in
the total U.S. installed base of volume servers byy
2011
..but electricity consumption by data centres will still
rise by 12% p p.a.
a in the period to reach 2 2.8%
8% of US
production

www.Capitoline.eu
Engineering IT Infrastructure

Building Shell
Telecommunications &
General Office Space Equipment Rooms
serving spaces outside
data centre

Data Centre

Support Staff Entrance Room(s) Data Centre


Offices Electrical &
Mechanical
Rooms
Telecommunications
Operations Storage room
Room(s) serving
Centre & Loading
data ce
centre
t e spaces Docks

Computer Room

The relationship of the Spaces


within a Data centre

www.Capitoline.eu
Engineering IT Infrastructure

The hierarchical structure of a data centre

www.Capitoline.eu
Engineering IT Infrastructure

The ability
abilit to
provide levels
of redundancy
in a data
centre

www.Capitoline.eu
Engineering IT Infrastructure

www.Capitoline.eu
Engineering IT Infrastructure

Data Centre Standards


TIA 942 Telecommunications Infrastructure
Standard for Data Centers, April 2005
Substantial, available, all-American
EN 50173-5 Information technology data centres
Smaller scope, European perspective
ANSI-BICSI-002 Data Center standard
complementary to TIA 942
ISO/IEC NP 24764 Information technology --
Generic cabling for data-centres

www.Capitoline.eu
Engineering IT Infrastructure

Relationship of American standards

ANSI/TIA-942
Telecommunications Infrastructure
Standard for Data Centers

TIA/EIA TIA/EIA TIA/EIA TIA/EIA TIA/EIA


568 569 606 607 758-A
Copper & Fiber Pathways Administration Grounding Outside Plant
Cabling & Spaces & Bonding

National
ASHRAE IEEE 1100
Electrical
Cooling/HVAC ITE Grounding
Code

www.Capitoline.eu
Engineering IT Infrastructure

Relationship of CENELEC standards


EN 50173-2 Information technology EN 50174-1 Information technology
Generic Cabling Office premises Cabling installation Specification
and QA
EN 50173-3 Information technology
Generic Cabling Industrial premises EN 50174-2 Information technology
Cabling installation Internal cabling
EN 50173-4 Information technology
Generic Cabling Homes

EN 50173-5
01 3 Information
I f i technology
h l EN 50346
0346 IInformation
f i technology
h l
Generic Cabling Data centres Cabling installation Testing
installed cabling

EN 50310 Application of
Relationship
equipotential bonding andofearthing
the in
buildings CENELEC
g with q p standards
IT equipment

www.Capitoline.eu
Engineering IT Infrastructure

European perspective

EU Directives
CENELEC, IEC, ISO and CISPR standards
Building Regulations
Planning permission
Legislation
Disability
Health & safety
Electricity
National Standards

www.Capitoline.eu
Engineering IT Infrastructure

DATA CENTERS:
CENTERS
BEST PRACTICES FOR SECURITY
AND PERFORMANCE

JSP 480 DEFENCE CO-ORDINATING INSTALLATION DESIGN


AUTHORITY MANUAL of REGULATIONS for INSTALLATION of
COMMUNICATION & INFORMATION SYSTEMS

www.Capitoline.eu
Engineering IT Infrastructure
ASHRAE Technical Committee
9.9, Mission Critical Facilities

www.Capitoline.eu
Engineering IT Infrastructure

Reliability

www.Capitoline.eu
Engineering IT Infrastructure

Equipment
qu p e iss ou
outgrowing
g o g racks
ac s

Servers require 3+2 basic utilities


Power
Data 3 connections
Control / KVM
Cooling 2 environmental
Racking

As servers become more densely located,


satisfying these utilities and getting them to
work well together becomes increasingly
critical.

www.Capitoline.eu
Engineering IT Infrastructure

Limiting factors
Heat dissipation within a server rack
1.7 kW average in 2003, now looking for 25 kW+
Power
P
supply to the rack
Power supply to the whole data centre
Communications links
Floor space available
Availability of qualified staff
Site location
Security, size, accessability

www.Capitoline.eu
Engineering IT Infrastructure

www.Capitoline.eu
Engineering IT Infrastructure

Breakdown of typical energy


requirements

About 9% of power station


power makes it to the server
About 6% makes it to the
processors and electronics
p
only about 3% of the
electricity goes towards
making calculations IBM

www.Capitoline.eu
Engineering IT Infrastructure

New Energy
Energy Star
Star rating 3
3-11-06
11 06

It focuses on 1U and 2U rack servers and does not address medium


enterprise or blade servers.
The
The environmental conditions under which the tests are performed should
be guided by data center standards set up by ASHRAE [American Society
of Heating, Refrigerating and Air Conditioning Engineers].
The result will be calculated using a power curve that measures energy
output at three different load levels: full, 90% and idling.

www.Capitoline.eu
Engineering IT Infrastructure

US and EU agree
g to use Energy
gy Star rating
g

REGULATION (EC) No 106/2008 OF THE EUROPEAN PARLIAMENT AND OF THE


COUNCIL of 15 January 2008 on a Community energy-efficiency labeling
programme for office equipment

www.Capitoline.eu
Engineering IT Infrastructure

Predictions
Calif.-based AFCOM itself predicted that over the next five
years power failures and other limits on power availability
will
ill h
halt
lt d
data
t center
t operations
ti att more th
than 90% off allll
companies.

Stamford, Conn.-based research firm Gartner Inc. said


that by 2008, half of all data centers will have insufficient
power and cooling capacity to meet demands of high-
density equipment.

www.Capitoline.eu
Engineering IT Infrastructure

AMD/Ziff

www.Capitoline.eu
Engineering IT Infrastructure

AMD/Ziff

www.Capitoline.eu
Engineering IT Infrastructure

AMD/Ziff

www.Capitoline.eu
Engineering IT Infrastructure

Data centre power usage

EU 2006 46 TWh
Data centres
account for 2% of
USA 2007 70 TWh the worlds CO2
emissions; the
same as air
EU 2020 93 TWh transport

= one hundred million 100 W


bulbs burning all year

Source EU, EPA

www.Capitoline.eu
Engineering IT Infrastructure

Average consumption by land type in kW


kW.hrs/sq
hrs/sq m/p
m/p.a
a

Office

Shopping centre

Residential

Distribution & Industrial

Leisure

S
Supermarket
k t

Retail warehouse

British Land 2005


www.Capitoline.eu
Engineering IT Infrastructure

Average Data Centre take 52 times more


electricity than an average office

D t centre
Data t computer
t room: 7500 kW.hrs/sq.m/p.a
kW h / /

450 per sq m per year electricity costs


A 10% improvement equates to 9000 per year for the
average 200 sq m computer room

www.Capitoline.eu
Engineering IT Infrastructure

The average floor tile represents about


1 2 tonnes of CO2 emissions per year
1.2

www.Capitoline.eu
1st
Qatar 61
1.9

36
6.6
2nd
Bahra
ain

Trinida
ad 35
5.5
3rd

33
3.7
4th

UAE
E

32
2.8
5th

Kuwa
ait

20
0.2
8th

Austra
alia

20
0.1
9th

USA
A

Netherland
ds 16
6.4
11th

udi Arab
Sau bia 15
5.6
CO2 emissions per person per year

12th

13
3.1
Belgium
m
15th

9.55
year, tonnes

UK
36th

4.
World avera
age 8
Engineering IT Infrastructure

www.Capitoline.eu
Engineering IT Infrastructure

Energy costs may determine future growth


areas

www.Capitoline.eu
Engineering IT Infrastructure

How the IT manager sees a data centre

www.Capitoline.eu
Engineering IT Infrastructure

How the rest of the world sees it

www.Capitoline.eu
Engineering IT Infrastructure

How the prime contractor sees it

www.Capitoline.eu
Engineering IT Infrastructure

How the finance director sees it

www.Capitoline.eu
Engineering IT Infrastructure

Tier Classifications p
per Uptime
p Institute
and TIA-942 Draft Standard

Tier 1 Tier II Tier III Tier IV


Site availability
y 99.671% 99.749% 99.982% 99.995%
Downtime (hours/yr) 28.8 22.0 1.6 0.4
Operations Center Not required Not required Required Required
Redundancy y for 2(N+1)
( ) or
power, cooling N N+1 N+1 S+S
Gaseous fire FM200 or FM200 or
suppression system Not required Not required Inergen Inergen
Redundant
backbone pathways Not required Not required Required Required

www.Capitoline.eu
Engineering IT Infrastructure

www.Capitoline.eu
Engineering IT Infrastructure

Syska Hennessy Criticality levels in Data Centres


C1 Facilities supporting routine local office processes that are not backed up regularly. The
loss of function could result in diminished productivity. However, the facility can achieve simple
and rapid recovery from unplanned downtime.
downtime
C2 Facilities supporting critical business processes that are both local and remote. The loss of
availability for a C2 facility could widely affect productivity. Full recovery after momentary
unplanned downtime can potentially take hours. Maintenance downtime can be regularly
scheduled.
C3 Back-up corporate facilities supporting and/or including critical business processes. The
loss of availability widely affects productivity and directly affects customers.
C4 Primary corporate facilities that support and/or include critical business processes. The loss
of availability widely affects productivity and directly affects customers. Full recovery after
momentarily unplanned downtime can take hours or even days. days
C5 Primary corporate facilities supporting and/or including core business processes. The loss of
availability directly translates to the facility's bottom line. Full recovery after momentary
unplanned downtime can take days to possibly weeks. C6 Large corporate data centers
supporting and/or including core business processes and are, typically, a network of remote
d
data centers that
h work k together.
h The
h loss
l off availability
l bl poses widespread
d d circumstances that
h
can affect national security and public safety.
C7 and beyond Future levels for continued growth and evolution of the critical facility.

www.Capitoline.eu
Engineering IT Infrastructure

BITKOM Model
Planning
Planning Aid for reliable
data centers
Category Approx Tier Downtime
rating allowed
A T1 T2 72 h
B T1-T2 24 h
C T3 1h
D T3-T4
T3 T4 10 min
E T3-T4 0 min

www.Capitoline.eu
Engineering IT Infrastructure

Cost of a Data Centre


/sq m
7500

5000

2500

www.Capitoline.eu
Engineering IT Infrastructure

Small projects 30 200 Sq m


size cost cost/sqm
208 381 1.83
220 1285 5.84
Sizesqm
31 138 4.45
300
34 303 8.91 275
83 292 3.52 250
100 208 2 08
2.08 225
200
60 278 4.63 175
31 152 4.90 150
125
27 149 5.52
100
65 293 4 51
4.51 75
200 585 2.93 50
25
70 379 5.41 0
235 602 2.56 1 2 3 4 5 6 7 8 9
25 126 5.04 Costpersqm

Average
cost/sqm 4.44

www.Capitoline.eu
Engineering IT Infrastructure

Medium Size 180 -600 sq m

www.Capitoline.eu
Engineering IT Infrastructure

15,000
, sq
q ft relocation project
p j
Architects fees $262,000 4%
Electrical design
g $142,000
$ , 2%
Facilities inc cabling design $196,000 3%
Raised floor $349,000 5%
Other building g works $378,000 6%
Plumbing $39,000 1%
Sprinkler and FM200 suppression $270,000 4%
HVAC $975,000 15%
Electrical, UPS and generator $2,700,000 41%
Data cabling $263,000 4%
Security system $60,000 1%
BMS system $80,000 1%
Control room $180,000 3%
Management fees and insurance $767,000 11%
Total $6,661,000 $444/sq ft

www.Capitoline.eu
Engineering IT Infrastructure

Management fees Architects fees Electrical design


and insurance 4% 2% Facilities inc cabling
11% design
3%
Control room
BMS system 3%
Raised floor
1% Other building works
5%
Security system 6%
1%
Plumbing
Data cabling
1%
4%

Sprinkler and FM200


suppression
4%
HVAC
15%

Electrical, UPS and


generator
40%

www.Capitoline.eu
Engineering IT Infrastructure

British University. 180 sq m plus 14 sq m Entrance Room

entrance room minor building raised floor


minor building works 14.7 works
fitout 3%
raised floor 18 3% 3%
ins and fees lighting
lighting
g g 9 documentation 2%
4%
vesda 15.3 1% vesda
power 234.7 3%
BMS
CCTV/access 16.2 3%
FM200 36 9
36.9
HVAC
cable containment 2.7
20%
data cabling 55
HVAC 117
BMS 16 2
16.2 data cabling
9% power
documentation 3 40%
ins and fees 26
entrance room fitout 15 cable containment
0%
total cost 579.7 FM200
6%
CCTV/access
cost k p
per sq
qm 3.22 3%

www.Capitoline.eu
Engineering IT Infrastructure
Plumbinganddrainage 306000
Chillerplant 2040000
ChiledwaterDistribution 2987200

Big Projects Ventilation


CRACunits
2120000
1657500
HVACrestofbuilding 201500
HVswitchgear 2500000

8500 sq m colocation LV distribution


LVdistribution 4213400
Technicalearth 79500
facility Safetyearth 59500
Electricalmonitoring 425000
Two stories Lighting 495000

6 MVA supply UPS 4160000


Standbygenerator 1700000
Chilled water air con N+1 Cablecontainment 178250
S i kl
Sprinkler 116250
2N UPS Gasfiresuppression 1122000
Leakdetection 102000
3200 racks (not included) Smokedetection 326400
Intruderalarm 44000
CCTV 720000
7500 per sq m Accesscontrol 107000
BMS 416500
Datacabling 3840000
Professionalfees 210000
30127000
www.Capitoline.eu
Professional fees, Plumbing and
Fees 210000
Engineering
drainage, 306000
IT Infrastructure

BMS, 416500
1% Minor
Security, works 1%
Smoke detection,
monitoring and 326400
Chiller plant,
2040000
Data cabling,
access control CCTV, 720000
3840000
4% Access control,
107000
Intruder alarm, 44000 Chiled water
Distribution,, 2987200
Leak detection,
Fire systems 102000 Cabling
6% 13%
Gas fire suppression,
1122000
HVAC
V til ti
Ventilation, 2120000
Sprinkler, 116250 30%
Standby generator,
CRAC units, 1657500
1700000
Power
45%
% HVAC
rest of
building,
201500
HV switchgear,
UPS, 4160000 2500000

Cable containment, LV distribution,


178250 4213400
Lighting, 495000
Technical earth,
Electrical monitoring,
Safety earth, 59500 79500
425000
www.Capitoline.eu
Engineering IT Infrastructure

Cost of getting it wrong:


per hour!

www.Capitoline.eu
Engineering IT Infrastructure

www.Capitoline.eu
Engineering IT Infrastructure

www.Capitoline.eu
Engineering IT Infrastructure

The essential questions


1.0 Physical location of the data centre
2.0 Physical sizing and capabilities
3.0 Electrical systems to and within the data centre
4.0 Fire minimisation, detection, alarm and suppression
5.0 Heating, Ventilation and Air Conditioning (HVAC)
6.0 Communications Cabling within and to the data centre
7.0 Cablingg containment within the data centre ((including
g
raised floors)
8.0 Equipment racks and cabinets
9.0 Information Technology equipment
10.0 Security, Access and CCTV
11.0 Project management
12.0 Ongoing
g g maintenance

www.Capitoline.eu

Вам также может понравиться