Академический Документы
Профессиональный Документы
Культура Документы
UC Berkeley
Upcoming Applications!
UC Berkeley
UC Berkeley
UC Berkeley
Talk Outline
FireBox
DIABLO
UC Berkeley
Service-Oriented Architecture
6"
Bookstore:
Silo
Internal
subsystems
reviews
users
orders
Review
Subsystem
User Profile
Service
Buying
Subsystem
single
API
(Bookstore)
Bookstore Service
7"
credit card
processing
Bookstore:
SOA
Subsystems
independent,
as if in separate
datacenters"
user
reviews
editor
reviews
User Profile
Service
Review
Service
Review Service
access User
Service API"
Can recombine
to make new
service (Favorite
Books)"
(Figure 1.3, Engineering Software as
a Service by Armando Fox and David
Patterson, 2nd Beta edition, 2013.)
users
orders
Buying
Service
Bookstore Service
Favorite Books
Service
users
Social
Network
Service
8"
on time, on budget"
20%"
challenged (late,
over budget,
insufficient
functionality)"
76%"
failed (cancelled
prior to completion
or delivered and
never used)"
38%"
52%"
UC Berkeley
4.
5.
UC Berkeley
11
UC Berkeley
12
UC Berkeley
Sodware
(SW)
Reducing
Component
VariaCon
Hardware
(HW)
Higher
network
bisecCon
BW,
reduce
queuing
Reduce
per-message
overhead
(helps
hedged/Ced
req.)
ParCConable
resources
(BW,
cores,
caches,
memories)
Dean,
J.,
&
Barroso,
L.
A.
(2013).
The
tail
at
scale.
CACM,
56(2),
74-80.
13
Memory
Hierarchy:
Old
vs.
New
Conven7onal
Wisdom
Old
CW:
3-Level
memory
hierarchy
/
node
1. DRAM
2. Disk
3. (Tape)
* Tape is Dead, Disk is Tape, Flash is Disk, RAM Locality is King by Jim Gray, December 2006
14
15
UC Berkeley
2010
D
D
R
D
D
R
D
D
R
2015
2020?
High Performance
Tier
Higher Performance
Tier
DRAM
DRAM
DRAM
PersistentDRAM
Performance
Tier
High Capacity
+ Flash
Tier
HDD
HDD
HDD
Tape
F
L
A
S
H
HDD
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
HDD
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
HDD
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
HDD
DRAM
DRAM
DRAM
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
HDD
D D DND ND
D D DE D ED
R R RWR WR
D
N
ED
R
W
D
N DN D ND
D
E DE D ED
R
W RWR WR
ND
ED
R
W
D
N
D
E
R
W
DN DND N
DE DE D E
RW RWR W
F F F F F F F F F F F F F F F
L L L L L L L L L L L L L L L
A A A A A A A A A A A A A A A
(if
RRAM,
STT-MRAM,
or
PCM
work)
S S S S S S S S S S S S S S S
H H H H H H H H H H H H H H H
Cold Storage
HDD
HDD
HDD
HDD
HDD
[
Revised,
based
on
slide
from
Bob
Brennan,
Berkeley
Next-GeneraCon
Memory
Discussion,
Jan.
2014
Samsung
]
16
UC Berkeley
2010
D
D
R
D
D
R
D
D
R
2015
2020?
High Performance
Tier
Higher Performance
Tier
DRAM
DRAM
DRAM
PersistentDRAM
Performance
Tier
High Capacity
+ Flash
Tier
HDD
HDD
HDD
Tape
F
L
A
S
H
HDD
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
HDD
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
HDD
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
HDD
DRAM
DRAM
DRAM
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
HDD
D D DND ND
D D DE D ED
R R RWR WR
D
N
ED
R
W
D
N DN D ND
D
E DE D ED
R
W RWR WR
ND
ED
R
W
D
N
D
E
R
W
DN DND N
DE DE D E
RW RWR W
F F F F F F F F F F F F F F F
L L L L L L L L L L L L L L L
A A A A A A A A A A A A A A A
(if
RRAM,
STT-MRAM,
or
PCM
work)
S S S S S S S S S S S S S S S
H H H H H H H H H H H H H H H
Cold Storage
HDD
HDD
HDD
HDD
HDD
[
Revised,
based
on
slide
from
Bob
Brennan,
Berkeley
Next-GeneraCon
Memory
Discussion,
Jan.
2014
Samsung
]
17
UC Berkeley
2010
D
D
R
D
D
R
D
D
R
2015
2020?
High Performance
Tier
Higher Performance
Tier
DRAM
DRAM
DRAM
D D D D D D D D D D D D D D D
D D D D D D D D D D D D D D D
R R R R R R R R R R R R R R R
HDD
HDD
HDD
Tape
F
L
A
S
H
HDD
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
HDD
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
HDD
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
HDD
DRAM
DRAM
DRAM
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
HDD
D D D D D D D D D D D D D D D
D D D D D D D D D D D D D D D
R R R R R R R R R R R R R R R
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
Cold Storage
HDD
HDD
HDD
HDD
HDD
[
Revised,
based
on
slide
from
Bob
Brennan,
Berkeley
Next-GeneraCon
Memory
Discussion,
Jan.
2014
Samsung
]
18
UC Berkeley
2010
D
D
R
D
D
R
D
D
R
2015
2020?
High Performance
Tier
Higher Performance
Tier
DRAM
DRAM
DRAM
HDD
HDD
HDD
Tape
F
L
A
S
H
HDD
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
HDD
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
HDD
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
HDD
DRAM
DRAM
DRAM
N N N N N N N N N N N
E E E E E E E E E E E
W W W W W W W W W W W
F
L
A
S
H
F
L
A
S
H
F
L
A
S
H
HDD
Cold Storage
HDD
HDD
HDD
HDD
HDD
[
Revised,
based
on
slide
from
Bob
Brennan,
Berkeley
Next-GeneraCon
Memory
Discussion,
Jan.
2014
Samsung
]
19
UC Berkeley
Security:
Old
vs.
New
Conven7onal
Wisdom
UC Berkeley
Moores
Law:
Old
vs.
New
Conven7onal
Wisdom
Moores Law
1965-2020
21
UC Berkeley
UC Berkeley
UC Berkeley
24
UC Berkeley
What is an ISA?
to
an
ISA
standard
In
an
open
compuCng
future,
why
have
a
proprietary
ISA
standard?
Are
x86
and
ARM
v8
innovaCve
interface
designs?
ISA
should
be
an
open
industry
standard!
25
UC Berkeley
www.riscv.org
A
new
completely
open
ISA
UC Berkeley
sodware
2nd
generaCon
WSC
also
pushing
open-source
board
designs
(OpenCompute),
OpenFlow
API
for
networking
3rd
generaCon
open-source
chip
designs?
-We
plan
to
release
FireBox
WSC
chip
generator
27
FireBox Overview!
UC Berkeley
SoC
SoC
SoC
SoC
SoC
SoC
SoC
SoC
SoC
SoC
SoC
Up to 1000 SoCs +
High-BW Mem
(100,000 core total)
SoC
SoC
SoC
SoC
Inter-Box
Network
High Radix
Switches
NVM
NVM
NVM
NVM
NVM
NVM
NVM
NVM
NVM
NVM
NVM
NVM
NVM
NVM
NVM
NVM
Up to 1000 NonVolatile
Memory Modules (100PB total)
UC Berkeley
29
UC Berkeley
Photonic Switches
MulCplexing (WDM)
stage
of
Clos
network
(rst
and
last
Clos
stage
inside
sockets)
2K
endpoints
can
be
congured
as
either
SoC
or
NVM
modules
In
Box,
all
paths
are
two
ber
hops:
- Electrical-photonic
at
socket
- One
ber
hop
socket-to-switch
- Photonic-electrical
at
switch
- Electrical
packet
rouCng
in
switch
- Electrical-photonic
at
socket
- One
ber
hop
switch-to-socket
- Photonic-electrical
at
socket
SoC
Switch
SoC
NVM
Switch
30
UC Berkeley
Inter-Socket
Communica7on:
Old
vs.
New
Conven7onal
Wisdom
UC Berkeley
32
UC Berkeley
33
UC Berkeley
34
UC Berkeley
35
UC Berkeley
36
UC Berkeley
37
UC Berkeley
38
UC Berkeley
Number of
Switches
median
0
100
200
300
400
Number of Servers
39
UC Berkeley
150
Number of
Switches
DIABLO 1
100
50
0
0
1000
2000
3000
4000
Number of Servers
40
UC Berkeley
UC Berkeley
10
Gbps
n
n
1 Gbps
UC Berkeley
43
UC Berkeley
DRAM DIMMs
SoC
SoC
SoC
DRAM
SoC
Flash
SoC
DRAM
PCIe
FPGA
FAME-7
FAME-
7
SoC
Models
SoC
Models
High
Radix
Switch
FPGA
High
Radix
Switch
Models
Other
FPGAs
SERDES
NVM
NVM
NVM
NVM
Performance
Models
NVM
Performance
Models
PCIe
Simulated
Flash NVM
Storage
SERDES
PCIe
Simulated
NVM
Storage Flash
DIABLO
2
44
UC Berkeley
FireBox Conclusion
UC Berkeley
Acknowledgements
ASPIRE Sponsors:
46