H2OEIN: A HIERARCHICAL HYBRID OPTICAL/ELECTRICAL

INTERCONNECTION NETWORK FOR EXASCALE

COMPUTING SYSTEMS
PRESENTED BY: ATHULYA KRISHNAN

IDK16CS025

GUIDED BY : Ms. GREESHMA A

AP, CSE DEPT

 CONTENTS

❑ WHAT IS HPC?
❑ INTRODUCTION
❑OBJECTIVES
❑PROPOSED INTERCONNECT ARCHITECTURE
❑ROUTING ALGORITHM FOR ELECTRICAL PACKET SWITCH
❑ROUTING ALGORITHM FOR HSWITCH
❑EXISTING INTERCONNECTS
❑PERFORMANCE STUDIES
❑CONCLUSION
❑REFERENCES
 INTRODUCTION

• A high-performance computer (HPC system) is a tool used by computational scientists and

engineers to tackle problems that require more computing resources or time.
• HPC systems range in size from the equivalent of just a few personal computers to tens, or
even hundreds of thousands of them.
• They are expensive to buy and operate.
• Applications of HPC varies throughout different domains like astronomical sciences,
atmospheric sciences, molecular research, cloud computing etc. .
• This further leads to tremendous increase in cost and power consumption.
• The performance of the HPC system depends largely on interconnect.
• The cost and power consumption in the interconnect is to a large extent determined by
the number of switches and links.
• The extraordinary growth in switch capacity has led to the rapid development and
widespread utilization of high-radix routers.
• Optical interconnect reduces cost and power consumption, but it also offers the
advantages of higher bandwidth, reduced interference and crosstalk.
 OBJECTIVES

The interconnect must provide :

• Good scalability
• Cost effectiveness
• Low latency
• Reduced number of links and switches
• Improve network performance
• Reduced network complexity over expansion
 PROPOSED INTERCONNECT ARCHITECTURE
• Proposed architecture has 4 layers:
• BASIC UNIT
• 8 TRADITIONAL ELECTRICAL PACKET SWITCHES
• 1 HYBRID OPTICAL-ELECTRONIC PACKET SWITCH
• 2 PAIRS OF OPTICAL TRANSCEIVERS

• GROUP
• 8 BASIC UNITS
• CLUSTERS
• N GROUPS
• SYSTEM
• (N+1) CLUSTERS
 AWGR
• Arrayed waveguide grating router (AWGR) is
a device that can forward information based
on the wavelength of the signal.
• AWGR can achieve all to all communication
without contention.
• Because of its high reliability and large port
count, AWGR has become a switching device
of increased interest in optical interconnects.
• AWGR can achieve high bandwidth and
nonblocking switching.
& LOW-RADIX ROUTER
• Low-radix router (low-level router) has been
widely used in the traditional parallel
interconnection networks.
• Its transmission medium is electric, with a
number of ports.
• Large and thick ports.
• Low latency compared to high radix switch.
 BASIC UNIT AND GROUP

Fig 1 : (a) The basic unit consists of eight electrical packet switches and one HSwitch
(b) the group is connected by eight HSwitches in the different basic units
• The serial number of the surrounding electrical packet switches Id1 and itself Id0 in the basic
unit are used to make the connection rules. First, the switches in the basic unit are divided
into two parts by the following equation:
F = Id1/4−Id0/4
• If F equals 0, the local switch and its connected switch are in the same plane, otherwise they
are not. After getting the value of F, the port number of the local switch is determined by the
next equation:
G = Id1%4−Id0%4
 CLUSTER

Fig 2 : The cluster with N=3, there are three groups and eight AWGRs in H2OEIN.
• If N is 4, there will be four groups in a cluster and the port count of each AWGR needs to
increase to connect another eight HSwitches in the additional group.
• The AWGR Id is represented by Ai. The N ports of the AWGR in the cluster are indexed from
0 to N − 1 and port ID is represented by Pj.
• The groups in the cluster are numbered from 0 to N−1and group ID is represented by gk.
• The ID of the HSwitches in the same group is represented by Hl. The port Pj in the AWGR Ai
is used to connect the HSwitch Hl in the group gk.
• The connection rule is l = i and k = j.
Fig 3: In the H2OEIN (N = 3) network, the system consists of 4 clusters, and the different
clusters are connected with inter-cluster bridge
 SYSTEM
• Each AWGR in the system has 16 optical links to connect the HSwitches of the two
communicating groups in the different clusters, and the AWGR used for the communication
between clusters is referred to as the inter-cluster bridge.
• In the link bundle of the HSwitch, the remaining two links are optical cables and one of them is
used to link the AWGRs for intra-cluster communication.
• The serial number of the port used to connect the AWGR in the cluster is 15 and for inter-
cluster communication is 16.
Qswitch·H2OEIN = N(N + 1)/2 + 8(N + 1) + 8N(N + 1) + 64N(N + 1)
Qport·H2OEIN = Nk’A(N + 1)/2 + 8kA(N + 1) + 8Nk’(N + 1) + 64Nk(N + 1)
Qnode·H2OEIN = N(N + 1)×8×8×m
 ROUTING ALGORITHM FOR ELECTRICAL PACKET SWITCH
• The packet format for the Start
destination address as
(Dc,Dg,Du,De,Ds) where Dc, Dg,
Get information of packets
Du, De, and s are the destination and electrical packet switch
address of the cluster, group, basic
unit, electrical packet switch and H
Dc=Lc &
computing node respectively. Dg=Lg & NO
Du=Lu?
• The electrical packet switch is Y
described using the four tuple E
S
(Lc,Lg,Lu,Le), which indicates the
De=Le? NO
location of the cluster, group, basic
unit, and electrical packet switch in
Fig 4: Flowchart for the routing algorithm in the
the network. electrical packet switch
ROUTING ALGORITHM FOR HSWITCH

Fig.5: Flowchart for the routing algorithm in the HSwitch

 EXISTING INTERCONNECTS
Fat tree 3D Torus Dragonfly
K-ary tree with usually 3 layers: Unequal link lengths. Hierarchical clustering of nodes.
core , aggregation and access. It is a (a,p,h) network.

Nmax=(Pe*Pc/2) servers Composed of short wrap around Nodes in each cluster have direct
links. connections.
The number of uplinks and Scalable as compared to other High scalability and focus on
downlinks are in proportion of 1:1. networks. reducing long links.

Wiring complexity in large Bisection bandwidth shrinks with Each group can have a different
networks. expansion of topology. topology.
Cost and power consumption also Require high-radix routers because
highest. of the large number of ports
needed per router.
E.g.: TH-2,Cray X2 E.g.: Titan supercomputer E.g.: Cori Supercomputer
 PERFORMANCE STUDIES

Fig 9(a)-(c):Comparison of the number of links, switches, and switch ports in four networks
Fig 10.: Comparison of the cost and power consumption in four networks.
 CONCLUSION

• H2OEIN performs. better than the other interconnects to achieve acceptable performance.

• The proposed interconnect (H2OEIN) is a scalable, low-latency, high-throughput and cost-effective

interconnect architecture for exascale computing.
• Moreover, the port count and connectivity relationship of most switches will not change when the
network grows in size.
• A 25% reduction in cost and a 50% reduction in power consumption can be achieved with the scale
of 300,000 nodes compared with the dragonfly network.
 REFERENCES
1) Yunfeng Lu, Huaxi Gu, Krishnendu Chakrabarty and Yintang Yang,” A Hierarchical Hybrid
Optical/Electrical Interconnection Network for Exascale Computing Systems”, IEEE
Transactions On Multi-scale Computing Systems
2) Md Atiqul Mollah, Peyman Faizian, Md Shafayat Rahman, Xin Yuan, Scott Pakin, Mike Lang,
”A Comparative Study of Topology Design Approaches for HPC Interconnects”, 2018 18th
IEEE/ACM international symposium on cluster, cloud and grid computing.
3) Christopher Nitta, Roberto Proietti, Yawei Yin, S. J. Ben Yoo, Matthew Farrens, and Venkatesh
Akella, “Leveraging AWGR-based Optical Packet Switches to Reduce Latency in Petascale
Computing Systems”, Technical report CSE-2013-68.
4) https://www.cs.cornell.edu/courses/cs5413/2014fa/lectures/08-fattree
5) http://parallelcomp.github.io/Lecture3.pdf