Network Based Distributed

Computing

Presented BY: By:Peter Kacsuk

Ferenc Vijad
Basic Concepts
Computing
Super Computing
Cluster Computing
Metacomputers

2
Agenda

• From Supercomputing to the Cluster

Computing.
• From Cluster Computing to the
Metacomputing.
• Comparison of Super ,Cluster &
Metacomputing.

3
What is a Metacomputer?
A metacomputer is a collection of
◦ computers
◦ that are heterogeneous in every aspects
◦ geographically distributed
◦ connected by a wide-area network
◦ form the image of a single computer
 Metacomputing means:
◦ network based
◦ distributed supercomputing

4
 Progress in
Metacomputing
Supercomputing Network
(PVM/MPI) Computing (sockets)

Clusters
Cluster Web Computing OO Computing
computing (scripts) (CORBA)

Client/server
High-throughput High-performance
Object Web
computing computing

Metacomputing

5
 Table : Comparison of
supercomputers, clusters and
Metacomputing systems
Supercomputi Cluster Now Metacomputi
ng ng
system
Processing Microprocessor PCs, PCs, Supercomputer
units s workstations workstations s,
(nodes) clusters, PCs,
workstations

Number of 100 - 1000 10 - 100 10 - 100 100 - 10000

nodes
Communication network LAN LAN Internet
Buses, switches

Node OS Homogeneous Typically Typically Heterogeneous

homogeneous homogeneous

Inter-node Nonexistent Rarely Necessary© Peter Kacsuk

Necessary 6
Progress to the Grid
GFlops

2100 2100 2100

2100

2100 2100 2100 2100

Computers

Single Super- Cluster Meta-

processor computer computer
7
 Original motivation for
metacomputing
 Grand challenge problems run weeks and
months even on supercomputers and
clusters

• Various supercomputers/clusters must be

connected by wide area networks in order to
solve grand challenge problems in
reasonable time

8
Original meaning of
metacomputing

Super Wide area

Metacomputing = computing + network

Original goal of metacomputing:

• Distributed supercomputing to achieve

higher performance than individual
supercomputers/clusters can provide
9
 Distributed
Supercompu
ting

Caltech
NCSA Exemplar Issues:
Origin ◦ Resource discovery,
scheduling
Maui
Argonne SP ◦ Configuration
SP ◦ Multiple comm methods
◦ Message passing (MPI)
◦ Scalability
◦ Fault tolerance

SF-Express Distributed Interactive Simulation: Caltech, USC/ISI

Technologies for
metacomputers
Super- WAN Distributed
computing technology computing

Metacomputers

11
Further motivations for
metacomputing
 Betterusage of computing and other
resources accessible via wide area
network

• Various computers must be connected by

wide area networks in order to exploit their
spare cycles
• Various special devices must be accessed
by wide area networks for collaborative
work
12
Motivations for meta-
computing
To form a computational data similar to the
information data access on the web.

• Any computers/devices must be connected

by wide area networks in order to form a
universal source of computing power.

• Metacomputing

13
Technologies that led to
the Metacomputing
Super- Network Web
computing technology technology

Meta-computing

14
What is a Grid?
A Grid is a collection of
◦ computers, storage and other
devices
◦ that are heterogeneous in every
aspects
◦ geographically distributed
◦ connected by a wide-area network
◦ form the image of a single computer
Generalised metacomputing means:
◦ network based
◦ distributed computing

15
Application areas of the
Grid
Disributed supercomputing
High throughput computing
◦ Parameter studies
Virtual laboratory
◦ Collaborative design
Data intensive applications
◦ Sky survey, particle physics
Geographic Information
systems

• Teleimmersion
• Enterprise architectures
16
 Problem Solved by Metacomputing!!!
• Solved in 7 days instead of 10.9 years
• The first 600K seconds …

Number
of
workers

Time taken 17
 Generic Grid Architecture
Application Problem
Environmen Appl. Dev. Analysis & Collaboratories Solving Grid Portals
ts Environments Visualisation
Environments

OLE
Application MPI CONDOR CORBA JAVA/JINI Other...
DCOM
Support

Authentication
Co-Allocation

Authorisation

Management
Data Access

Accounting
Information

Monitoring
Sceduling

Resource
Services

Caching
Global

Policy
Fault
Grid Common
Services

Resource Management Resource Management

Grid Fabric
- local Tertiary Online Scientific
CPUs Tertiary Online Scientific Communications
resources CPUs Storage
Storage Storage
Storage Instruments
Instruments
Communications

18
 Globus Layered
Architecture
Applications

GlobusView Application Toolkits Testbed Status

DUROC MPI Condor-G HPC++ Nimrod/G globusrun

Grid Services
Nexus GRAM

I/O MDS-2 GSI GSI-FTP HBM GASS

Condor MPI Grid Fabric TCP UDP

LSF PBS NQE Linux NT Solaris DiffServ

Grid application
environments
Integrated environments
◦ Cactus
◦ P-GRADE (Parallel Grid Run-time and
Application Development Environment)
Application specific environments
◦ NetSolve
Problem solving environments
Grid portals

20
P-GRADE: Software Development and
Execution

Edit,
debugging

Performance-
analysis

Execution

Grid
© Peter Kacsuk 21
Summary
Metacomputing is a technology
which integrates:
◦ Supercomputing
◦ Wide-area network technology
◦ WWW technology

• The computational Grid will lead to a new

infrastructure similar to the electrical grid
• This infrastructure will have a tremendous
influence on the Information Society

22