CUDA

A technology that can make super-

computers personal
Presented by
Kunal Garg
2507276
UIET KU
Kurukshetra,India
SUPERCOMPUTER
A supercomputer is a computer that is at the
frontline of current processing capacity, particularly
speed of calculation.
Supercomputers are used for highly calculation-
intensive tasks.
Space for supercomputer pic
GPU
A graphics processing unit or GPU
(VPU) is a specialized processor that
offloads 3D or 2D graphics rendering
from the microprocessor.
Used in embedded systems,
mobile phones, personal computers,
workstations, and game consoles
GPU Computing
The excellent floating point
performance in GPUs led to
the advent of General Purpose
Computing on GPU’s(GPGPU)
GPU computing is the use
of a GPU to do general
purpose scientific and
engineering computing
The model for GPU
computing is to use a CPU
and GPU together in a
heterogeneous computing
model.
 Problems in
GPU Programming
Required graphical languages
Difficult for users to program applications for GPU
CUDA
CUDA is
an acronym for Compute Unified Device
Architecture
a parallel computing architecture
computing engine
CUDA
CUDA with industry-standard C
 Write a program for one thread
 Instantiate it on many parallel threads
 Familiar programming model and language
CUDA is a scalable parallel programming model
 Program runs on any number of processors
without recompiling
Advantages of CUDA
CUDA has following advantages over
traditional GPGPU using graphics APIs.
Scattered reads
Shared memory
Faster downloads and readbacks to and from the GPU
Full support for integer and bitwise operations
CUDA Programming Model
Parallel code (kernel) is launched and executed
on a device by many threads
Threads are grouped into thread blocks
Parallel code is written for a thread
 Each thread is free to execute a unique code path
 Built-in thread and block ID variables
CUDA Architecture
The CUDA Architecture
Consists of several
components

Parallel compute engines

OS kernel-level support

User-mode driver

ISA
Tesla 10 Series

CUDA Computing with Tesla T10

240 SP processors at 1.45 GHz: 1 TFLOPS peak
30 DP processors at 1.44Ghz: 86 GFLOPS peak
128 threads per processor: 30,720 threads total
Thread Hierarchy
Threads launched for a parallel section are section
are partitioned into
thread blocks
 Grid = all blocks for a given
launch
Thread block is a group of
threads that can
 Synchronize their execution
 Communicate via shared
memory
Execution Model
Warps and Half Warps
GPU Memory Allocation / Release
Host (CPU) manages device (GPU) memory:
cudaMalloc (void ** pointer, size_t nbytes)
cudaMemset (void * pointer, int value, size_t
count)
cudaFree (void* pointer)
Next Generation CUDA Architecture
The next generation CUDA architecture, codenamed
Fermi is the most advanced GPU architecture ever
built. Its features include
• 512 CUDA cores
• 3.2 billion transistors
• Nvidia Parallel Datacache Technology
Nvidia Gigathread Engine
ECC Support
Applications
Accelerated
rendering of
3D graphics
Video Forensic
Molecular Dynamics
Computational Chemistry
Life Sciences
Bioinformatics
Electrodynamics
Medical Imaging
Oil and gas
Weather and Ocean Modeling
Electronic Design Automaton
Video Imaging
Video
Acceleration
Why should I use a GPU as a Processor
When compared to the latest quad-core CPU, Tesla 20-
series GPU computing processors deliver equivalent
performance at 1/20th the power consumption and
1/10th the cost
When computational fluid dynamics problem is
solved it takes
 9 minutes on a Tesla S870(4GPUs)
 12 hours on one 2.5 GHz CPU core
Double Precision Performance
 Intel core i7 980XE is 107.6 GFLOPS
 AMD Hemlock 5970 is 928 GFLOPS (GPU)
 nVidia's Tesla S2050 & S2070 is 2.1 TFlops - 2.5 Tflops(GPU)
Tesla C1060-933 GFLOPs (GPU)
GeForce 8800 GTX - 346 GFLOPs(GPU)
Core 2 Duo E6600 - 38 GFLOPs
Athlon 64 X2 4600+ - 19 GFLOPs
After all, it’s your personal supercomputer
Bibliography