Big Data Real Time Low Latency

Ecole Polytechnique June 9th 2011

1

Agenda

Big Data The Challenge Current Approaches ParStream A HPC Database for Big Data Use Cases

Big Data The amount of digital information increases tenfold every five years
We are at a different period because of so much information, says James Cortada of IBM ..what is scarce is the ability to extract wisdom from them., Hal Varian, Googles chief economist Every day I wake up and ask, how can I flow data better, manage data better, analyse data better?, says Rollin Ford, the CIO of Wal-Mart. The data-centered economy is just nascent, admits Mr. Mundie of Microsoft.

Big Data Analyzing big datawill become a key basis of competition, underpinning new waves of productivity growth, innovation, and consumer surplus
Making big data more accessible in a timely manner Using data and experimentation to expose variability and improve performance Segmenting populations to customize actions Replacing and supporting human decisionmaking with automated algorithms Innovating new business models, products, and services.

Challenges in Big Data Analytics There are challenges in Big Data Analysis in different dimensions

Billions of Records

Thousands of Columns

Concurrent Queries

Real Time & Low Latency

Complex Queries

Big Data eCommerce & Web Analytics

Big Data Social Media Analytics

Big Data in Telecommunications Billing, Pricing, Fraud detection

Big Data in Utilities Smart meetering & Smart grid

Big Data in Finance Share Prices History, Fraud Detection, Algo-Trading

10

Big Data in other Industries Retail, Telematics, Science, Mining

11

Established Databases Current databases are not engineered for mass-data

Existing Database Architectures are 20-30 years old and are not able to cope with current data sizes. Several Statements on Conference for Very Large Databases VLDB 2010, Singapore

12

Hadoop Ecosystem Some New approaches not suitable for Realtime Processing

MapReduce isn't suited to calculations that need to occur in near real-time. You can't do anything that takes a relatively short amount of time, so we got rid of it. Lipkovitz, Senior Director of Engineering, Google

13

Big Data Threat Big Data Analysis requires new engines

14

Big Data products New Marketplayers and their downsides

No Partitioning No Index, Postgres based

Map Reduce approach

Hardware bound

No Index

No Index

15

Big Data New Market Players and their setbacks

No Partitioning No Index, Postgres based

Map Reduce approach

Hardware bound

No Index

No Index

16

ParStream

The first HPC Database focusing on the Real-Time Analysis of Big Data

17

ParStream Building Blocks ParStream combines state of the art database technologies with unique technologies

Column Store Fast data access for analytical processing

In-Memory Technology Data and indices can stay in memory due to efficient compression

High Performance Index Unique index structure allows highly parallel execution of queries

Custom Query Operators SQL, JDBC and powerful C++ API enable fast query processing

Patent Pending High USP

18

High Performance Indexing Fast and flexible analytics through highly compressed and partitioned Bitmap-Indexes
Big Data Index Compression Partition

Paralell Excecution

19

High Level Technical Architecture ParStream is a complete database on a highly optimized architecture
High Speed Import & Index Compression Partitioning Caching Parallelization

ParStream ParStream Data Data Source Source Data Data Source Source Data Data Source Source ETL ETL ETL Loader Query Query ETL Roworiented record store Columnoriented record store Index Store Query Logic

Results Results

ETL ETL

Singe Servers / Clusters / Clouds with CPUs & GPUs

20

ParStream - Product Features ParStream is optimized for all challenges in Big Data analysis
Scalability

Low Latency Queries include new data immediately after continuous import

Clustering Clustering

Scalability

Editions Editions SW Package for Linux on Standard HW (Windows upc.) GPU Server Appliance

Configurable ParStream partitioning scales linearly allows horizontal up to PetaByte and vertical clustering (fault tolerant)

21

GPU Processing motivation

Graphical Processing Units (GPUs) outperform standard processors

22

Cloud Ready ParStream delivers outstanding performancen all infrastructure Setups

23

Performance ParStream vs PostgreSQL

ParStream delivers in sub-seconds even on > 100 million rows ParStream clearly dominates PostgreSQL and others

PostgreSQL (blue) reaching its limits

100 90 80 1,0 0,9 0,8

ParStream delivering in sub-second

Response Time [sec]

70 60 50 40 30 20 10 0 0 20 40 60 80 100 120 140 160 180

Response Time [sec]

0,7 0,6 0,5 0,4 0,3 0,2 0,1 0,0 0 20 40 60 80 100 120 140 160 180

Number of Rows [Millions]

Number of Rows [Millions]

24

Explorative analytics on billions of records ParStream analyzes billions of records within milliseconds

Case: Web Analytics Unique Visitor Calculation (select count distinct) Analysis of 8 billion records in 15 ms on 4-server cluster

25

Flexible analytics on thousands of columns ParStream allows quering data by selecting any combination of different columns

Case: Market Research Pattern recognition Flexible multi-column filtering & grouping 20 million records with 1000 data columns
> 1000 Columns

5000 queries in 5 seconds

26

Concurrent queries and high throughput ParStream can execute many queries efficiently at the same high throughput

Case: Online Travel Search High throughput even with complex filter & sorting criteria 100 queries per second per node on 1 billion travel offers Throughput scales linearly with number of nodes

27

Use case: travel search engine

Comparison for a search appliance delivering 100 travel offers out of 1 billion based on 25 independent, optional filter criteria Response Time
6,5 sec

Memory Requirements

factor 1000 factor 80

~ 5000MB for each query

~ 5MB for each query

0,08 sec

25
Database X

Index size

24
Parstream
28

Database X

Parstream

Use case: travel search engine

Server Requirements

400 Servers

Sizing for a search appliance executing 1000 queries per second to deliver 100 travel offers out of 1 billion based on 25 optional filter criteria

factor 20
20 Servers

Database X

Parstream
29

Instant analytics on up-to-the-second data Simultaneous data import and querying allows comparison of current & historical data

Case: Web Analytics Continuous import of newly created data every second Simultaneous import and querying
Data partitions Historic A1 B1 C1 Index partitions A1 A2 B1 B2 C1 C2 Queries New

Single node performance typically 1TB per hour Continuous trend spotting for alert-function

Webserver A2 B2 C2

Continous Consolidation

30

Advanced analytics Standard SQL features and custom query nodes provide maximum flexibility and speed

Case: Climate Research Identification of hurricane risk areas Geo-clustering with customized query node Implementation of custom algorithms via C++ API Analysis of 3 billion records in 100 ms

31

Testimonials Leading experts, customers and hardware providers have realized the benefits of ParStream
Experts are impressed An extremely innovative idea Convinced me completely 2 years ahead of competition
Prof. Dr. Markl, leading database expert at TU Berlin, Formerly at IBM for DB2 optimization

Customers are satisfied Outperforms all databases by a factor of at least 35 Reduced our response time by factors up to 12.000 Scales linearly, runs stable in production
Leading web-analytics company

Awards One to watch award 2010 from Nvidia, Cooley & Adobe First database running on high-performance GPUs
32

Summary

Analyzing Big Data is getting more and more important for every industry Existing Database Architectures are 25-30 years old and not designed for Big Data New approaches often do not fulfill promises ParStream is a new powerful database, specifically designed for Big Data Analysis
33

Contact

Questions ?
joerg.bienert@parstream.com Phone +49 221 97 76 14 80
34