Bagaimana Media Sosial Bisa

Membuat Bangsa Lebih

Cerdas?
Ismail Fahmi, PhD. KONFERENSI BIG DATA INDONESIA 2018
Drone Emprit Jakarta
Media Kernels Indonesia 13 Mei 2018
Ismail.fahmi@gmail.com
 Ismail Fahmi, PhD.
Ismail.fahmi@gmail.com

1992 – 1997 S1, Teknik Elektro, ITB

2003 – 2004 S2, Information Science, Universitas Groningen, Belanda
2004 – 2009 S3, Information Science, Universitas Groningen, Belanda

2000 – 2003 Inisiator IndonesiaDLN (Digital Library Network pertama di Indonesia)

Mengembangkan Ganesha Digital Library (GDL)
Mendirikan Knowledge Management Research Group (KMRG) ITB
Membangun Digital Library ITB

2009 – Sekarang Engineer di Weborama, Perusahaan berbasis big data (Paris/Amsterdam)

2014 – Sekarang Founder PT. Media Kernels Indonesia, a Drone Emprit Company
2015 – Sekarang Konsultan Perpustakaan Nasional, Inisiator Indonesia OneSearch
2017 – Sekarang Dosen Tetap Magister Teknik Informatika Universitas Islam Indonesia

2
Terinspirasi dari buku ini

3
1960-an
Gagal Panen di India dan Rusia
Mengejutkan Dunia

4
 Pengolahan Data Satelit

LANDSAT, Descartes Labs, dan Prediksi 5

 USDA (ratusan surveyor) v.s.
Descartes Labs (20 data scientist) 6
Smart
Using Big Data
No more large-scale surprise crop failures

7
Smart

Nation?
8
Armenia Smart Nation

Innovation
Invention
Armenia Intellectual property
Technology
Foreign affairs
Diaspora
9
Singapore Smart Nation

Through the adoption

of digital and smart
technologies

10
Indonesia: Connectivity & Content
National digital identity, e-payment, sensor platforms, urban mobility, open data: long way

Sumber:
Mastel, 2015

11
12
13
 The Idea:
Social Media as a “Modern Town Hall”

Balai Kota DKI

14
Behavior:
Twitter First

Quick and immediate source Further information

of information and analysis

15
The Problem:
Echo Chambers, Hoax, Hate Speech, Noises

SNA ‘Jokowi’

Haters Lovers

16
 Current Situation:
Vicious cycle of noises
Noise

Public Government
Buzzers Buzzers

Noise
17
Proposed Solution:
Increasing S/N Ratio

18
Proposed Model:
Social media and Big data

Signal
Big Data Analytics

Government
Policy & PR

Response,
engagement 19
Media Kernels Big Data Architecture
Data Pipeline

News Crawler Map Reduce Analytics UI

Management & Queue

Data Ingest

Data & Workflow

Twitter Crawler

Scheduled Job

Management
Realtime Job

Visualization
Processings
Processing

Processing

Sentiment
Data Insight

Analysis

Access
Other
Twitter Streaming

FB Page Crawler

Google Custom Database Framework

Search
Hadoop Framework
Other sources
SOLR Indexer 1 SOLR Indexer 2 SOLR Indexer 3 SOLR Indexer 4

Physical Hardware

20
 Social Media
Client(s)
JSON Twitter Stream Subscriber

PUSH JSON
Smart phones, Control Room
Desktops
Search + JSON

tablets Screens
Twitter

Facebook
Search + Account
Crawler
Instagram
Sentiment
Index Servers Analysis

Analyses
Online News SOLR Nodes
Shard 1 Backtrack
Detik (ID) Filters
RSS + HTML

RSS + HTML SOLR Nodes

Reuters (EN) Shard N deletes Projects
Crawler
Storage
Etc..
Cache Manager

Gatra (ID) Keywords + Mentions

Redis Queue Accounts Filters Storage
HTML

Bloomberg (EN) HTML Crawler

Etc.. Sentiment Sentiment

Converter Analysis Models

Forums Print

Kaskus Kompas
TEXT
HTML

Detik Forum Warta Ekonomi

HTML Crawler
Etc..
System Architecture
Etc..

21
Media Kernels Features
DASHBOARD ANALYTICS TOPICS INFLUENCERS SNA

Trends Media Retweets Impact Influencer Network

Comparison News Sites Replies Engagement Topic Network

Page Ranks Most Shared URLs Reach Insight Explorer

NEWS PORTAL
Sentiment Analysis Most Shared Videos Most Engaged

Topic Map PR-Values Hashtags Posts

DEMOGRAPHY

Latest News PF-Chart Topic Map Followers Twitter User Map

Engagement Word Cloud Bubble Map User Locations

MENTIONS
Exposure

Edit Sentiments Reach

ADMIN REPORTING COMPARE

Training & Learning User Management Upload Report Compare SNA

Backtracking
OPINION ANALYSIS
Project Management Download Report Compare Projects

Background Jobs Label and Training Client Management Popularity vs

Favorability
Opinion Chart Source Management

confidential
22
Why Twitter & Online News?
Cross-platform Resonance

23
Opinion Analysis
Twitter: Industry, foreign workers, lands

24
Opinion Analysis
Online News: Industry, foreign workers, education

25
Social Network Analysis
Asian Games (Case Study)

26
Asian Games Hashtags

27
Twitter
Sebaran percakapan ‘Asian Games’

28
Online News
Sebaran berita ‘Teroris’

29
Online News
Co-occurrence: person and organization

30
Online News
SPO Triples Tree Map

31
Topic Mapping
Online News Agenda Settings

32
Sentiment Analysis

33
Sentiment Analysis
Machine Learning or Dictionary Based

34
Sentiment Analysis

Positif
MENTIONS

? Negatif

Netral

35
Sentiment Analysis

Positif
MENTIONS

Untuk Setya Novanto

36
Sentiment Analysis

MENTIONS

? Negatif

Untuk KPK
37
Sentiment Analysis

MENTIONS

?
Untuk Hakim Cepi Iskandar

Netral

38
Sentiment Analysis Methods

”one model for all” tidak bisa

memberi label yang tepat untuk
setiap subyek.

Lexicon base tergantung dari

keberadaan kata dalam kamus sentimen,
tidak bisa memberi label yang tepat
untuk subyek yang berbeda.

39
http://www.sciencedirect.com/science/article/pii/S2090447914000550
Kesimpulan

“Bangsa Indonesia terjebak dalam ‘noise’

yang mempolarisasi mereka. Analisis big
data terhadap percakapan dan berita, harus
mampu menangkap ‘signal’ yang dapat
digunakan untuk membangun bangsa yang
cerdas.”

Drone Emprit

40
Terimakasih

Ismail Fahmi, PhD

Drone Emprit
PT Media Kernels Indonesia
Email: ismail.fahmi@gmail.com
Hp: 0812 8908 3894

41