Вы находитесь на странице: 1из 55

Geospatial Data Science

Made it Easy with ArcGIS


ArcGIS
WITTAWAT BUNNASARN TOSPOL TOOMMALA
GIS Technical Specialist Senior GIS Technical Consultant
Esri Thailand Esri Thailand
CONTENTS 01 Understanding Data Science
Why It is So Important?
Data Science Use Cases

02 How Data Science works in


GIS with ArcGIS technology?
• ArcGIS Pro
• Insights for ArcGIS
• ArcGIS Notebooks

03 Resources to learn more


User Guidance

2
01
Understanding Data Science and
Why It is So Important

3
Why we need Data Science
How many of the black dots
at intersections?

Human brain won't let us see


12 black dots
at intersections
what else we miss?

4
Understanding Data Science

Machine
Learning
Computer Math and
Science/IT Statistics

DATA
SCIENCE

Software Traditional
Development Research

Business
Knowledge

5
5
Understanding AI, ML, DL

Caffe
Object
Artificial Intelligence Detection
Object Tracking
T-SNE
Support Vector Machines
Natural Language
Processing Machine Neural Networks
Random Forest
Learning
Cognitive Computer Vision
Computing Theano
Keras
Dimensionality
CNTK Reduction
GeoAI Deep
scikit-learn Learning TensorFlow

6
Understanding AI, ML, DL

ARTIFICAL
INTELLIGENCE
Early artificial intelligence MACHINE
stirs excitement LEARNING
Machine learning begins To flourish DEEP
LEARNING
Deep learning breakthroughs
Drive AI born

7
1950’s 1960’s 1970’s 1980’s 1990’s 2000’s 2010’s
Workflow of Machine/Deep Learning

Create Training Train Perform Inference


Samples Model Ex. Detect objects

1 2 3
8
Use Cases By Machine Learning
Targeted Advertising

9
Use Cases By Machine Learning
Website Recommendations

10
Use Cases By Deep Learning
Advanced Image Recognition

11
02
How Data Science works in GIS
with ArcGIS technology?

12
Integrating Open Science, AI and
Machine Learning

Analytic Services Python API


Integration

Big Data AI & Machine Learning


GeoAnalytics

Spatial Analysis Open Science Tools


& Geoprocessing
Geospatial
Infrastructure

Revolutionizing Spatial Analysis and Data Science


13
ArcGIS Standard Tools

Clustering Prediction
• Density-based Clustering • Ordinary Least Squares and
• Spatially Constrained Exploratory Regression
• Multivariate Clustering • Empirical Bayesian Kriging
• Hot Spot Analysis • Areal Interpolation
• Cluster and Outlier Analysis • EBK Regression Prediction
• Space Time Pattern Mining • Geographically Weighted
Regression

ArcGIS

Classification
• Maximum Likelihood • Generate training samples
• Pixel & Object Based • Detect objects
• Image Segmentation • Classify pixels
• Random Trees
• Support Vector Machine
14
ArcGIS Standard Tools

Clustering Prediction

The grouping of observations


based on similarities of values or locations
ArcGIS

Classification

15
Standard Tools in ArcGIS Pro
Clustering Tools

16
16
Standard Tools in ArcGIS Pro
Clustering Tool - How HDBSCAN Works

Noise HDBSCAN
Minimum Points = 4

Noise

Noise
Noise

Noise
Noise

17

17
Standard Tools in ArcGIS Pro
Clustering Tools

Density-based
Clustering

HDBSCAN

18
Standard Tools in ArcGIS Pro
Clustering Tools

Density-based
Clustering

HDBSCAN

19
Standard Tools in ArcGIS Pro
Clustering Tools

Density-based
Clustering

HDBSCAN

20
ArcGIS Standard Tools

Clustering Prediction

ArcGIS
Classification
Machine Learning Deep Learning

21

The process of deciding to which category an object should be assigned


Standard Tools in ArcGIS Pro
Classification tools using machine learning

Train Support Vector


Machine Classifier
*Spatial Analyst license
*Image Analyst license

22
Standard Tools in ArcGIS Pro
Classification tools using machine learning

Train Support Vector


Machine Classifier
*Spatial Analyst license
*Image Analyst license

23
Standard Tools in ArcGIS Pro
Classification tools using machine learning

Train Support Vector


Machine Classifier
*Spatial Analyst license
*Image Analyst license

24
Standard Tools in ArcGIS Pro
Classification tools using machine learning

Train Support Vector


Machine Classifier
*Spatial Analyst license
*Image Analyst license

Farm Water Built Area ActiveCrop


25
ArcGIS Standard Tools

Clustering Prediction

ArcGIS
Classification
Machine Learning Deep Learning

26

The process of deciding to which category an object should be assigned


Standard Tools in ArcGIS Pro
Swimming pool detection and classification using deep learning

27
Standard Tools in ArcGIS Pro
Swimming pool detection and classification using deep learning

Deep Learning
Workflow

1.Create
Training
Samples

2.Train
Model

3.Perform
Inference

28
Standard Tools in ArcGIS Pro
Swimming pool detection and classification using deep learning

Deep Learning
Workflow

1.Create
Training
Samples

2.Train
Model

3.Perform
Inference

29
Sample training data from Export Training Data For Deep Learning tool
Standard Tools in ArcGIS Pro
Swimming pool detection and classification using deep learning

Deep Learning Deep Learning

Workflow
USA NAIP Imagery False Color
1.Create
Training Swimming pool from DL
Samples
esri_model_definition.emd

2.Train
Model

3.Perform
Inference

30
ArcGIS Standard Tools

Clustering Prediction

ArcGIS Using the known to estimate the unknown

Classification
Machine Learning Deep Learning

31
Standard Tools in Insights for ArcGIS
Opening Location Analytics to Everyone

Link Charts
Spatial /
Analytics Charting Temporal
Spatiotemporal Bar, Column,
Statistics Pie, Scatter,
Mapping Predictions Box, Data Clock,
Thematic Link Analysis Heat . . .
Smart Mapping
New and Improved

• Link Analysis
Charts
• Presentations & Reports
• Public Sharing
• Python & R Integration

Exploratory Mapping & Analysis

Providing Powerful Data Visualization and Analytics . . . 32


Standard Tools in Insights for ArcGIS
How Regression Analysis works
House Prices per Square Metre Prices (฿)
SQ M Prices

20 200,000 350,000
300,000
25 250,000
250,000
30 300,000

35 ? 200,000
SQ M
20 25 30 35
Prices (฿)

R Squared = 1- error

33

SQ M
Standard Tools in Insights for ArcGIS
Regression Analysis in Insights

34
Standard Tools in Insights for ArcGIS
Regression Analysis in Insights

35
Scripting in Insights
Extend your analysis using Python and/or R

PASS DATA TO/FROM INSIGHTS

BUILD SCRIPTING ENVIRONMENT

INCLUDE SCRIPTS IN MODELS

36
Scripting in Insights
Demo

37
38
ArcGIS Standard Tools

Clustering Prediction

ArcGIS

Classification

39
ArcGIS Notebooks
For Integration, Modeling, and Automation Scripting

It is a web-based, interactive, computational environment for you


to write, document, and run code all in one place. 40
ArcGIS Notebooks
ArcGIS Notebooks sits at the intersection of open data science and ArcGIS

Open Source
Python & Data Science

ArcGIS
• ArcGIS API for Python
• ArcPy
• Analytics
• Geoprocessing
• Web GIS analysis
• GeoAnalytics*
• Raster Analytics*

41

*Tools only available with a license of GeoAnalytics Server and Image Server, respectively
ArcGIS Notebooks
Seamless integration with the portal

You can open a new notebook from the portal by clicking Notebook.

42
ArcGIS Notebooks
Included various sample notebooks

43
ArcGIS Notebooks
Come with more than 25 sample notebooks

44
Example use case in Notebooks
Identify unusual patterns of PM2.5 stations

PM 2.5
45
Example use case in Notebooks
Identify unusual patterns of PM2.5 stations

46
Example use case in Notebooks
Identify unusual patterns of PM2.5 stations

47
Example use case in Notebooks
Identify unusual patterns of PM2.5 stations

48
ArcGIS Notebooks
Demo

49
50
51
User Guidance

ArcGIS Insights ArcGIS


Pro for ArcGIS Notebooks

GIS Analysts Data Analysts Developers

Data Preparation/ Exploratory Scripting


Analysis Analysis Advanced Analysis

Desktop Web-based Web-based


52
Resources to learn more

ArcGIS Pro
- https://esri.com/pro
- https://pro.arcgis.com/en/pro-app/help

ArcGIS Notebooks
- https://enterprise.arcgis.com/en/notebook

Insights for ArcGIS


- https://esri.com/insights
- https://doc.arcgis.com/en/insights

53
Questions?

54
WITTAWAT BUNNASARN TOSPOL TOOMMALA
GIS Technical Specialist Senior GIS Technical Consultant
wittawat.b@cdg.co.th tospol.t@cdg.co.th

Вам также может понравиться