Вы находитесь на странице: 1из 16
in#conjunc(on#with# Data Management & Warehousing http://www.datamgmt.com
in#conjunc(on#with#
Data Management & Warehousing
http://www.datamgmt.com

What#is#the#Spa(al#Module?#

What#is#the#Spa(al#Module?# •   It’s#the#ability#to# analyse #informa(on#in#a# geographic#context:# –  

It’s#the#ability#to#analyse#informa(on#in#a# geographic#context:#

Where#is#the#nearest#petrol#sta(on?# Which#road#am#I#on?# How#many#ATMs#are#in#this#area?#

It’s#not#maps#and#images#

These#come#later#with#tools#that#help#present#the# informa(on#

The#three#types#of#data#&#many#ques(ons#

•   Points# –   OS#Grid# –   La(tude#&#Longitude## •   Lines# –   Pairs#of#points#
•   Points#
–   OS#Grid#
–   La(tude#&#Longitude##
•   Lines#
–   Pairs#of#points#
–   e.g.#Road#Segments#
•   Polygons#
–   e.g.#Road#Segments# •   Polygons# –   A#series#of#points#that# define#a#boundary# –

A#series#of#points#that# define#a#boundary# e.g.#Postcode#Boundaries#

How#close#are#two# points?# Does#a#point#touch#a# line?# Is#a#point#inside#or# outside#a#polygon?# Does#a#line#cross#a# polygon?# How#many#points#are#in# a#polygon?#

Using#Spa(al#Data#Is#Complex#

Using#Spa(al#Data#Is#Complex# •   Different#distances# between#points#at# different#longitudes#and# la(tudes# •

Different#distances# between#points#at# different#longitudes#and# la(tudes# Measurement#over#a# curved#irregular#surface# Mul(ple#input#and#output# formats# Mul(ple#coZordinate# systems#see:

A#Guide#to#Coordinate#

Systems#in#Great#Britain # #

A#Guide#to#Coordinate# Systems#in#Great#Britain # # Wednesday,#July#28,#2010#

Sources#of#Informa(on#–#GPS#

Sources#of#Informa(on#–#GPS# •   In#Car#Device# –   Sends#frequent#data#sets#to# processing#centre# –

In#Car#Device#

Sends#frequent#data#sets#to# processing#centre# Point#Data#

Speed,#Direc(on,## Loca(on#and#GZforce#

Aggregate#Data#

Speed#and#Direc(on#

Other#Devices#

Sat# Nav#Systems# Smart#Phone#Apps## e.g.#‘GPS#Tracker’# Cameras#

e.g.#‘GPS#Tracker’# –   Cameras# Wednesday,#July#28,#2010#
e.g.#‘GPS#Tracker’# –   Cameras# Wednesday,#July#28,#2010#
e.g.#‘GPS#Tracker’# –   Cameras# Wednesday,#July#28,#2010#

Sources#of#Informa(on#–#Ordnance#Survey#

Sources#of#Informa(on#–#Ordnance#Survey# •   Integrated#Road#Network:# A#series#of#3#million# ‘linestrings

Integrated#Road#Network:#

A#series#of#3#million#

‘linestrings ’#and#17#million# points#that#describe#every# road#in#the#UK# Linestrings#have#between#2#

and#655#points,#most#have#

less#than#10#

23#points#for#this#picture###

less#than#10# •   23#points#for#this#picture### Wednesday,#July#28,#2010#

Sources#of#Informa(on#–#Post#Office/ GAdm#

Sources#of#Informa(on#–#Post#Office/ GAdm # •   Postal#Address#File:# A#series#of#c.1.75M#UK# postcodes# –  

Postal#Address#File:#

A#series#of#c.1.75M#UK#

postcodes#

Postcode#Boundaries## Over#28M#complete# addresses#

Global#Admin#Boundaries#

Na(onal#and#regional#

boundaries#for#c.245#

countries# hgp://www.gadm.org##

countries# –   hgp://www.gadm.org ## Wednesday,#July#28,#2010#

Data#Layers#–#Enriching#what#you#have#

Data#Layers#–#Enriching#what#you#have# •   Data#Layers#are#sets#of#informa(on#(ed#to#a# geographic#point# –  

Data#Layers#are#sets#of#informa(on#(ed#to#a# geographic#point#

Road#Speed#for#a#given#road#segment# ATM#Loca(on# House#Price#for#a#postcode#

Where#data#has#loca(on#informa(on#it#is# known#as#‘GeoZtagged’#

Data#Layer#Sources#(1)#

Data#Layer#Sources#(1)# •   Ordnance#Survey# –   Road#Types,#Limits,#Closures,#etc.# •   Government# –

Ordnance#Survey#

Road#Types,#Limits,#Closures,#etc.#

Government#

UK#Government#now#providing#masses#of## geoZtagged#info#( hgp://data.gov.uk)#

Met#Office#/#HM#Nau(cal#Almanac#Office##

Weather,#Daylight#to#Postcode#Level#

Data#Layer#Sources#(2)#

Data#Layer#Sources#(2)# •   Wikipedia# –   GeoZtag#Access#API#–#what’s#nearby?# •   Google#Maps# –

Wikipedia#

GeoZtag#Access#API#–#what’s#nearby?#

Google#Maps#

Road#level#photographic#images#

Commercial#Sources#

Fast#Food#Outlets,#Supermarkets,#Petrol#Sta(ons,#ATMs,# etc.#

Massive#growth#in#both#commercial#and#public#domain# geoZtagged#data#

Issues#with#GeoZtagged#data#

Issues#with#GeoZtagged#data# •   GeoZtagging#uses#different#formats# –  

GeoZtagging#uses#different#formats#

Longitude#&#La(tude,#OS#Grid#Reference,#etc#

GeoZtagging#at#different#levels#

Data#for#a#postcode#or#a#an#en(re#county#which#makes# it#difficult#to#compare#

GeoZtagging#coverage#is#patchy#and/or#historic#

Rate#of#change#of#fine#detail#data#is#very#high## e.g.#OS#issues#monthly#updates#to#the#UK#mapping#

Mul(ple#standards#and#formats#

XML#&#CSV,#different#file#formats,#etc.##

Our#Model#For#Delivering#Spa(al#Data#

Our#Model#For#Delivering#Spa(al#Data# Source# Source# Source# Source# Source# Source# 1.  

Source#

Source# Source# Source# Source# Source# Source#

Source#

Source# Source# Source# Source# Source# Source#

Source#

Source# Source# Source# Source# Source# Source#

Source#

Source# Source# Source# Source# Source# Source#

Source#

Source# Source# Source# Source# Source# Source#

Source#

1. Load#Mul(ple#File#Formats# 2. Standardise#GeoZTagging# 3. Extract#&#Load#CSVs# 4. Perform#Spa(al#Analysis# 5. Create#User#Access#Area#

1#

(Small)#

Postgres#

Database#

2#

3#

Netezza#

#(Proximity,#Contains,#Excludes)#

Spa(al#Analysis#

Netezza# #(Proximity,#Contains,#Excludes)# Spa(al#Analysis# 4# 5#

4#

5#

Spa(al#Presenta(on# (Sets#of#data#with#spa(al# agributes)# Query#&#Presenta(on#Tools# (Tableau,#Google#Maps,#etc.)#
Spa(al#Presenta(on#
(Sets#of#data#with#spa(al#
agributes)#
Query#&#Presenta(on#Tools#
(Tableau,#Google#Maps,#etc.)#

Netezza#Spa(al#Value#Add#

Netezza#Spa(al#Value#Add# •   Netezza#Spa(al#is#fast ' –   Analysis# •   Look#up#a#typical#18#point#

Netezza#Spa(al#is#fast'

Analysis#

Look#up#a#typical#18#point#

trip#in#the#3M#linestrings#to#

find#the#roads#that#the# vehicle#was#on#in#less#than#

1#second#

Overnight#batch#process#of#

300,000#points#to#matching#

road#names#in#under#30#

minutes#

Presenta(on#

Tools#rely#on#fast#query# access#to#render#any# queried#map#with#subZ second#response#(mes#

Netezza#Spa(al#is#easy#

Distance#and#proximity# calcula(ons#are#simple# ‘Touches’,#‘Overlaps’#&# ‘Contains’#queries#allow# instant#value#add##

Netezza#Spa(al#integrates#

Works#well#with#Tableau# Easy#to#generate#KML#for# use#with#Google#Earth#and# Google#Maps#

Netezza#Spa(al#Limita(ons#

Netezza#Spa(al#Limita(ons# •   Fails#the# Slar(barpast#Test :# –   Polygons#for#very#detailed#maps#

Fails#the#Slar(barpast#Test:#

Polygons#for#very#detailed#maps# are#too#big#to#be#loaded#as# Netezza#limits#the#maximum#

block#size#to#64000#characters#

Named#aqer#the#HitchZHikers# Guide#to#the#Galaxy#coastline# designer#responsible#for#the# twiddly#bits#around#the# Norwegian#rords#

WorkZaround:#

Use#regional#boundaries#(e.g.# UK#Coun(es,#US#States,#etc.)# and#then#aggregate#into# na(onal#boundaries# If#a#point#is#in#Berkshire#then#by# defini(on#it#is#also#in#England #

Norway# Slar(barpast#
Norway#
Slar(barpast#

Wednesday,#July#28,#2010#

©#2010#Data#Management#&#Warehousing#

Page#14#

Current#Uses#…#

Current#Uses#…# •   M/A/B#road#driving#profiles# •   Time#of#day#driving#profiles# •  

M/A/B#road#driving#profiles# Time#of#day#driving#profiles# Speed#Limits#vs.#Driven#Speed# Matching#GPS#posi(ons#to#road#names# Out#of#bounds#driving# Customer#Demographic#Profiles#

# …#but#this#is#only#the#start#in#a#very#short#(me#

in#conjunc(on#with# Data Management & Warehousing http://www.datamgmt.com
in#conjunc(on#with#
Data Management & Warehousing
http://www.datamgmt.com