Академический Документы
Профессиональный Документы
Культура Документы
Part 1: Introduction
to Internet of Things
Internet of Things
Source: CISCO
55
Source: Stephan Haller, Internet of Things: An integral Part of the Future Internet, SAP Research, 2009.
Application domain
Adapted from: W3C Semantic Sensor Networks, SSN Ontology presentation, http://www.w3.org/2005/Incubator/ssn/
Sensors and devices provide data about the physical world objects.
The observation and measurement data related to an object can be
related to an event, situation in the physical world.
The processing of turning this data into knowledge/ perception and
using it for decision making, automated control, etc. is another important
phase.
Huge amount of data related to our physical world that need to be
Published
Stored (temporary or for longer term)
Discovered
Accessed
Proceeded
Utilised in different applications
The Things
Feature of Interest
e.g.
Sensors
e.g.
Embedded device
e.g.
WASPmote, SunSPOT,
Sensors
platforms
software platforms
RFID
Technology
Reading range
Physical limitations
Interference
Security and Privacy
Controller
Memory
Communication device
Sensors (or actuators)
Power supply
Waspmote
Source: Wireless Sensor Networks to Control Radiation Levels, David Gascn, Marcos Yarza, Libelium, April 2011.
Human as a sensor
e.g.
Virtual sensors
e.g.
Adapted from: The Web of Things, Marko Grobelnik, Carolina Fortuna, Joef Stefan Institute.
Actuators
[2]
[3]
[4]
Image credits:
[1] http://directory.ac/telco-motion.html
[2] http://bruce.pennypacker.org/category/theater/
[3] http://www.busytrade.com/products/1195641/TG-100-Linear-Actuator.html
[4] http://www.arbworx.com/services/fencing-garden-fencing/
Image source: Protocols and Architectures for Wireless Sensor Networks, Protocols and Architectures for Wireless Sensor Networks
Holger Karl, Andreas Willig, chapter 3, Wiley, 2005 .
Gateway
SunSpots
Directory server
Web user/application
Control channel
Information channel
Distributed WSN
Heterogeneity
Interoperability
Mobility
Energy efficiency
Scalability
Security
What is important?
Robustness
Quality of Service
Scalability
Seamless integration
Security, privacy, Trust
In-network processing
source: Protocols and Architectures for Wireless Sensor Networks, Protocols and Architectures for Wireless Sensor Networks
Holger Karl, Andreas Willig, chapter 3, Wiley, 2005 .
Data-centric networking
source: Protocols and Architectures for Wireless Sensor Networks, Protocols and Architectures for Wireless Sensor Networks
Holger Karl, Andreas Willig, chapter 3, Wiley, 2005 .
Retrieve data from an unknown source, like in peer-to-peer networking with efficient
implementation
DHTs typically ignore issues like hop count or distance between nodes when performing a
lookup operation
Publish/subscribe
Nodes can publish data, can subscribe to any particular kind of data
Once data of a certain type has been published, it is delivered to all subscribes
Subscription and publication are decoupled in time; subscriber and published are agnostic
of each other (decoupled in identity);
Adapted from: Protocols and Architectures for Wireless Sensor Networks, Protocols and Architectures for Wireless Sensor Networks
Holger Karl, Andreas Willig, chapter 3, Wiley, 2005 .
A Few Words
on
Semantic Web
34
SSW Introduction
Semantic Web
(according to Farside)
Concrete Facts
Resource Description Framework
lives in
General Knowledge
Web Ontology Language
has pet
is a
Person
has pet
Animal
is a
~ 50 Billion Statements
Apple
Siri
Watson
Knowledge Graph
42
Leading to
Improved situational
awareness
Advanced cyber-physical
systems / applications
Enabling the Internet of
Things
Closed centralized
management of sensing
resources
Closed inaccessible data
and sensors
Drowning in Data
A cross-country flight from New York to Los Angeles on a Boeing
737 plane generates a massive 240 terabytes of data
- GigaOmni Media
Drowning in Data
In the next few years, sensor networks will produce 10-20
time the amount of data generated by social media.
- GigaOmni Media
Drowning in Data
Challenges
To fulfill this vision, there are difficult challenges to overcome such as the
discovery, access, search, integration, and interpretation of sensors and
sensor data at scale
Discovery
Integration
Interpretation
Scalability
Solution
Semantic Sensor Web
Solution
Discovery, access, and search
Solution
Integration
Solution
Interpretation
Solution
Scalability
60
Barnaghi et al 2012, Semantics for the Internet of Things: early progress and back to the future
IoT challenges
Challenge: Freshness of the data and supporting temporal requirements in accessing the
data
Ubiquity
Challenge: Processing and mining the data, Providing secure access and preserving and
controlling privacy.
Timeliness of data
Huge volumes of data emerging from the physical world, M2M and new
communications
Challenge: Interoperability
Low power sensors, wireless transceivers, communication, and networking for M2M
Challenge: Scalability
Diagram adapted from L. Atzori et al., 2010, the Internet of Things: a Survey
What is expected?
Users
Physical entities
Virtual entities
Devices
Resource
Services
Definition adapted from De et al, 2012, Service modeling for the Internet of Things
Gateways
Directories
Platforms
Systems
Subsystems
Annotated
Published
Stored (temporary or for longer term)
Discovered
Accessed
Proceeded
Utilised in different applications
Utilise semantics
Semantic modelling
Deprecated
Procedure-Oriented Service Model (POSM) and Resource-Oriented
Service Model (ROSM): two different models for different service
technologies
Defines Operations and Messages
No profile, no grounding
Web-level access to low level sensor data and real world resource
descriptions (gateway and middleware solutions);
http://ccsriottb3.ee.surrey.ac.uk:8080/IOTA/
Ontology mapping
Reference ontologies
Standardisation efforts
Reality: it is still meta-data, machines dont understand it but can interpret it. It still does need
intelligent processing, reasoning mechanism to process and interpret the data.
Its a Hype! Ontologies and semantic data are too much overhead; we deal with
tiny devices in IoT.
Reality: Ontologies are a way to share and agree on a common vocabulary and knowledge; at
the same time there are machine-interpretable and represented in interoperable and re-usable
forms;
You dont necessarily need to add semantic metadata in the source- it could be added to the
data at a later stage (e.g. in a gateway);
93
In general
In relation to IoT
Tweeting Sensors
sensors are becoming social
Semantic Perception/Abstraction
Linked Open Data as prior knowledge
standard encoding)
Sensor Registries
RDF
OWL
Sensor Web
SSN Ontology
OWL 2 DL ontology
Authored by the XG
participants
Edited by Michael Compton
Driven by Use Cases
Terminology carefully tracked
to sources through annotation
properties
Metrics
Classes: 117
Properties: 148
DL Expressivity: SIQ(D)
SSN Ontology http://purl.oclc.org/NET/ssnx/ssn
SSN Ontology
Stimulus-Sensor-Observation
The SSO Ontology Design Pattern is developed following the principle of minimal
ontological commitments to make it reusable for a variety of application areas.
Introduces a minimal set of classes and relations centered around the notions of stimuli,
sensor, and observations. Defines stimuli as the (only) link to the physical environment.
Empirical science observes these stimuli using sensors to infer information about
environmental properties and construct features of interest.
SSN Sensor
A sensor can do (implements) sensing: that is, a sensor is any entity that can follow a
sensing method and thus observe some Property of a FeatureOfInterest.
Sensors may be physical devices, computational methods, a laboratory setup with a
person following a method, or any other thing that can follow a Sensing Method to
observe a Property.
SSN Observation
An Observation is a Situation in which a Sensing method has been used to estimate or calculate a
value of a Property.
Links to Sensing and Sensor describe what made the Observation and how; links to Property and
Feature detail what was sensed; the result is the output of a Sensor; other metadata gives the
time(s) and the quality.
Different from OGCs O&M, in which an observation is an act or event, although it also provides
the record of the event.
xlink:href - link to
ontology individual
xlink:role - link to
ontology class
xlink:arcrole - link to
ontology object
property
Semantic Perception/Abstraction
Linked Open Data as prior knowledge
Abstraction
Abstraction provides the ability to interpret and synthesize information in a way
that affords effective understanding and communication of ideas, feelings,
perceptions, etc. between machines and people.
Abstraction
People are excellent at abstraction; of
sensing and interpreting stimuli to
understand and interact with the world.
The process of interpreting stimuli is
called perception; and studying this
extraordinary human capability can
lead to insights for developing effective
machine perception.
Abstraction
conceptualization
of real-world
observe
perceive
real-world
Semantic Perception/Abstraction
Fundamental Questions
What is perception, and how can we
design machines to perceive?
What is Perception?
Inference
Explain observations (hypothesis building)
Focus attention by seeking additional stimuli (that
discriminate between explanations)
Observer
observes
Quality
inheres in
Entity
* Formally described in
domain ontologies
(and knowledge bases)
Perceiver
perceives
Entity
Perceptual Inference
Abductive Logic (e.g., PCT)
high complexity
minimize
explanations
tractable
degrade gracefully
Perceptual Inference
(i.e., abstraction)
Web reasoning
Observer
sends
observation
sends
focus
Perceiver
Key Insights
Background knowledge plays a crucial role in perception; what we know
(or think we know/believe) influences our perception of the world.
Semantics will allow us to realize computational models of perception
based on background knowledge.
Contemporary Issues
Internet/Web expands our background knowledge to a global scope;
thus our perception is global in scope
Social networks influence our knowledge and beliefs, thus influencing our
perception
sends
observation
observes
sends
focus
Perceiver
Quality
inheres in
perceives
Entity
Prior Knowledge
W3C SSN Ontology
Bi-partite Graph
Semantics of Explanation
Explanation is the act of accounting for sensory observations (i.e.,
abstraction); often referred to as hypothesis building.
Observed Property: A property that has been observed.
ObservedProperty ssn:observedProperty.{o1}
ssn:observedProperty.{on}
Explanatory Feature: A feature that explains the set of observed
properties.
ExplanatoryFeature ssn:isPropertyOf.{p1}
ssn:isPropertyOf.{pn}
Semantics of Explanation
Example
Assume the properties elevated blood pressure and
palpitations have been observed, and encoded in RDF
(conformant with SSN):
ssn:Observation(o1), ssn:observedProperty(o1, elevated blood pressure)
ssn:Observation(o2), ssn:observedProperty(o2, palpitations)
Semantics of Discrimination
Discrimination is the act of deciding how to narrow down the multitude of
explanatory features through further observation.
Expected Property: A property is expected with respect to (w.r.t.) a set of
features if it is a property of every feature in the set.
ExpectedProperty ssn:isPropertyOf.{f1} ssn:isPropertyOf.{fn}
Semantics of Discrimination
Example
Given the explanatory features from the previous example,
Hypertension and Hyperthyroidism, the following classes are
constructed:
ExpectedProperty ssn:isPropertyOf.{Hypertension}
ssn:isPropertyOf.{Hyperthyroidism}
NotApplicableProperty ssn:isPropertyOf.{Hypertension}
ssn:isPropertyOf.{Hyperthyroidism}
Semantic Perception/Abstraction
Linked Open Data as prior knowledge
Lower
Lift
Discrimination Algorithm
Adoption of SSN
SSN Applications
SSN Applications
Applications of SSN
Weather
Rescue
Healthcare
DEMO: http://www.youtube.com/watch?v=in2KMkD_uqg
Possible Explanations
Panic Disorder
Hypoglycemia
Hyperthyroidism
Heart Attack
Septic Shock
Observed Symptoms
Possible Explanations
Panic Disorder
Hypoglycemia
Hyperthyroidism
Heart Attack
Septic Shock
yes
Have you taken your Methimazole
medication?
no
Future work
Selected references
Payam Barnaghi, Wei Wang, Cory Henson, Kerry Taylor, "Semantics for the Internet of Things: early progress and back to the future", (to appear)
International Journal on Semantic Web and Information Systems (special issue on sensor networks, Internet of Things and smart devices), 2012.
Atzori, L., Iera, A. & Morabito, G. , The Internet of Things: A survey, Computer Networks, Volume 54, Issue 15, 28 October 2010, 2787-2805.
Suparna De, Tarek Elsaleh, Payam Barnaghi , Stefan Meissner, "An Internet of Things Platform for Real-World and Digital Objects", Journal of
Scalable Computing: Practice and Experience, vol 13, no.1, 2012.
Suparna De, Payam Barnaghi, Martin Bauer, Stefan Meissner, "Service modelling for the Internet of Things", in Proceedings of the Conference on
Computer Science and Information Systems (FedCSIS), pp.949-955, Sept. 2011.
Cory Henson, Krishnaprasad Thirunarayan, and Amit Sheth, An Efficient Bit Vector Approach to Semantics-based Machine Perception in ResourceConstrained Devices, In: Proceedings of 11th International Semantic Web Conference (ISWC 2012), Boston, Massachusetts, USA, November 11-25,
2012.
Cory Henson, Amit Sheth, and Krishnaprasad Thirunarayan, Semantic Perception: Converting Sensory Observations to Abstractions, IEEE Internet
Computing, Special Issue on Context-Aware Computing, March/April 2012.
Cory Henson, Krishnaprasad Thirunarayan, Amit Sheth, An Ontological Approach to Focusing Attention and Enhancing Machine Perception on the
Web., Applied Ontology, vol. 6(4), pp.345-376, 2011.
Payam Barnaghi, Frieder Ganz, Cory Henson, Amit Sheth, Computing Perception from Sensor Data, In proceedings of the 2012 IEEE Sensors
Conference, Taipei, Taiwan, October 28-31, 2012.
Michael Compton et al, The SSN Ontology of the W3C Semantic Sensor Network Incubator Group, Journal of Web Semantics, 2012.
Harshal Patni, Cory Henson, and Amit Sheth , Linked Sensor Data, in Proceedings of 2010 International Symposium on Collaborative Technologies
and Systems (CTS 2010), Chicago, IL, May 17-21, 2010.
Amit Sheth, Cory Henson, and Satya Sahoo , Semantic Sensor Web IEEE Internet Computing, vol. 12, no. 4, July/August 2008, pp. 78-83.
Wei Wang, Payam Barnaghi, Gilbert Cassar, Frieder Ganz, Pirabakaran Navaratnam, "Semantic Sensor Service Networks", (to appear) in
Proceedings of the IEEE Sensors 2012 Conference, Taipei, Taiwan, October 2012.
Wang W, De S, Toenjes R, Reetz E, Moessner K, "A Comprehensive Ontology for Knowledge Representation in the Internet of Things", International
Workshop on Knowledge Acquisition and Management in the Internet of Things (KAMIoT 2012) in conjunction with IEE IUCC-2012, Liverpool, UK.
Liverpool. 25-27 June, 2012.
http://www.itu.int/osg/spu/publications/internetofthings/InternetofThings_summary.pdf
http://www.theinternetofthings.eu/content/mirko-presser-iot-comic-book
http://www.iot-a.eu/public/public-documents
http://www.w3.org/2005/Incubator/ssn/XGR-ssn-20110628/
http://knoesis.org/projects/ssw