KCET

01.04.2011

BLUE EYES TECHNOLOGY

Human operator monitoring system presented by

DIVYA MOHAN S.NAGA PRIYA

1

KCET

01.04.2011

WHAT IS BLUE EYES TECHNOLOGY?

Aims at creating computational machines that have perceptual and sensory ability.
Use camera and microphone to identify user actions and emotions

KCET

01.04.2011

THE TERM BLUE EYES

BLUE in the term stands for Bluetooth, which enables reliable wireless communication EYES , because the eye movement enables us to obtain a lot of interesting and important information.

KCET

01.04.2011

NEED OF BLUE EYES TECHNOLOGY

To built a machine that can understand your emotions A pc that can listen, talk or scream Verify your identity, feels your presence and interact with you.

KCET

01.04.2011

TECHNOLGIES USED

Emotion Mouse Manual And Gaze Input Cascaded (MAGIC)

Artificial Intelligent Speech Recognition

Simple User Interest Tracker (SUITOR) The eye movement Sensor
5

KCET

01.04.2011

EMOTION MOUSE

Simplest way

People spend approximately 1/3 of their total computer time touching input device Physiological data is obtained and emotional state is determined A user model will be built that reflects the personality of user.

KCET

01.04.2011

KCET

IBM RESEARCH

01.04.2011

BLUE EYE EMOTIONAL MOUSE sensors in the mouse ,sense the physiological attributes which are correlated to emotions using corr- elation model -by simply touching the mouse ,the computer will be able to determine a persons emotional state. BLUE EYE enabled TELEVISION could become active when the user makes an eye contact.

KCET

01.04.2011

MAGIC POINTING

Reduce the cursor movement needed for target selection Click on the target with a regular manual input device Two magic pointing techniques

Liberal Conservative
9

KCET

01.04.2011

APPROACHES

LIBERAL APPROACH To warp the cursor to every new object user looks at

CONSERVATIVE APPROACH Does not warp the cursor target until the manual input device has been actuated
10

KCET

ARTIFICIAL INTELLIGIENT SPEECH RECOGNITION

01.04.2011

Input words are scanned and matched against internally stored words Identification causes some action to be taken User speaks to the computer through microphone Filtered and fed to ADC and then stored in RAM pattern matching is designed to look for the best fit because of variations in loudness, pitch, frequency difference, time gap etc.
11

KCET

01.04.2011

APPLICATION OF ARTIFICIAL INTELLIGIENT SPEECH RECOGNITION

To control weapons by voice commands

Pilot give commands to computers by speaking into microphones Can be connected to word processors and instead of writing, simply dictate to them

12

KCET

01.04.2011

SUITOR

Help by fetching more information at desktop Notice where the users eyes focus on the screen Fills a scrolling ticker on a computer screen with information related to users task

Ex. If reading headline ,pops up the story in the browser window

13

KCET

01.04.2011

THE EYE MOVEMENT SENSOR DESIGNING

A personal area network for linking all the operators and the supervising system

Two major units - DAU (data acquisition unit ) - CSU (central system unit )

14

KCET

01.04.2011

DAU
The DAU consists of the following components ATMEL 8952 microcontroller BLUE TOOTH MODULE supports synchronous voice data transmission central system sound feedback microcontroller (115200 bps) ALPHAUNUMERIC LCD display LED indicators ID CARD interface

15

KCET

01.04.2011

DAU - FEATURES
Data Acquisition Unit
Atmel 89C52 microcontroller

Lightweight
Runs

Bluetooth

Jazz Multisensor

on batteries - low power consumption Easy to use - does not disturb the operator working ID cards for operator authorization 16 Voice transmission using hardware PCM codec

KCET

01.04.2011

MICROCONTROLLER & BLUE

TOOTH MODULE

17

KCET

01.04.2011

CSU COMPONENTS
CONNECTION MANAGER main task to perform low-level blue tooth communication

DATA ANALYSIS MODULE performs the analysis of the raw sensor data

DATA LOGGER MODULE provides support for storing the monitored data.

VISULAIZATION MODULE provides user interface for the supervisors

18

KCET

01.04.2011

CSU FEATURES
Connection management Data processing
Central System Unit

Bluetooth

Connection Manager Data Analysis

Visualization Module Data Logger

Data recording
Access verification System maintenance

19

KCET

01.04.2011

MULTISENSORS

20

KCET

01.04.2011

FUTURE IMPROVEMENTS
DAU small CMOS camera to monitor the operators point of gaze single PCB (SMD technology) low voltage ICs CSU data mining algorithms advanced database encryption using

21

KCET

01.04.2011

EXPERIMENT

Measurement of heart rate, temperature, galvanic skin response (GSR), general somatic activity Six basic emotions are anger, fear, sadness, disgust, joy and surprise

22

KCET

DATA SECURITY
Only registered mobile devices can connect to the system Bluetooth connection authentication Bluetooth connection encryption Access rights restrictions Personal and physiological data encryption

01.04.2011

23

KCET

01.04.2011

APPLICATIONS
In retailing record and interpret customer movements In automobile industry In video games To create Face Responsive Display and Perceptive Environment Generic control rooms Power station Flight control centres o Operating theatres

24

KCET

01.04.2011

BLUE EYES ENABLED DEVICES

POD

Technology used in cars

PONG

A Robot
25

KCET

01.04.2011

CONCLUSION

Provide more delicate and user friendly facilities in computing devices Gap between the electronic and physical world is reduced The computers can be run using implicit commands instead of the explicit commands

26

KCET

01.04.2011

REFERENCES
n www.seminar4u.com n www.howstuffswork.com n www.cs.put.poznan.com n www.whitepapers.com n www.ibmresearchcenter.com n www.almaden.ibm.com

27

KCET

01.04.2011

Thank u
ANY QUESTIONS ???
28