Вы находитесь на странице: 1из 31

BlueEyes

Human Operator Monitoring System

BlueEyes
Human-Operator Monitoring System

Presented by Saste Ashwini S.

BlueEyes
Human Operator Monitoring System

Agenda
What is Blue Eyes (and what is not) ? Emotional mouse. Magic

Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion

Artificial intelligent speech recognition


Suitor Conclusion

BlueEyes
Human Operator Monitoring System

Introduction
BLUE EYES technology enables the computer to

Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion

gather information about person and interact with the


person through special techniques like facial recognition, speech recognition etc.

It verifies persons identity ,feels his presence &


starts interacting with him.

Human cognition depends primarily on the ability to

perceive , interpret & integrate audio-visuals &


sensing information.

BlueEyes
Human Operator Monitoring System

What Is Blue Eyes ?


The Blue Eyes technology aims at creating
computational machines that have perceptual and sensory ability like those of human beings.

Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion

What Is Blue Eyes Not?


Doesnt predict nor interfere with operators thoughts Cannot force directly the operator to work

BlueEyes
Human Operator Monitoring System

Emotional Mouse
One goal of Human Computer Interaction (HCI) is to make an adaptive, smart computer system. In order to start creating smart

Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion

computers, the computer must start


gaining information about the user.

BlueEyes
Human Operator Monitoring System

Emotion And Computing


Rosalind Picard (1997) describes two aspects of

Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion

affective computing:
1) Giving the computer the ability to detect emotions &

2) Giving the computer the ability to express


emotions. We can gain the information from user via

(1) Touch
(2) Video (3) Speech

BlueEyes
Human Operator Monitoring System

Theories & Technologies


It Contains The Four Technologies As:

Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion

a)

Paul Ekmans Facial Expression.

b)

Magic Pointing.

c)

Artificial Intelligent Speech Recognition.

d) Suitor.

BlueEyes
Human Operator Monitoring System

Paul Ekmans Facial Expression


Based on Paul Ekmans facial expression work, we
see a correlation between a persons emotional state and a persons physiological measurements. He defined the six basic emotions as anger, fear, sadness, disgust, joy and surprise. Six participants were trained to exhibit the facial expressions of the six basic emotions The measures taken were GSR, heart rate, skin temperature and general somatic activity (GSA).

Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion

BlueEyes
Human Operator Monitoring System

Emotion Sensing Mouse

Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion

BlueEyes
Human Operator Monitoring System

Analysis
To analyze data there are two types of analysis:

Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion

(1) Multidimensional scaling (MDS)


(2) Discriminate function analysis

The amount of conductivity of the skin is best taken from the fingers. The changes in the temperature of the finger are reliable for prediction of emotion. GSA can be measured by changes in movement in the computer mouse.

BlueEyes
Human Operator Monitoring System

Manual And Gaze Input Cascaded


(MAGIC) Pointing
Gaze tracking has long been considered as an alternative or potentially superior pointing method

Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion

for computer input.


Many fundamental limitations exist with traditional gaze pointing. We therefore propose an alternative approach, MAGIC pointing. Two specific MAGIC pointing techniques are as: 1) Conservative & 2) Liberal.

BlueEyes
Human Operator Monitoring System

Liberal MAGIC Pointing Technique Of Cursor

Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion

BlueEyes
Human Operator Monitoring System

Conservative MAGIC pointing technique of cursor

Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion

BlueEyes
Human Operator Monitoring System

Advantages
Reduction of manual stress and fatigue. Practical accuracy level. A more natural mental model for the user. Speed

Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion

Improved subjective speed and ease-of-use.

BlueEyes
Human Operator Monitoring System

Disadvantages
With the more liberal MAGlC pointing technique, the cursor warping can be overactive at times It is possible to introduce additional constraint

Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion

according to the context


a strategy may prolong the target acquisition time Motor action may start as soon as the user's gaze

settles on a target.
With MAGlC pointing techniques, the motor action computation (decision) cannot start until the cursor

appears.

BlueEyes
Human Operator Monitoring System

IBM Almaden Eye Tracker

Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion

BlueEyes
Human Operator Monitoring System

Implementation Of Magic Pointing


The MAGIC pointing program takes data from both the manual input device and the eye tracking system. Raw data from an eye tracker can not be directly used for gaze-based interaction, due to noise from image processing. To eliminate noise we have used Filters.

Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion

The goal of filter design is to make the best


compromise between preserving signal bandwidth & eliminating unwanted noise.

BlueEyes
Human Operator Monitoring System

Implementing MAGIC pointing

Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion

BlueEyes
Human Operator Monitoring System

Experimental Results

Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion

SESSION

SESSION

Mean Completion Time (Sec) Vs. Experimental Session

No_Gaze -1.4sec ,Gaze-1.52 sec ,Gaze 2 -1.33 sec

BlueEyes
Human Operator Monitoring System

Experimental Results
1.8 1.6 1.4 1.2 1 0.8 0.6
0.4 0.2

Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion

NO GAZE GAZE 1 GAZE 2

0 0 20 40 60 80

Mean Completion Time (Sec) Vs. Target Size (Pixels)


SMALL W LARGE

BlueEyes
Human Operator Monitoring System

Experimental Results
1.8 1.6

Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion

1.4 1.2 1
0.8 0.6 NO_GAZE

GAZE 1
GAZE 2

0.4 0.2 0
0

Short

200

Mid 500 A

Long 1000

Mean Completion Time (Sec) Vs. Pointing Amplitude(pixels)

BlueEyes
Human Operator Monitoring System

Experimental Results
1.8 1.6 1.4 1.2 1 0.8 0.6 0.4 0.2 0

Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion

No_Gaze

Gaze 1
Gaze 2

Horizontal 200 Diagonal


Short Mid

Vertical

Long

Mean Completion Time (Sec) Vs. Target Angle(Degree)

No_Gaze-8.2% , Gaze 1-7% , Gaze 2-7.5%

BlueEyes
Human Operator Monitoring System

MAGIC Pointing Is More


Significant
(1) Reduced physical effort and fatigue (2) Greater accuracy and naturalness (3) Higher speed

Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion

BlueEyes
Human Operator Monitoring System

Artificial Intelligence Speech


Recognition
It is important to consider the environment in which speech recognition system has to work. Example : an automatic call-handling system is used without employing any telephone operator.

Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion

BlueEyes
Human Operator Monitoring System

Technology
(AI) involves two basic ideas as: 1. It involves studying the thought processes of human beings. 2. It deals with representing those processes via machines (like computers, robots, etc). It makes machines smarter and more useful.

Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion

BlueEyes
Human Operator Monitoring System

Speech Recognition
The user speaks to the computer through a microphone, which may use minimum three filters. As the number of filters used increases, the probability of accurate recognition increases. The filter output is then fed to the ADC to translate the analogue signal into digital word. The binary representation of each of these words becomes template or standard, against which the

Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion

future words are compared.

BlueEyes
Human Operator Monitoring System

Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion

Simple User Interest Tracker (Suitor)


We have to develop an intimate relationship between the computer and the humans. By simply noticing where the users eyes focus on the computer screen, the SUITOR can be more precise in determining users topic of interest. Two prototypes of gaze-tracking technology are as: (1)SUITOR (Simple User Interest Tracker) (2)Filling a scrolling ticker on a computer screen with

information related to the user's current task.

BlueEyes
Human Operator Monitoring System

Applications
Blue Eyes can be implemented in surveillance systems that record and interpret customer movements. Blue Eyes can be applied in the automobile industry. We could see its use in video games. Current interface between computers and human users

Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion

becomes more natural and intuitive.

BlueEyes
Human Operator Monitoring System

CONCLUSION
The BLUE EYES technology ensures a convenient

Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion

way of simplifying the life by providing more delicate


and user friendly facilities in computing devices.

BlueEyes
Human Operator Monitoring System

BIBLIOGRAPHY:
www.newtech.com www.blue-eyestech.com

www.wikipedia.com
www.google.com www.eetimes.com

BlueEyes
Human Operator Monitoring System

Thank you for your attention

BlueEyes
Human-Operator Monitoring System