SEMINAR REPORT ON

BLUE EYES
TECHNOLOGY

AAKANSHA GUPTA
ROLL No 2
UNIVERSITY ROLL No 0805410001
CS 31
BBDNITM
 ABSTRACT

Is it possible to create a computer, which can interact with us as we interact each other?
For example imagine in a fine morning you walk on to your computer room and switch
on your computer, and then it tells you “Hey friend, good morning you seem to be a bad
mood today. And then it opens your mail box and shows you some of the mails and tries
to cheer you. It seems to be a fiction, but it will be the life lead by “BLUE EYES” in the
very near future.
The basic idea behind this technology is to give the computer the human power. We all
have some perceptual abilities. That is we can understand each others feelings. For
example we can understand ones emotional state by analyzing his facial expression. If we
add these perceptual abilities of human to computers would enable computers to work
together with human beings as intimate partners. The “BLUE EYES” technology aims at
creating computational machines that have perceptual and sensory ability like those of
human beings.
Introduction :-

Imagine yourself in a world where humans interact with computers. You are sitting in
front of your personal computer that can listen, talk, or even scream aloud. It has the
ability to gather information about you and interact with you through special techniques
like facial recognition, speech recognition, etc. It can even understand your emotions at
the touch of the mouse. It verifies your identity, feels your presents, and starts interacting
with you .You ask the computer to dial to your friend at his office. It realizes the urgency
of the situation through the mouse, dials your friend at his office, and establishes a
connection.

The BLUE EYES technology aims at creating computational machines that have
perceptual and sensory ability like those of human beings. Employing most modern video
cameras and microphones to identifies the users actions through the use of imparted
sensory abilities . The machine can understand what a user wants, where he is looking at,
and even realize his physical or emotional states.

• For Hand: Emotion Mouse

• For Eyes: Expression Glasses
• For Body: Conductor Jacket
What is BlueEyes?

 BLUE EYES is a technology, which aims at creating computational machines

that have perceptual and sensory abilities like those of human beings.
 The basic idea behind this technology is to give computer human power.
For example, we can understand humans’ emotional state by his facial
expressions. If we add these perceptual abilities to computers, we would enable
them to work together with human beings as intimate partners.
 It provides technical means for monitoring and recording human-operator’s
physiological condition.

What is BlueEyes not?

 Doesn’t predict nor interfere with operator’s thoughts.

 Cannot directly force the operator to work.

How was the term blue-eyes coined?

Blue in this term stands for Bluetooth, which enables reliable wireless communication
and the eyes because the eye movement enables us to obtain a lot of interesting and
important information.

How are blue and eyes related?

As the idea is to monitor and record operator’s basic physiological parameters, the most
important physiological activity is the movement of eyes. For a computer to sense the eye
movement, wiring between operator and the system is required. But, this is a serious
limitation of the operator’s mobility and disables his operations in large control rooms.
So utilization of wireless technology becomes essential which can be implemented
through blue tooth technology
Need for blue eyes
Is it necessary to make computer function what a human brain does?
Yes, human error is still one of the most frequent causes of catastrophes (calamity) and
ecological disasters, because human contribution to the overall performance of the system
is left unsupervised.
The control instruments within the machine have automated it to large extent, thus
Human operator becomes a passive observer of the supervised system, resulting in
weariness and vigilance drop, but the user needs to active.

But Why?
Is it really needed that a human brain be active?
He may not notice important changes of indications causing financial or ecological
consequences, which is a threat to human life.
Thus, it’s crucial that operator’s brain is involved in an active system supervising over
the whole work time period.

What can we do with blue eyes technology?

 It has the ability to gather information about you and interact with you through
special techniques like facial recognition, speech recognition, etc.

 It can even understand your emotions at the touch of the mouse.

 It can verify your identity, feel your presence, and start interacting with you.

 The machine can understand what a user wants, where he is looking at, and even
realize his physical or emotional states.

 It realizes the urgency of the situation through the mouse.For instance if you ask
the computer to dial to your friend at his office, it understands the situation and
establishes a connection.

 It can reconstruct the course of operator’s work.

How can we give computer the human power?
It uses non-obtrusive sensing method, employing most modern video cameras and
microphones to identify the users’ actions through the use of imparted sensory abilities.
The blue eyes system checks the physiological parameters like eye movement, heart beat
rate and blood oxygenation against abnormal and undesirable values and triggers
user-defined alarms when necessary. Blue eyes technology requires designing a
personal area network linking all the operators and the supervising system. As the
operator using his sight and hearing, senses the state of the controlled system, the
supervising system will look after his physiological condition. The use of a miniature
CMOS camera integrated into the eye movement sensor will enable the system to
calculate the point of gaze and observe what the operator is actually looking at.
Introducing voice recognition algorithm will facilitate the communication between the
operator and the central system and simplify authorization process.

Types of Emotional Sensors:

Hand: Emotion Mouse
One proposed, non-invasive method for gaining user information
through touch is via a computer input device, the mouse. This then
allows the user to relate the cardiac rhythm, the body temperature,
electrical conductivity of the skin and other physiological attributes
with the mood. This has led to the creation of the “Emotion Mouse”.
The device can measure heart rate, temperature, galvanic skin
response and minute bodily movements and matches them with six
emotional states: happiness, surprise, anger, fear, sadness and
disgust. The mouse includes a set of sensors, including infrared
detectors and temperature-sensitive chips. These components, User
researchers’ stress, will also be crafted into other commonly used
items such as the office chair, the steering wheel, the keyboard and
the phone handle.

Eyes: Expression Glasses

A wearable device which allows any viewer to visualize the
confusion and interest levels of the wearer. Other recent developments
in related technology is the attempt to learn the needs of the user just
by following the interaction between the user and the computer in
order to know what he/she is interested in at any given moment. For
example, by remembering the type of websites that the user links to
according to the mood and time of the day, the computer could search
on related sites and suggest the results the user.
Body: Conductor’s Jacket
A jacket with an embedded sensor net worn by a conductor helps
extend the conductor’s ability to express emotion and intentionality.

STRUCTURE:
Blue eyes system consists of a mobile measuring device called Data Acquisition Unit
(DAU) and a central analytical system called Central System Unit (CSU).

DATA ACQUISITION UNIT:

It maintains Bluetooth connections.

Gets the information from the sensor.
Sends information over the wireless connection.
Delivers the alarm messages sent from the Central System Unit (CSU) to the operator.
Handles personalized ID cards.
Jazz Multisensor:
• It’s an eye movement sensor, to provide necessary physiological data in Data
Acquisition Unit (DAU).
• It supplies raw digital data regarding eye position, the level of blood oxygenation
acceleration along horizontal and vertical axes and ambient light intensity.
• Eye movement can be measured using direct infrared oculographic transducers.

CENTRAL SYSTEM UNIT:

Maintains blue tooth connections in the other side.

Buffers incoming sensor data.
Performs on-line data analysis.
Records the conclusion for further exploration.
Provides visualization interface.
 Designing
• A personal area network for linking all the operators and the supervising system
• Two major units
- DAU (data acquisition unit )
- CSU (central system unit )

DAU - features
• Lightweight
• Runs on batteries - low power consumption
• Easy to use - does not disturb the operator working
• ID cards for operator authorization
• Voice transmission using hardware PCM codec
CSU - features
 Connection management
 Data processing
 Visualization
 Data recording
 Access Verification
 System maintenance

CSU – components

 CONNECTION MANAGER – main task to perform low-level blue tooth

communication
  DATA ANALYSIS MODULE – performs the analysis of the raw sensor data in
order to obtain information about operator’s physiological condition
 DATA LOGGER MODULE – provides support for storing the monitored data.
 VISULAIZATION MODULE – provides user interface for the supervisors

Conclusion
• In the near future ,ordinary household devices- such as television , refrigerators
,ovens may be able to do their jobs when we look at them and speak to them.
• Future applications of blue eye technology is limitless.

References
• www.seminar4u.com
• www.howstuffswork.com
• www.cs.put.poznan.com
• www.whitepapers.com
• www.ibmresearchcenter.com
• www.almaden.ibm.com