ARTIFICIAL PASSENGER

(A Sleep Prevention Dialogue Based

Car System)

Presented by
Thriveni R
1DS07Cs123
Contents
 Introduction
 Why Such System ? ?
 Working Components
 Applications
 Future Applications
 Conclusion
 Q N A..
 Reference
Introduction
 IBM (International business machines corporation, NY) has
developed a software that holds the conversation with driver to
determine whether the driver can respond alertly enough, called
“Artificial Passenger”.

 The name was firstly suggested

in an article in new scientist magazine.

 This was designed to make solo

journey safer and more bearable.
Why Such System??
 According to a national survey in UK and USA, it is
observed that the driver fatigue annually causes,
• 10000 crashes
• 1500 deaths
• 7100 injuries ,
which causes annual
cost of $12.5 billions.

 Majority of off-road accidents

observed were preceded by
eye closure of half and even
2-3 seconds where the normal human eye blinks at 0.2-0.3 seconds.
Showing the dashboard of the car where the whole
artificial system is generally attached
About AP

 The AP is an artificial intelligence–based

companion that will be resident in software
and chips embedded in the automobile
dashboard.

 The system has a conversation planner

that holds a profile of you, including
details of your interests and profession.
 A microphone picks up your answer and breaks it down
into separate words with speech-recognition software.

 A camera built into the dashboard also tracks your lip

movements to improve the accuracy of the speech
recognition.
 A voice analyzer then looks for signs of
tiredness by checking to see if the answer
matches your profile. Slow responses and a
lack of attention are signs of fatigue.

 If you reply quickly and clearly, the system

judges you to be alert and tells the
conversation planner to continue the line
of questioning.
 If your response is slow or doesn’t make
sense, the voice analyzer assumes you are
dropping off and acts to get your
attention.
Working Components
There are some of the components which supports
for the working of the system:

 Automatic speech recognizer (ASR)

 Natural language processor
 Driver analyzer
 Conversational planner (CP)
 Alarm
 Microphone
 Camera
Working
Components( contd.)
Automatic speech recognition:-

There are two ASRs used in the system:

 First one is “speaker independent” and used for

decoding voice signals of the driver.

 Second one operates with voice car media and decodes

tapes, audio book, telephone mails etc.
Working Components
(contd.)
Natural language processor:-
 Processes the decoded signals of textual data provided
from the ASR.

 Identifies related meanings from the contents of the

decoded messages.

 Produces variant of responses.

 This output goes to the driver analyzer as an input.

Working Components
(contd.)
Driver analyzer:-

 Receives the textual data and voice data.

 Measures the time response using a clock.

 Analysis is both subjective and objective.

 Time responses, conclusions about driver’s alertness will

output to the conversational planner.
Working Components
(contd.)
Conversational planner:-

 It is the heart of the system.

 Instructs the language generator to produce the

response.

 If the driver is in perfect condition CP instructs the

language generator to continue the conversation
otherwise it is instructed to change the conversation.
Working Components
(contd.)
Alarm:-

If the CP (conversational planner) receives information

that the driver is about to fall asleep an alarm system is
activated.

Microphone:-
For picking up the words and separate them by some

internally used software for conversation.

Working Components
(contd.)
Camera:-

 This will track the lip movements of the driver.

 Used for the improvement for the accuracy of the speech

recognition.
Application
 Prevents the driver, falling asleep during long and solo trip.

 In any problem it alerts the vehicles near by this, so the driver

there become alert.

 Opens and closes the doors and windows of the car

automatically.

 It is also used for the entertainment.

Future Application

Will provide us with a shortest-time routing based on

road conditions changing because of weather and traffic,
information of about the cars on the route, destination
requirement (as flight has been delayed).
Conclusion
Successful implementation of artificial
passenger would allow use of various services
in car like reading emails, navigation,
downloading music files, voice games without
compromising a driver safety.
References
 www.ieee.org

 www.esnips.com

 www.electronicsforu.com

 www.wikipedia.com
Q n A..
Questions ????
Thank you