Вы находитесь на странице: 1из 37

c 

{  

{      
  
          
                       
      !    !         
        "    #{$  % {! "  & 
   '  "         !   
              !
!        
        
     '  "  ({"')#       
& !      
          
!                  



      


 
  


c 



{
{



Prototypes of interactive computer systems have been built that can begin to
detect and label aspects of human emotional expression, and that respond to users
experiencing frustration and other negative emotions with emotionally supportive
interactions, demonstrating components of human skills such as active listening,
empathy, and sympathy. These working systems support the prediction that a
computer can begin to undo some of the negative feelings it causes by helping a user
manage his or her emotional state. This paper clarifies the philosophy of this new
approach to human±computer interaction: deliberately recognizing and responding to
an individual user's emotions in ways that help users meet their needs. We define user
needs in a broader perspective than has been hitherto discussed in the HCI
community, to include emotional and social needs, and examine technology's
emerging capability to address and support such needs. We raise and discuss potential
concerns and objections regarding this technology, and describe several opportunities
for future work.
















      


 
  


c 



{   






&  *    
&  +!    
     ,
        -
'  ,.    /
+  0   "     /
,     /
1 0    2
- 3     2
4 "    2
5 #     6
'  1.    ,,
0    '      ,,
'  -.    ,7
#{ '       ,7
'  4.     15
{    " (     15
'  5.     15
" 8   +
   15
'  /.     12
'     16
     -,
3!    -1






      


 
  


c 


  


"0({& 9) ++&0 { 0 9)

* ,, 0  # /


* ,1 " )!       # 7
* ,- "  # 7
* ,4 0  2
* ,5      "  6
* ,/ 0  #  0 ,-
* ,7 #    , ,2
* ,2 #    1 1:
* ,6 {  0 +
 14


      



  


c 


 


"0({& 9) ++&0 { 0 9)

+! ,.   " ,4


+! 1. "   ;   ,5
*   ' 
+! -. *      '   ,5
+! 4. '  (  ,5

























      



  


c 


Preface

0 
                
 
            <
   3#= {  ( '     ! !   
       
          
  $!   
+      
   .  c    $   ! 
  !   =        >8? c 
 
       !       !    
  @!              
       !    
{  
!             
A A                  
          !    
   $              
    +   !   
     
   !      @@ 
       ' 
          *            A A  
    
    
%   !    !         
A 
 A    !  
    
      
   A A
        
        
  
               !$ =    
          
+    ;      =     
         !         +    !
        !         
         !          
 @         {         !  

      


,
  


c 


    !    


     !     
 
(         !        
   
    ;    
       
 


























      


1
  


c 


Introduction
+ c                 
     !  
    !     @! 
                    
 =            !  +   
           
      ;   
     
*         !
    !     B
        !         
     
+            !    !
   ;             
                      $ +
     CD     C ! 
                
                   
!                   ! 
                 + 
             !   
         !            
   !   
9      E    F         !  
     "             
 
            C     
!  !                
!                  
      
*    (  9  "   8        
!                  
   
C 
         
C 
     
 
      !   
  C

      


-
  


c 


E     F              


! 
    
+ 
     !    ;           
       G       
  
       
             
!       
     
 
     
          
  !        
   
'             
!  
      !      !     
        !           
 (   !     ! !        
        !    H=          
    
{          =        !    
        
+  
            H  =  
   !  .          !
    
G !               
            !         
                  
 ' 
   !                   
        
       !  =
        
'     .        
           !       
              !     ! 
 = ! < "   B   !   
     < I        !    
                {      
     
                     
       {   !  !    

      


4
  


c 


                  
  C ! 
"                    
!       !  =      ! +
                   + 
   !    B     
   
         !    ;   
 >+ ? "           ! 
        "    !       
                   !  

  
              
!   !         !      
   

      


5
  


 
c    


C t 1 E ti lS

1.  

F 1.1

O propos o s m o for g g usr form o rough ouch s 
compu r pu c h mouse. ?hs h ows h usr o r  h c r c
rhy hm h boy mpr ur c rc  couc  y of h sk  o hr
physoogc  rbu s w h h moo. ?hs h s  o h cr o of h ³Emotion
Mouse´. ?h c c  m sur h r r  mpr ur g  c sk rspos 
mu  boy mom s  m chs hm w h s mo o  s s. h ppss
surprs gr f r s ss  sgus .
?h mous cus s of ssors cug fr r  c ors  mpr ur
ss  chps. ?hs compo s Usr rs rchrs¶ s rss w so b cr f   o
o hr commoy us  ms such s h offc ch r h s rg wh h kybo r
 h pho h . I gr g h sys m
I o h s rg wh for s c cou ow  r o b sou wh rr
bcoms rowsy.



           
      6     
 
c     

J   
   

1) 3h or
. #ous mom s
b. 3u o cck frucy
c. Fgr prssur wh usr prsss hs/hr bu o
2) Physoogc  form o
.  r r  (Ec roc rogr m (E' /EKG)) Pho op hysmogr m (PPG)
b. Sk mpr ur (?hrms r)
c. Sk c rc y (G  c sk rspos GS()
. Ec romyogr phc c  y (Ec romyogr m #G)



Fgur 1.2

Fgur 1.3
I s mof compu r mous h cus rc o  prssur ssor for g 
rcog o of mo o   c (kg/ r c o s. skg/ o c).

         ! "  #  #"    


     7     
& +
c $% '%( )%* ,- -.'

2. Eys

 


Fgur 1.4
A w r b c whch ows y wr o su   h cofuso   rs
s of h w rr. O hr rc opm s  r  choogy s h mp o
 r h s of h usr $us by foowg h
I r c o b w h usr  h compu r  orr o kow wh h/sh s
 rs   y g mom . For  mp by rmmbrg h yp of wbs s
h h usr ks o ccorg o h moo  m of h  y h compu r cou
s rch ur  s s  suggs h rsu s h usr.

3. 3oy

 

A $ ck w h  mb ssor  wor by couc or hps   h
couc or¶s b y o prss mo o    o  y.

4. Spch


 

A prso  g cors o  spch  rf c g sg for ffc 
commuc o whch $us sp kg s y o h usr.

/0 0. 1 - %.% - 2-* 0 2* %,*%( 3 %4 01 5%, - -54 $ %1 2* %,*%


      8     
8 =
c 67 97: ;7< >? ?@9

5. #sc ous/Or  Sys ms







?hs s form b surf c m  of couc  co h  couc  fo m  c s
co uous prssur w h hgh ss  y  rsou o  r prsss h
pp prssur musc y. (Is   of g  g h pp prssur  o musc w
cou prob by us  s  pu sg   o compu r sys m).



 



Fgur 1.5

A c r ou f  w h c mr s  physoogc  ssors  us r  m sg s o


rcog  rr s rss s rprs  by ro  co os us o r rsposs 
hr p r y obsr os.
?h sub$c wor f physoogc  ssors  c roc rogr m (E'G) o h
chs   Ec romyogr m (E#G) o h f shour chs c  y p so
rspr o ssor ((sp.) rou h  phr gm  wo sk couc  y ssors
(S') o o hs f h   o o h f foo . ?h ssors wr ch o
compu r  h r r of h hc.

AB B@ C ? 7@7 ? D?< B D< 7><7: E 7F BC G7> ? ?GF 6 7C D< 7><7


      9     
J O
c HI KIL MIN PQ QRK

A s mp fr m from h u  sp o coc  urg h prm . ?h uppr


f p  shows h rr f c  prsso coc  from c mr mou  o h
s rg coum. ?h uppr rgh p  shows h c mr us for prm r
o os whr ³S op´ o o s show. ?h owr f p  shows ro 
co os  h owr rgh p  shows su  r c of h physoogc  sg s
s hy wr bg rcor.

   
Am  rs rchrs so prs  robo c  ³PogA h obsrs r  
c  y  rcog s usr prsc  rspo ccorgy w h s y hum k
sm or compu r b s c o k    g sk op P'. ?hs A  A robo
cr  by h Usr group r m  s compu rs¶ mrgg w rss by ssg
pop¶s prsc  r c g o hr comgs  gogs.APogA u  s sm 
o c mr o pro
 o o  s usr. ?hs c mr s p r of o hr pro o yp  m # gc po g
whch ows h ys o ffc h mom of h cursor. ?hs fuc o  y c 
oy ow h cursor o rr h po whr h usr g
s by h g hm o hr
ouch h po g c frs . If h cursor wr o mo whr h ys go h
opr o wou b uprouc   mpr c c  h rs rchrs s y bc us hs
 s h usr h us   cofus.

ST TR U Q IRI Q VQN T VN IPNIL W IX TU YIP Q QYX H IU VN IPNI


      10     
c 


Chapter 2: Emotions and Computing



(  !               
+          .       !    
          !       9   
         
    ! !  
                  {    
    @!           =      
{                      
    {     J          
        !    >,666?  
             *     
        
      3   
  =                    
   =     !  !  
+ !                        
           
           =
   +    !           
)              C
   !   '  !       =      
>   ,666? G           )  !
         + !     
>              !?    
,/-                 
!          




3   0
 =   
      !  
 =          =    "  

 0        ! ! 0
 = * { 
'   "  >0  ( ! ,667? )       

      


,,
  


c 


                 


  
   > "(?       ! 
                   
        !         !
           $  
*  
  >,66-?       
!             "       
!       !    G   
!              
  +  
  "(    
     
     > "{? +     !$  two   *  first
         >#"?         
        +         
                      *
 second                 
                    +  
      !       C  
 !                  #   
              ! 
 =       
3                C 
    
         +  
      
  ! 
         
 !  !  !  G  ;         
   !          G   ;  "{  !
 !         

 !" "

{        !   +  
          "(      +
        !      +
              

      


,1
  


\ a
c Z[ ][^ _[` bc cd]

(D##). ?h GS( w s so m sur w h D##. ?h som c mom w s


m sur by rcorg h compu r mous mom s.


  

S pop p r cp   hs s uy (3 m  3fm ). ?h prm w s w h
sub$c sg  orr of prs o w s cou r b  c cross p r cp  s.





P r cp  s wr sk o s  fro of h compu r  ho h mpr ur 
GS( ssors  hr f h  & ho h mous w h hr rgh h   wor h
chs ssors. ?h rs g (b s) m surm s wr rcor for f mu s
 h h p r cp  w s s ruc  o c ou o mo o for f mu s. ?h
mo os coss  of gr f r
s ss sgus  $oy  surprs. ?h oy s ruc o for c g ou h mo o w s
o show h mo o  hr f c  prssos.

Fgur 1.6

!


?h  for  ch sub$c coss  of scors for four physoogc  ssssm s
[GSA GS( pus  sk mpr ur for  ch of h s mo os ( gr f r
s ss sgus  $oy  surprs) cross h f mu  b s  s sssos.
GSA  w s s mp 80 ms pr sco GS(  mpr ur wr rpor 
pprom y 3 4 ms pr sco  pus w s rcor s b w s  c 
ppro. 1 m pr

ef fd g c [d[ c hc` f h` [b`[^ i [j fg k[b c ckj Z [g h` [b`[


      13     
n s
c lm omp qmr tu uvo

sco. Frs h m  scor w s c cu  for  ch b s  s sssos. ?o


ccou for h u   r c  physoogy h ffrc b w h b s
 s sssos w s c cu . Scors h ffr by mor h  o  h f
s  r  os from h m  wr r  s mssg. 3y hs cr ro w
scor wr rmo from h  yss. ?h rm g s show  bow ? le1.
I orr o  rm wh hr our m surs of physoogy cou scrm  mog
h s ffr mo os h  wr  y
 w h scrm  fuc o
 yss. ?h four physoogc  ffrc scors wr h scrm  groups. ?h
 r bs wr  r  o h u o smu ousy  four c oc 
scrm  fuc os wr c cu . A Wks¶ L mb s of hs four fuc os
w s m rg y s s c y sgfc  B for  mb = 192 chsu r (20) = 29.748 p
< .075. ?h fuc os r show  ? le 2.
?h us  r
 c oc  scrm  fuc os  u  group m s r
show  ? le 3. Fuc o1 s f by s ss  f r o   gr 
surprs o hr . Fuc o 2 h s f r  sgus o   s ss o hr
. Fuc o 3 h s h ppss o   surprs h o hr. Fuc o 4 h s
sgus  gr o   surprs h o hr.
?o  rm h ffc ss of hs fuc os w us hm o prc h group
mmbrshp for  ch s of physoogc   . As show  ? le 4 w0 hr of
h c ss wr succssfuy c ssf.


 
"



.

wx xv y u mvm u zur x zr mtrmp { m| xy }mt u u}| l my zr mtrm


      14     
€ …
c ~ ‚ ƒ„ †‡ ‡ˆ


 
#  #
     

.



 
$   
 %


 
& !







‰Š Šˆ ‹ ‡ ˆ ‡ Œ‡„ Š Œ„ †„‚  Ž Š‹ † ‡ ‡Ž ~ ‹ Œ„ †„


      15     
c 


"$"    !"



+      !  0  = 

     +          
       +         !  
   !   ! C C       !  
       !       !
          
  !  
9               !   
 ! !            +        !
         {  
       
 !                    !
  


















      


,/
  


c 


Chapter 3: MAGIC Pointing

+ 
       ;   ;   
   ; 
     !              
           G !          
       ;              
              
 G   
     !! #{ '    G       
     !    
           
             !    
   ;        +  #{ '   
           !      ;  
      
    +       
   +         #{ '       
                   
                     ;
    !          +      
         !       !$   
            
    ;                
 
  *     @  ;      !  $ 
             ;         8
     ! 
        = 8  
{  15@                   :44  
    ;     !       ;  
  
"                 
     !      "      
            !      G  
   !               !
!
       !       
       
  
!$       
          > 1:: ?

      


,7
  


c 


    !     )            


!$         !$  !       
=                     
)     !      @   >      $  
! ? *       !        
 + 
           {   
    > 
   ?   ! 
>    !  
?   
 >      ? +  !         
                     

         =          
   
               
   !$  )    !           
;           !   
{          ; 
      
!       !    
   < G                
        
!     ! ; 
  )

      ;       >?  EF    
     !            !   
 
    !             
    

)       !            
 
    
             
         #  { ;   '  >#{ '?
    #  {     ;     ' +    
      #{ '       '         
               G     #{ '
        !           
        + !       
  !$   
 


      


,2
  


’ —
c ‘ “‘” •‘– ˜™ ™š“

Fgur 1.7

?h usr c  h k co ro of h cursor by h   r (or o) h rg  or gor
  s rch for h  rg . Opr o y w ob$c s f by suffc
s c (.g. 120 ps) from h curr cursor pos o uss h cursor s 
co ro mo o by h . Sc hr s 120p hrsho h cursor w o b
w rp wh h usr os co uous m pu o such s r wg. No  h hs
#AGI' po g chu s ffr from r  o  y g
 co ro whr h
usr uss hs y o po rg s  hr w hou cursor or w h cursor h
cos  y foows h $ ry y g
 mo o.
?h br  ppro ch m y pp r ³pro c ´ sc h
cursor w  s r y  h c y of or o ry po    rg . ?h usr m y mo
h cursor oc h cs o cur h rg h s ookg . O h o hr h  h
usr m y so f h h cursor s or c  wh h s mry ookg rg 
 hough h m y gr u y  p o gor hs bh or. ?h mor cosr 
#AGI' po g chu w h  por os o w rp cursor o rg u 
h m u  pu c h s b c u . Oc h m u  pu c h s b
c u  h cursor s w rp o h g
 r rpor  by h y r ckr. ?hs r

›œ œš  ™ ‘š‘ ™ ž™– œ ž– ‘˜–‘” Ÿ ‘  œ ¡‘˜ ™ ™¡   ‘ ž– ‘˜–‘


      19     
¤ ©
c ¢£ ¥£¦ §£¨ ª« «¬¥

shou b o or  h c y of h rg . ?h usr wou h s r h cursor


u y ow rs h rg o comp  h rg cus o. As us r   Fgur
2 o mm
 rc o  ucr  y f r h cursor pp rs  h cosr 
chu w  rouc  ³ g ´ b s. Is   of bg p c h c r of
h g
 r  h cursor pos o s offs o h  rsc o of h m u  c u o
c or  h bou ry f h g
 r . ?hs m s h oc w rp h cursor s
ky o pp r  mo o ow rs h rg  rg rss of how h usr c u y
c u  h m u  pu c. W hop h w h h  g b s h usr
wou o h  o G
 pos o rpor  by y r ckr Ey r ckg bou ry w h
95% cofc ?ru rg w b w h h crc w h 95% prob b y. ?h cursor
s w rp o y r ckg pos o whch s o or  r h ru rg Prous cursor
pos o f r from rg .

Fgur 1.8
?h br  #AGI' po g chu. cursor s
p c  h c y of rg h h usr f s o. Ac u  pu c obsr
h cursor pos o  c  whch rc o o s r h cursor. ?h cos o hs
m ho s h cr s m u  mom mp u. Fgur 2. ?h cosr 

­® ®¬ ¯ « £¬£ « °«¨ ® °¨ £ª¨£¦ ± £² ®¯ ³£ª « «³² ¢ £¯ °¨ £ª¨£


      20     
c 


#{ '         E   F +          


     !    )     E    .F  
 =            
    + 

                     =
  +          !     ! 
  
            
      
               

+       #{ '          )   

              E   !F
                        
      !        ! 
    G           ! @  
$                   @
      3   !      #{ '      
     
   .
, (                 @    
         
1             ;    
       !         #{ '
               
    !   
           
- {           +      !  
     ; +          !    
   
            !
4 "  "                     
       !  #{ '     !    
    
5  !$    @@ "           
      #{ '            
                  

+          {       
* = &               {/G  

      


1,
  


c 


 {        G    ;       


       
     

* #{ '        ;     !   
                !         
;    * = &  G  #
 =       
  !           !    
* = & +    "!  ! K5L        
 
                * = & 
    !    =  
        
        !             
#{ '                 .

, G    ! #{ '            !
            ;      
;         > ,1: ?     +
 !                  ! 
                  *    =
            #{ '     !   
 

1 G       #{ '             
              
     !   . 
   >       
    ?  >    ?   >     
 ? "              +  
      @        !       
;     !  
 0 
  !    65M    
+   !       65M !!  +     
!    ;                 
            

- G            
    
     !            # 

      


11
  


c 


         = ;       G  #{ '   


           >  ?        
 +            #{ '   
  =         '   >  
 ? 
                #{ '
     

)         
   .
+ 3# {   

"      
   #{ '      
          !      
   

               >   
     !          !
                 
!      G          

    {!         ! "'{9
    &' +   { "  &!  >{"&?   
                   
"'{90+&@4::     @      &'+   {"& 05:4
       @  > !    ?    

 

G       @        
  !                 
    ! 
+         @          
   

      


1-
  


¶ »
c ´µ ·µ¸ ¹µº ¼½ ½¾·

Fgur 1.9

3rgh (f )   rk (rgh ) pup m gs rsu g from o  off s
um o. ?h g s or cor  rfc os from h o  off s gh sourcs
c  b  sy  f s h brgh po s  h rs. ?h Am  sys m uss wo
 r fr r (I() m mu p gh sourcs compos of wo s s of I( LED's
whch wr sychro
 w h h c mr fr m r . O gh sourc s p c ry
cos o h c mr 's op c  s  s sychro
 w h h  fr ms. O
fr ms r sychro
 w h h sco gh sourc pos o off s. ?h wo
gh sourcs r c br  o pro pprom y u  whosc
um o. Pup  c o s r 
 by m s of sub r c g h  rk pup m g
from h brgh pup m g. Af r hrshog h ffrc h  rgs coc 
compo s  f s h pup. ?hs chu sgfc  y cr ss h
robus ss  r b y of h y r ckg sys m. Af r mpm g our sys m
w h s sf c ory rsu s w scor h sm r pup  c o schms h  b
p y op by ?omoo   Ebs w  S oh.

¿À À¾ Á ½ µ¾µ ½ ½º À º µ¼ºµ¸ à µÄ ÀÁ ŵ¼ ½ ½ÅÄ ´ µÁ º µ¼ºµ


      24     
c 


Chapter 4: Artificial Intelligent peech Recognition


               
       
 +   !  
    !
                 
  =                
G      !   !     
   
                   
  EG            !   F
I        !          
                 
 + 
          @        
       



$"

{     >{?    !   *         
    !  "          
   >
   !   ? {  !      
 !   !   !      
    
              9   
  >9&?                  
        
 0  +  !$    9&  
              +          
      
        
   
   ! 
                  =
  9             +   
              



      


15
  


c 


$ $""

+  
            B 
             +   !   
     !!              
      !   !  @!      
+                +
         {'               
+ {'              0   
        0           
                0        
!  !            {     
>'8?           !  {'" {  ({# > 
 ?          !  +      
    
      !  '8      +
          1:: ;  7
; ( ;    
       !       -:: ; --
;
{     
     !    
{' + !           !    
               +      
  )                     
    !      
   {    
   
     !        ({# +      
     !             !  
     
 
            
                      
          !      !   
  +                 
   
  !  


      


1/
  


c 


+   !       !          
   !          ;    
      !          +   
 !     G  !           
           +   
    !
     '8   
     !   
 +       @  {  ({#  
      
            !
                        
          !       !
       +        
 ;   
            
             +      
@
    ;

{ $"

)     !                
  
    +        !    
           !      {   $
             %      
  G  !             
        !  
      C 
 =          {        
       @     '+          
                 +
                    %
     !      
         
{             
          

   !  

      


17
  


c 


Chapter 5: imple User Interest Tracker ( UITOR)



'    !         
   !      !      G    !  
       !         {  " 8
  +
 >"8+)(?           
3 !   G!   ;  !  
"8+)(   !          
 3    
  =          "8+)(  !  
                    
   +          !      
3#N 30  $ !            #
*
     {  N 8"0( . '    !  
       <

)     ;C       


 
  *
             
 
  N        ;@ 
      
   )   "8+)( >" 8   +
?    

               N  

"8+)(
    
            
G!    ! !  A N     G!  ! 3# 
   A   #  {           "8+)(
A          
  !       
3#          
         !   
                 
 + N      
    C                   
         A

      


12
  


c 


Chapter 6: Conclusion

+               
        + 3&80 0I0"     
         !          
       9             
           !        
!     ! !            +   
                
   
;        !  {       
   

 {%
{ 3#= !   
            
*        E;C 
 F    #{ '
>#  {     ;@    '?      G 
#{ '        
    G  
   !$   
      G       
   
 
< (         
     
     #       {   
  ; 
                  
)       =              
G       Emotion Mouse3        
    
{         {        
      !           3
  !    !         !
    C!            
       ! =       
    
      
         !   
+    ;      =         
       !    
       !  

      


16
  


c 


      !          *     


 !   !      
      
         E  @ '99F +  
   =   !        '99    
sees  
          =        

         '99    9

Ë "  " 3 %" % % $ $   "3 
"%  "&' %  ( '" ' )  ! "%  )  !*+
     !            
  !     !    =        $   
      $              
 C   $!   
   
 
*      c    
  C                
        
















      


-:
  


c 


 {,

{ #   ;   ' 

"
 '   

  0 

    "
 ( 

-
 " 8   +


      


-,
  


c 




 {./,


K,L #   & ( 
 ;. E+  { @"   #  
 @'     F    000 % 6,  ,-7:@,-6:
" 1::-
K1L ( '  . E0            F
000 "    #; % ,2  ,  -1D2:   1::,
K-L (G  . E+     ;    
  F 3# "    % -6 9)" -J4  7:5@7,6 1:::
K4L G {
  '     &. E+ 0  #F   '
     N66 #    { ,666
K5L 0    ( ! 0 >0 ? G  * (. 3 
{ "    "   0 8   * {  '  
"  >*{'"X 
K/L   ( {  '   #+ . '!   ' 
 ; &# G      <   
K7L '             "


      


-1