Henrik Hautop Lund Center for Pl C t f Playware, T h i l U i Technical University of Denmark it f D k

Center for Playware Professor Henrik Hautop Lund, hhl@playware.dtu.dk

Robotic Technology to Provide:

Personalisation Adapt to personal level Inclusiveness Different physical abilities Different cognitive abilities Different cultures Different ages Social interaction T h l Technology as mediator di t Activities of daily living

- th through modularity h d l it
Center for Playware Professor Henrik Hautop Lund, hhl@playware.dtu.dk

Example: Modular Playware

Adaptivity flexible to adjust to treatment area activity patient level patient fatigue Modularity provides flexibility ease of use use anywhere robustness
Center for Playware Professor Henrik Hautop Lund, hhl@playware.dtu.dk

Human Robot Human-Robot Interaction (HRI)

HRI inspiration for health and welfare technology

Collaboration with Odense University Hospital, Denmark

Sygehus Fyn Svendborg, Ringe Neurorehabilitationscenter, U-H Kiel, MedCom, Odense and Svendborg Municipality, OUH HCA childrens hospital Sund Vkst & Robin projects

Robotic technology may help and inspire creating interactions of many different kinds in the physical environment can motivate specific actions because of immediate feedback Motivate through play g p y Play is a free and voluntary activity
Center for Playware Professor Henrik Hautop Lund, hhl@playware.dtu.dk

Playware Playware

PLAYWARE is intelligent hardware and software that aims at producing play and playful experiences among users of all ages Robotics Modern artificial intelligence Children culture Play culture

HM Queen Margrethe II

Center for Playware

Professor Henrik Hautop Lund, hhl@playware.dtu.dk

Why Play and Playware?

Play creates a zone of proximal development in the child. In play, the child always behaves beyond his average age, above his daily behavior; in play it is as though he were a head taller than himself. As in the focus of a magnifying glass, play contains all developmental tendencies in a condensed form and is itself a major source of development.
Lev Vygotsky, 1930 35 Vygotsky 1930-35

Works also for adult for health Adaptivity in playware can automatically and dynamically allow the zone of proximal development to follow the individual i di id l user wrt h t her competencies and motivate her Examine adaptivity with playware
Center for Playware Adapted from Hill & Crevola Professor Henrik Hautop Lund, hhl@playware.dtu.dk

Design Principles for Modular Playware

Playware tools with behaviour Motivation and engagement Immediate feedback Adaptivity Modularity and flexibility Robustness through distribution Construction and physical movement Tangible interaction End-user activity design g Inclusive games/activities
www.playware.dk

Lund & Marti 2009 Marti,

Professor Henrik Hautop Lund hhl@playware.dtu.dk

Adaptive Modular Playware

Modularity and flexibility
(for easy adjustment and personalisation)

www.playware.dk

Professor Henrik Hautop Lund hhl@playware.dtu.dk

MODULAR PLAYWARE TILES

Immediate Feedback Motivation

OUH Sygehus Fyn Svendborg cardiac patients

www.playware.dk Professor Henrik Hautop Lund hhl@playware.dtu.dk

Adaptivity - modularity
Flexibility through adaptivity Adaptivity: also by physical construction

www.playware.dk

Professor Henrik Hautop Lund hhl@playware.dtu.dk

MODULAR INTERACTIVE TILES

Input: Force sensitive resistor & accelerometer Output: Colour light, sound Processor: ATmega128 Battery: Lithium polymer 30 hours operation (3h charging) Communication: Wireless (IR, radio) Attachment: magnets / puzzle

Jigsaw puzzle

Off/On

Battery status

Game selector box

World Wide Patent Pending 60/885 957 60/885,957

www.playware.dk Professor Henrik Hautop Lund hhl@playware.dtu.dk

ADJUSTABLE for DIFFERENT PATIENTS

Setup within 1 minute Automatic structure detection Adjustable levels, different activities

www.playware.dk

Professor Henrik Hautop Lund hhl@playware.dtu.dk

Physical Construction and Interactivity - Modularity

Setup within 1 minute Automatic structure detection Adjustable levels, different activities

Center for Playware

Professor Henrik Hautop Lund, hhl@playware.dtu.dk

HAL exeskeleton & Tiles

- Flexible use with walking aids

Center for Playware

Professor Henrik Hautop Lund, hhl@playware.dtu.dk

Easy level adjustment

Modularity allows for physical construction

Cripple and mental disability

Cerebral palsy fixed contracture in born limbs

Center for Playware

Professor Henrik Hautop Lund, hhl@playware.dtu.dk

Clinical tests in hospitals

Cardiac patients, typically 55-85 years old Teams of 20 patients for 3 months periods
(OUH Sygehus Fyn Svendborg)

Games demands an average heart rate: 75% of the maximum heart rate with Colour race on floor 86% of th maximum h t rate with St f the i heart t ith Stepper Estimated maximum heart rate: 220 age.
When doing rehabilitation not everything is as much fun. Then it is nice to have a little competition. When having gone through a heart attack it is not always desired to go down to the gym and exercise. There has to be something to spice it up, and I think that the tiles makes this possible. Cardiac patient Heart News Magazine referring to the hospital report OUH Sygehus Fyn Hospital report, 2007 [in Danish] + CNN & WIRED
www.playware.dk Professor Henrik Hautop Lund hhl@playware.dtu.dk

Tests stroke patients

Balance, walking rhythm, weight carrying, coordination and orientation skills (e.g. crossing midline), cognitive skills (repetitive and varied movements) g ( p )

OUH Sygehus Fyn Svendborg and Ringe Neurorehabilitation Center

Center for Playware Professor Henrik Hautop Lund, hhl@playware.dtu.dk

Adaptation

Single

Cooperative

Competitive

Center for Playware

Professor Henrik Hautop Lund, hhl@playware.dtu.dk

Adaptation speed

Center for Playware

Professor Henrik Hautop Lund, hhl@playware.dtu.dk

Adaptation: Age & Gender

Center for Playware

Professor Henrik Hautop Lund, hhl@playware.dtu.dk

Modularity and flexibility adapt to private home

Stroke patients
The respondents both found positive challenge when it came to their balance, coordination and circulation. Likewise, respondent B experienced that exercising on the intelligent tile had challenged his muscular system in both under underextremities. Moreover, respondent B stated that the tiles brought some cognitive challenges, as it required use of his ability to concentrate. Observations of sweat, cheek colour and an enhanced respiration confirmed the respondents statements. Also, a progress in movement patterns on the tile was observed, e.g. the bilit to th ability t use l longer steps, stepping b k t t i backwards and sideways d i th games. d d id during the
Physiotherapist graduation report, 2008 [in Danish]

www.playware.dk

Professor Henrik Hautop Lund hhl@playware.dtu.dk

Modular tiles for autistic children

Construction and physical movement Playful autism diagnosis tool (neural network classification)

www.playware.dk

32x speed

Professor Henrik Hautop Lund hhl@playware.dtu.dk

Children with autism

Neural network: 88% correct classification Postprocessing: 100% correct classification

www.playware.dk

Professor Henrik Hautop Lund hhl@playware.dtu.dk

Different games/activities

- Modularity to adjust level E.g. concentration games, teleplay, etc.

OUH Hans Christian Andersen Childrens Hospital

www.playware.dk Professor Henrik Hautop Lund hhl@playware.dtu.dk

Design Principles for Modular Playware

- Different modules work together Inclusive games/activities:

OUH Hans Christian Andersen Childrens Hospital

www.playware.dk Professor Henrik Hautop Lund hhl@playware.dtu.dk

Adapt games to different patient groups:

www.playware.dk

Professor Henrik Hautop Lund hhl@playware.dtu.dk

Cardiac patients:
!"#$ !"#$$#% 67 0'(89 >,(?# 6C 0'(89 E3<3%%-.# &<33% 6F 0'(89 0'( 9 E3<3%%-.# G-<< 67 0'(89 E3(.#("%-"'3(A ;-<-(.# * .33%+'(-"'3( H "'0#) 6H 0'(89 1(# $-"'#(" @-<-(.#A .33%+'(-"'3( * .3(.#("%-"'3( &'"(#))A #(+,%-(.# * .3(.#("%-"'3( %&&"'($#$') *&$")#$') %&$" &'"(#)) * #(+,%-(.# *+#$ / "'0#) 6/ 0'(89 B "'0#) 6D 0'(89 D "'0#) 6B 0'(89 1(# $-"'#(" 1(# $-"'#(" ,"&)+-+."')/ 1(# $-"'#(" 0$/12) 20$%34#+ "5# $-"'#(":) 03;'<'"= -(+ .3(+'"'3(8 20$%34#+ "5# $ $-"'#(":) %#-."'3(8 20$%34#+ "5# $-"'#(":) $5=)'.-< <#4#<8 20$%34#+ "5# $-"'#(":) .30$#"#(.#) "3 ;-<-(.# I5#( "5# ;3+= I#'?5" ') $<-.#+ +'JJ#%#("<=8

www.playware.dk

Professor Henrik Hautop Lund hhl@playware.dtu.dk

!"#$

%&&"'($#$')

*&$")#$') %&$" )%#%*&' + ,-'#. ", /-0-"*

*+#$ 12" 3-4'0 56 4-*=7 - 7

,"&)+-+."')/ 8*' 9%3-'*3

0$/12) 8:3%-*'. 4"$' %2%$'*'00 3" 3;' #',3 %*. 3;' $->;3 0-.'= B49$"/'. 3;' 9%3-'*3C0 &%9%:-#-3D 3" ,"&E0 "* 4"$' '#'4'*30 %3 "*' 3-4'= 3-4' B49$"/'. 3;' 9%3-'*3C0 :%#%*&' "* 3;' $->;3 #'>=

Stroke:

!"#"$$%&' (#""$ 5< 4-*=7 !"#"$$%&' (#""$ 5? 4-*=7

@-/-.'. %33'*3-"* + ,-'#. ", /-0-"*

(-/' 3-4'0 5A 4-*=7

8*' 9%3-'*3

!"#"$$%&' (#""$ 5? 4-*=7

)%#%*&'

(-/' 3-4'0 5A 4-*=7

8*' 9%3-'*3

!"#"$$%&' (#""$ (# 5? 4-*=7

)%#%*&'

(-/' 3-4'0 5A 4-*=7

8*' 9%3-'*3

B49$"/'. 3;' 9%3-'*3C0 : # 3- 3C :%#%*&' "* 3;' #',3 #'>=

!"#"$$%&' (#""$ 5? 4-*=7

)%#%*&' + '*.E$%*&'

(-/' 3-4'0 5A 4-*=7

8*' 9%3-'*3

B49$"/'. 3;' 9%3-'*3C0 :%#%*&' %*. '*.E$%*&'=

!"#"$$%&' (#""$ 5? 4-*=7

)%#%*&' + &">*-3-"*

(-/' 3-4'0 5A 4-*=7

8*' 9%3-'*3

B49$"/'. 3;' 9%3-'*3C0 %:-#-3D 3" %&3 "* %*. E*.'$03%*. -*03$E&3-"*0= B49$"/'. 3;' 9%3-'*30 09''. %*. '*.E$%*&'=

!"#"$$%&' (#""$ 5? 4-*=7

)%#%*&'F &">*-3-"*F '*.E$%*&' + .-/-.'. %33'*3-"*

1;$'' 3-4'0 5G 4-*=7

8*' 9%3-'*3 + 3;' 3;'$%9-03

!"#"$$%&' (#""$ 5? 4-*=7

)%#%*&' + &">*-3-"*

H-I 3-4'0 5 5J 4-*=7 7

8*' 9%3-'*3

B49$"/'. 3;' 9%3-'*3C0 4":-#-3D= 4":-#-3D

www.playware.dk

Professor Henrik Hautop Lund hhl@playware.dtu.dk

Adapt training session

- utilising the modularity
!"#$ !"#"$$%&' (#""$ )* +,-./ !"#"$$%&' (#""$ )A +,-./ %&&"'($#$')

training cognition & field of vision

*&$")#$') %&$" *+#$ 78" 1,+'6 !"0-,1,"- 2 3,'#4 "3 5,6,")9 +,-./ (,5' 1,+'6 )B +,-./ : ;%1,'-1 8<" <%6 4%+%0'6 "1<' &"0-,1,"%-4 1<' 3,'#4 "3 5,6,"- %6 % $'6>#1 "3 % 61$"?'. 7<' ;%1,'-1=6 %8%$'-'66 1" 1<' 6,4'6 &%,+;$"5' 8<,&< ,6 '.0. ,+;"$1%-1 3"$ 1<'+ 1" -%5,0%1' ,- 1<' 1$%33,& 8<'- 1<'@ %$' $'#'%6'4 3$"+ 1<' <"6;,1%#. ,"&)+-+."')/ 0$/12)

C,+"- C%@6

(,5' 1,+'6 )1,+'D 4';'-4,-0 "- 1<' ;%1,'-1/

www.playware.dk

Professor Henrik Hautop Lund hhl@playware.dtu.dk

Adapt training session: balancing

- utilising the modularity training balancing where right leg / side is weak. fatigue: change to use both legs.

OUH Ringe Neurorehabilitation Center

www.playware.dk Professor Henrik Hautop Lund hhl@playware.dtu.dk

Therapists questionnaire
Therapists in Denmark responded: in future they will continue to use modular tiles for their particular patients (training balancing, coordination, cognition, attention, endurance, physical fitness) Therapists in Denmark responded that they experienced the modular tiles to: be fun for patients be motivational for patients be a good supplement to other equipment have challenged the p g patients balance have challenged the patients cognitive level be flexible to the patients different physical and cognitive levels
www.playware.dk Professor Henrik Hautop Lund hhl@playware.dtu.dk

EXTRA - MODULARITY
FIFA World Cup 2010, South Africa

www.playware.dk

Professor Henrik Hautop Lund hhl@playware.dtu.dk

Summary: Modular Playware

Adaptivity flexible to adjust to treatment area activity patient level patient fatigue Modularity provides flexibility ease of use use anywhere (e.g. home rehab) robustness
www.playware.dk Professor Henrik Hautop Lund hhl@playware.dtu.dk

Modular Tiles: www.e-robot.dk

www.playware.dk

Professor Henrik Hautop Lund hhl@playware.dtu.dk

Panel: Imagine the Future

Prof. Prof Henrik Hautop Lund Center for Playware

Technical University of Denmark

hhl@playware.dtu.dk

www.playware.dk

Professor Henrik Hautop Lund hhl@playware.dtu.dk

Playware
PLAYWARE is intelligent hardware and software that aims at producing play and playful experiences among users of all ages

SOCIAL PLAYWARE is playware that aims at producing social interaction among users of all ages

www.playware.dk

Professor Henrik Hautop Lund hhl@playware.dtu.dk

Inclusiveness
Transgenerational Explicit immediate feedback motivation and engagement

www.playware.dk

Professor Henrik Hautop Lund hhl@playware.dtu.dk

Inclusiveness Both professionals and amateurs can express together

User generated contents pre-defined contents

ATmega128 p g processor Accelerometer IR communication Xbee radio communication Coloured LEDs Magnets
www.playware.dk

I-BLOCKS by JACOB NIELSEN

Professor Henrik Hautop Lund hhl@playware.dtu.dk

www.playware.dk

Professor Henrik Hautop Lund hhl@playware.dtu.dk

Multi-sensory room
inclusiveness

www.playware.dk

Professor Henrik Hautop Lund hhl@playware.dtu.dk

Inclusiveness
Inclusive and flexible games/activities

www.playware.dk

Professor Henrik Hautop Lund hhl@playware.dtu.dk

SOCCER VIDEOS
FIFA World Cup 2010, South Africa

www.playware.dk

Professor Henrik Hautop Lund hhl@playware.dtu.dk

SOCCER VIDEOS
FIFA World Cup 2010, South Africa

www.playware.dk

Professor Henrik Hautop Lund hhl@playware.dtu.dk

SOCCER VIDEOS
FIFA World Cup 2010, South Africa HIV/AIDS children, orphanage

www.playware.dk

Professor Henrik Hautop Lund hhl@playware.dtu.dk

SOCCER VIDEOS
FIFA World Cup 2010, South Africa Shibuya, Tokyo

www.playware.dk

Professor Henrik Hautop Lund hhl@playware.dtu.dk

For Whom do We Develop Technology?

Inclusiveness Different cultures Different ages Different physical abilities Different cognitive abilities Social interaction Technology as mediator Activities of daily living

www.playware.dk

Professor Henrik Hautop Lund hhl@playware.dtu.dk

Playware

Gregory Bateson, 1977 Bateson

www.playware.dk

Professor Henrik Hautop Lund hhl@playware.dtu.dk