Interactive holograms system for theatre show

Michele Cremaschi
Associazione Retroscena Via Lunga 50, 24125 Bergamo michele.cremaschi@gmail.com

Abstract. The pepper ghost theatrical trick was used in the early 1900s to make performers appear and disappear as if by magic. This proposal consists of its revised and corrected version using avant-garde multimedia systems, which is perceived by the audience in the same way but the hidden technology is no longer mechanical and optical and it is based on sophisticated digital, interactive animation techniques. The final effect is the materialization of objects, human bodies, and scenery on stage. Their digital nature enables complete control of their existence beyond the most elementary rules of physics. Objects disappear, actors morph into virtual avatars, and the rules of gravity are defied: everything comes into discussion without any apparent tricks. And every hologram reaction is driven by actor movement: a real interaction system that makes the illusion even more close to reality. The applications of the stage set systems described herein can be found in the world of theatre: interactive performance, theatrical shows that fall somewhere between magic and new technologies. Keywords: holograms, interaction, kinect, pepper ghost, theatre, choreography, augmented reality

1 Introduction
The projects objective is the development of a control system for the virtual props, sets, and characters used on stage through the projection of 3D holograms. The real performers will control their virtual characters and objects interactively. Augmented theatre can be offered with the use of flexible mapping techniques applied by the real and virtual actors with real-time system management. 1.1 Input techniques

Recent developments on sensing technologies have led to affordable and low- cost technologies for tracking the movements of performers in real-time. The project will focuses on camera-based tracking in order to allow non-invasive localization and sensing. In particular one or more cameras will be exploited to track the 2D/3D positions of performers on stage. Moreover the Microsoft Kinect camera will be adopted for fine-tracking of the movements of specific actors. In this project,

scientific research is supported by Software Architecture Lab, DISCo, Universit degli Studi di Milano. Software implementation is developed by Ipnotica Studio.

1.2 Output techniques 3D modeling tools promise graphic simulation of reality, an artifice as dramatic as it is unexplainable owing to its materialization on stage without any apparent projection surfaces. These tools will be the basis of a modern puppetry system in which the puppeteer can become the puppet and the puppet can become the puppeteer at will. The synchronization of the illumination system that lets the performer disappear ensures the magic of the transformation from real to virtual performer and back again.

Interactive fire hologram spreading from moving hands

2. O Rigami O Logrammi theatrical performance

The artistical research starts from visual comedy (comedy without words) and projects into augmented comedy. Performer body language engages in dialogue with holograms onstage. Performers dissolve, objects fly up and away; settings may or may not be real. Anythings possible when entertainment stumbles up hard against magical surroundings. The well known Pinocchio tale will drive us in showing some parts of the story, suitable to show a metaphor of illusions that daily we live. Pinocchio let us to evocate, through a visual theatrical language, how nowadays many Pinocchios are attracted toward a Pleasure Island that are no more than holograms that will easily fade out. Well put on stage modern double of Blue Fairy and of Jiminy Cricket, well meet the Cat and the Fox and Lucignolo, and well ask him who moves Pinocchio strings. And who moves their own strings. Well also tribute some respectful honour to the most well done film transpositions of the story, putting some cameo on stage to 3D representation of most famous frames, and interacting with them. 2.1 Presentation at the conference Due to complex setup of the hologram system, for Arts.it conference we will be able to show a video recording of an open rehearsal well do in January 2013.

Michele Cremaschi Bio

Born in Bergamo, Italy, on 16/3/1973. After graduating obtaining a degree in Information Technology in 1997, Michele Cremaschi attended a European Social Fund Course in Theater at Cassina de Pecchi and received his diploma in 1999. He continued studying physical theatre under Pierre Byland, among others. Michele Cremaschi has been writing for the theater and acting since 1999, participating at festivals the length and breadth of Europe, and in Russia, Africa, and China. These include:

The Santarcangelo International Festival , Italy, 2004, The Harare International Festival of Arts (Zimbabwe, 2010), The Edinburgh Fringe Festival (2006 e 2009) The Macao International Festival (2012) !The National Art Festival (South Africa, 2012)

He founded the Slapsus comedy group, with which he appeared on Italian (Zelig) and Belgian television programs. He directed the Erbamil Cooperative from 2005 until 2008, and has served as Director and President of the Retroscena Association and InItinere Theater Residence Program since then. Currently organizes the Nuove tecnologie in scena/New technologies on Stage review in collaboration with Teatro Donizetti in Bergamo. Prizes and awards received for his previous work include:

2003 Festival du Rire Rochefort Prix de la presse; 2009 Edinburgh Fringe Festival Long-listed for the Total Theatre Prize and Pick of the Edinburgh Fringe Festival; 2010 Winner of the Lalka tez czowiek Festival (Warsaw-Poland); 2010 LAltro Festival Lugano Winner of the Younger Contestant Jurys Pirze; 2011 KingFestival (Veliky Novgorod-Russia) Winner of the prize for best Childrens Theatre Show, a prize awarded by the local tourism institute, with Honorable Mention from the Younger Critics Jury. 2011 E-Mix Quality Label a show selected for insertion in the E-Mix visual theater festival network

For more information:

www.michelecremaschi.it
!