For our tangible user interface project, we have tackled problems associated with the theatrical rehearsal process. In a single rehearsal, actors may run through a show and receive brief feedback from a director. Without taking copious notes, however, it is difficult to analyze or review the rehearsal or progress made over time. Our goal is to provide more data and analysis to theatrical teams, increasing their ability to learn from rehearsals and rehearsal critique, without adding any additional work to their rehearsal process.

Our interface consists of four sets of tangible objects and will be used in two phases. In the first phase, the recording phase, three objects are used to record data about a rehearsal. An installed video camera records scenes being practiced. RFID location tags worn by actors record who is onstage or offstage during said scenes. Computerized pens are used by users watching the rehearsal to document critiques or congratulations. In the second phase, the review phase, a single object is used to review data about past rehearsals. A Microsoft Surface displays video footage of rehearsals tagged with notes at the moment the notes were taken during the rehearsal. Notes can also be reviewed separately or sorted by note-taker or note-receiver. Video footage is also be sorted by actor, so an actor can view a whole rehearsal or only their scenes. All of this data has been processed and analyzed by the Surface.

Overall, the project will help theatrical teams to get more out of rehearsals and create a more collaborative process of review and critique, both for singular rehearsals and for the entire process over time. Though the project is extensive, we have been able to implement enough aspects to prove its worth as a tangible user interface.

Our system is created for the general use of a theatrical production team: director, cast, and crew. A typical user has extensive experience in theatre, but not with computers. With the assistance of our system, they will be able to enjoy the benefits of computer-assisted analysis, review, and documentation of rehearsals without a basis of knowledge about computers or programming.

The system will record the rehearsal process with video, audio, location information, and text. Video and audio will be provided by an installed video camera, location information will be provided by RFID tags worn by actors, and text will be automatically sourced from notes being taken by the director, stage manager, and other members of the production staff. With computerized pens, we will be able to digitally record the notes being taken by these users. All interactions take place within the theater space.

The interaction with our system is primarily with the Microsoft Surface. The video camera will be linked to the Surface, automatically recording when the Surface application is activated in Rehearsal mode. Actors only need to wear their RFID tags when they are onstage (to record at what points they enter and exit the stage space) and production staff members only need to write with computerized pens, which electronically record, convert and transfer their notes to the Surface. All other interaction is with the Surface.

At any point, any user can log into the Microsoft Surface application tailored to their production, which will store and sort the data recorded during rehearsals. Upon logging in, a user is provided with a tailored selection of recent rehearsals. For the most common user, an actor in the production, the Surface application would provide a number of workspaces: an area within which video and notes from the most recent rehearsal could be reviewed, an area within which the most recent unread notes for the actor could be reviewed, and thumbnails with which older rehearsals and notes could be accessed. With these workspaces, a user is able to both review their performance and quickly see which areas of the production need further work.