user interface keybaord shortcuts

We are starting to integrate user interaction with the characters now. The way that we plan to do it is that a wii gesture selects the action a user wants to perform, and the mobile phone defines the context for that action (speech rec for characters, RFID for objects). The user interface will display on the screen which gesture, object and character are currently selected (if any). In order to start the action the user has to press Wii button A. If that happens the action is started and broadcasted to the agents but only if the action context is valid and set. To simulate the interaction devices without having them connected use the following keys:

number keys 1-0 simulate the different Wii gestures
function keys F1-F7 simulate the speech recognition for different character names
function keys F8-F12 simulate the item selection for different items via RFID
The Ctrl key simulates the "A" Button on the Wii to confirm/send an action
letter o key simulates The "1" Button on the Wii, Letter p key simulates the "2" Button on the Wii (used for operating the recycling machine)
letter l simulates the "+" button on the wii used to toggle the character names display

Camera controls via dancemat: At the moment, because its easier for debugging the free look camera is switched on (controls via w,a,s,d keys plus mouse). The dance mat cannot control this camera, but a different camera (1stperson). This can be changed by modifying the TheMeal.xml episode file and commenting out the line:

changestorymode newmode="freeNavigationMode"

and remove instead the comments form

changestorymode newmode="firstPersonNoFreeLookNavigationMode"

In this mode the controls that simulate the dancemat buttons are the keys q,w,e,d,c,x,z,a. Those keys form a cirlce that corresponds to the keys in the same pattern on the dancemat. The s key in the middle of that circle simulates the start button on the dance mat (might be later used to confirm if the user wants to leave from one scene to another).

Regarding the same topic, we thought it would be probably better if the agent minds were put to sleep while the user is in "input mode", i.e. setting the context for an action. So whenever the user waves the Wii or uses the phone, the agents would not perform any actions to let the user concentrate on the input task. The agents would wake up when the action is confirmed/sent or when the user cancels/leaves input mode. Feel free to comment or make suggestions.