ORIENT software

Hi all,

The latest version of the application can be found at http://www.macs.hw.ac.uk/~myl/rundir.zip

Currently, the scenario starts with the Dinner Party where the user appear as invisible. The users will not be able to interact with the characters but observe what they are doing. After this episode, the users will be brought to a hub (the beach) where they can move to the other episodes.

If you want to test the interaction and do not want to wait for the Dinner Party episode to finish, change "TheDinnerParty" in the following line: in OrientStart.xml in the folder rundir\data\scenarios\Orient\episodes to the episode you want to test. For example, TheMeal, TheGardening or TheRecycling

No matter which episode you start with, when you finish it, you can go to the blinking lights and press start on the dance mat to go to the beach hub. You can also switch episode half way through if you wish.

If you want the software to run in German, please refer to Michael's previous post.

German Version Of Orient

The user interface is now also available in German. To switch to German, the language code in OrientProfile.xml should be switched from "EN" to "DE". Note that this does not change the agent dialogues to english. Sibylle and Natalie are still working on the translation for this. Once they are finished and we have integrated the translated sentences the agent language can be changed in data/scenarios/Orient/Orient.xml (in line 2 change the value of parameter language from "EN" to "DE").

Other components independent of the main software that are also different depending on language are the mobile phone interface (for RFID and speech recog) and the oracle components.

edit 21/11: Agent dialogues are now also in place in German. However additionally to what i have listed above every character's agent language also has to be switched from "en" to "de". So to summarize, switch language by changing the language code in OrientProfile.xml, the parameter "language" in line 2 of Orient.xml and the parameter agentLanguage for every character listed in Orient.xml.

User Interface Explained

Hi all,

this is an updated explanation of the Orient User Interface and the Keyboard shortcuts.

Starting Up:

starting up Orient brings you into training mode. You can recognize this mode by the little white "GO" button. In Training mode you can test the connection between user interface devices and Orient, so you can practise for example gesture and speech recognition. Pressing the "go" button loads Orient and starts the first scenario. Before you press the "Go" Button make sure the agent launcher server is running (more on that in this post from Samuel). If you want to use the real interaction devices and not just keyboard shortcuts the Orient Interaction Server also has to run.

Interaction Conventions:

The interaction conventions are as follows:
- A wii gesture selects the action a user wants to perform
- The mobile phone defines the context for that action (speech rec for characters, RFID for objects)
- The user interface will display on the screen which gesture, object and character are currently selected (if any)
- In order to start the action the user has to press Wii button A.
- If that happens the action is started and broadcasted to the agents but only if the action context is valid and set.
- To simulate the interaction devices without having them connected use keyboard shortcuts, described below.

Wii Gestures:
number keys 1-0 simulate the different Wii gestures

1: Greet
2: Consume
3: Pick
4: Accept
5: Reject
6: Attend To
7: Ask
8: Apologise
9: Give

Character Names (Speech Recognition):
function keys F1-F7 simulate the speech recognition for different character names

F1: Abbuk
F2: Errep
F3: Evui
F4: Ikop
F5: Ardoot
F6: Cerkith
F7: Tigrit

Items & Conversation Topics (RFID):

function keys F8-F12 (not F10) and the letters u, t , y and h simulate the item selection for different items via RFID

Conversation Topics (used together with the verbs Accept, Reject and Ask):
F8: Meal
F9: Gardening
F11: Recycling
F12: Drink

Items (used together with the verbs Consume, Pick, Accept, Reject, Give):
T: Seedpod
Y: Soil
U: Green Drink

Special RFID function:
H: Healing a dead Spryte

Wii Buttons:
- The Ctrl key simulates the "A" Button on the Wii to confirm/send an action
- Letter O key simulates The "1" Button on the Wii, Letter p key simulates the "2" Button on the Wii (used for operating the recycling machine)
- Letter L simulates the "+" button on the wii used to toggle the character names display

Camera controls via dancemat:

- The up arrow on the dancemat (keyboard shortcut W) moves the user forward
- The up-right arrow on the dancemat (keyboard shortcut E) turns the users view 45 degrees to the right
- The up-left arrow on the dancemat (keyboard shortcut Q) turns the users view 45 degrees to the left
- The down arrow on the dancemat (keyboard shortcut X) moves the user backward
- The "Start" button on the dance mat (keyboard shortcut S) has to be pressed when the user is at a portal point (signalled by blinking lights) to move to another scene