Integrating 3D-Virtual Reality and Video/Audio Streams for Annotation



ELAN is a professional tool for the creation of complex annotations on video and audio resources. The goal of ELANmod is a minor change of ELAN source code in order to synchronously playback a recorded Instant Realtiy scene from the ELAN GUI. This enables the user to watch the actual video recorded in combination with a 3D scene from the InstantPlayer of the same recording.

To be able to map the player behaviour of ELAN to an interface and send it via RPC connection to the logging/replay tool (FAMEReplay) ELAN.mod starts up two extra threads. One Thread is observing the ELAN MasterMediaPlayer on any change of the play/stop behaviour. This thread send the corresponding command to the logging/replay tool. The second thread ensures the synching between ELANs player and the playback tool therefore the synchThread send every 40 ms a seek command with the exact time of the ELAN player at that moment.

The communication between ELAN.mod - FAMEReplay - remoteControl is done via a RPC (remote procedure call). Therefore ELAN.mod has a RPC client to send commands (BrowserClient with corresponding BrowserInterface) and a RPC server to recieve commands (RemoteServer with corresponding RemoteInterface).


Get the source code of ELAN annotation tool. Extract the archive to a folder of your choice and get our ELAN.mod patch. Integrate the folders from the into the ELAN source code folder and overwrite the Once this is finished, build your ELAN.mod with ant. Use a command line tool (eg windows command prompt), navigate to the ELAN source root folder and just type "ant", then it will use the existing build.xml to build your patched ELAN.


To configure ELAN.mod there is a file located in the folder structure. See at /src/config/ If there is noch such configuration file you can create on. Standart appearence would be as follows:

#configuration for rpc browser connection(appFAMEReplayer)

#configuration for remote controll connection(mumodo)

#Offset settings

#Frequency of synchronization in (ms)


This website reports on some results of the "Multimodal Interaction Lab", which is located at Bielefeld University and is led by David Schlangen. The information contained in this website is for general information purposes only; we make no representations or warranties of any kind, express or implied, about the completeness, accuracy, reliability, suitability or availability with respect to the website or the information, products, services, or related graphics contained on the website for any purpose. Any reliance you

... Continued

place on such information is therefore strictly at your own risk.

Through this website you are able to link to other websites which are not under the control of us or Bielefeld University. We have no control over the nature, content and availability of those sites. The inclusion of any links does not necessarily imply a recommendation or endorse the views expressed within them.