Downloading mint.tools
NOTE: Due to some last-minute discovered bugs, there will be a delay of a few days in the release of the logging/replaying tool. This means that it will not be possible to log any data. However, if you wish to start setting up the architecture in your lab, you may start playing around with Kinect servers and X3D scenes, look into sample data/notebooks of mumodo that come from actual recordings, and patch/compile ELAN according to the instructions. The logger/replayer should be there by then. We deeply apologize for this slight delay.FAMEKinectServer
General
The FAMEKinectServer software allows the transfer of information provided by the Microsoft Kinect SDK and the Microsoft Speech SDK to Linux and Windows Clients via network. Details concerning the implementation can be found in the code documentation (.../FAME Kinect Server/manual.pdf).
Installation
Get FAMEKinectServer for Windows 7. Make sure that all frameworks listed below are installed before running FAMEKinectServer setup file:
- Microsoft Kinect SDK 7
- Microsoft Speech Platform SDK 11
- Microsoft Speech Platform Server Runtime 11
- Kinect for Windows Runtime Language Pack 11
- InstantReality 2.2
Execute FAMEKinectServer_v.2.3.3.exe and install it to a directory of your choice. Afterwards locate instantreality.jar (part of the InstantReality framework, usually found in C:\Program Files\Instant Reality\bin) and copy it into the installation directory of the FAMEKinectserver.
You can now start the server by using the link on your Desktop.
For further information and configuration see manual.pdf.
FAMEReplay
General
With our FAMEReplay tool you can both record and replay data. The data is stored in an xml-based file and you can easily load these so called .xio files from previous recordings and replay them with the very same software.
Installation
Download FAMEReplay tool.
GenericInstantIOServer
General
This is just a small example for you to see how you can easily sent a string over network and visualize it in a X3D scene.
Installation
Download GenericInstantIOServer, extract to a folder of your choice and run /GenericInstantIOServer/examples/java/run.bat for Windows or run.sh for Linux.
ELAN.mod
[IMPORTANT NOTE: At the moment this is in an experimental state]
General
The goal of ELAN.mod is a minor change of ELAN source code in order to synchronously playback a recorded Instant Realtiy scene from the ELAN GUI. This enables the user to watch the actual video recorded in combination with a 3D scene from the InstantPlayer of the same recording.
Installation
Get the source code of ELAN annotation tool. Extract the archive to a folder of your choice and get our ELAN.mod patch. Integrate the folders from the elanmod.zip into the ELAN source code folder and overwrite the ELANFrame2.java. Once this is finished, build your ELAN.mod with ant. Use a command line tool (eg windows command prompt), navigate to the ELAN source root folder and just type "ant", then it will use the existing build.xml to build your patched ELAN.
Configuration
To configure ELAN.mod there is a config.properties file located in the folder structure. See at /src/config/config.properties. If there is noch such configuration file you can create on. Standart appearence would be as follows:
#configuration for rpc browser connection(appFAMEReplayer)
browserIP=localhost
browserPort=4242
#configuration for remote controll connection(mumodo)
remoteIP=localhost
remotePort=4241
#Offset settings
offsetDefault=0
#Frequency of synchronization in (ms)
syncFreq=200
Note: There is some sample data in mumodo package including all types of files you need (.eaf, .xio, .wav, .mp4) to see a little demonstration of what is possible. The playback scene for InstantReality visualization is located in the x3d package.
mumodo
General
Our IPython based data analysis software.
Installation
Download mumodo package.
Dependencies
EnthoughtPythonDistribution (not really a dependency per se, but it provides all the packages that are needed (IPython, numpy, matplotlib) in an easy package)
-
register for the academic version: http://www.enthought.com/productsdudownload.php
-
download: Windows: epd-7.3.2-win-x86.msi/epd-7.3.2-win-x86_64.msi
-
install: Windows: double-click the .msi-file to start
-
update packages: enpkg ipython, pandas
TextGridTool
-
install tgt (with python distribute: pip install tgt)
-
via github:git clone https://github.com/hbuschme/TextGridTools.git
-
cd TextGridTools
-
python setup.py install
-
-
(move the installed package to epd-x.x/lib/python2.7/site-packages)
for ELAN_mod remote control:
-
msgpackrpc
-
install with setup.py
-
msgpack
-
install with setup.py
Analytical Geometry Library (Vectors, Planes, Quaternions etc.)
-
euclid.py
-
Download from https://pypi.python.org/pypi/euclid
-
sudo python setup.py install
X3D files
General
We have collected some X3D files for you to see the possibilities of the InstantReality framework in combination with our software collection. See the comments in the X3D files for more information. Also visit InstantReality website.
Installation
Download X3D files and extract to a folder of your choice. Now you can open them with InstantReality or edit them with a text editor.
Third party software
InstantReality
The instantreality-framework is a high-performance Mixed-Reality (MR) system, which combines various components to provide a single and consistent interface for AR/VR developers built by Fraunhofer IGD.
IPython
IPython is an interactive shell for interactive computing in multiple programming languages, especially focused on the Python programming language, that offers enhanced introspection, rich media, additional shell syntax, tab completion, and rich history.
ELAN
ELAN is a professional tool for the creation of complex annotations on video and audio resources.