Incremental Spoken Language Processing

A Tutorial at Interspeech 2013

Timo Baumann (Universität Hamburg) and David Schlangen (Bielefeld University)


The tutorial will take place on Sunday, August 25, from 9am until 12:20pm. Room tba.

Learning Goals

After completing this tutorial, you will


Note that some slides make heavy use of transitions and builds, and others contain videos or audio examples. We’re still trying to come up with a good way of how to distribute these. For now, you can find here versions with the only the final builds of each slide (“compact”) and with builds spread over several pages (“expanded”). As they are, the slides will give you a good idea of what’s going to be covered (and something to write on, if you print them out[1]), but they certainly aren’t self-contained. But all the better, that gives you a good reason to be there in person. Update 2013–08–21 We’ve now made silent movie-type title cards (“intertitles”) that explain (on the handout only) the animations that follow. So there isn’t really a need for the expanded slides anymore, and we’ve removed them.

  1. Part 1: Motivation and Concepts
    1. Motivation. Why bother with incremental processing?
    2. An Abstract Model of (incremental) Spoken Language Processing.
    3. Evaluation of Incremental Processing Systems and Modules
  2. Part 2: Challenges and Approaches
    1. Incremental Speech Recognition
    2. Incremental Natural Language Understanding
    3. Incremental Dialogue Management
    4. Incremental Speech Output Generation
  3. Part 3: InproTK, A Framework for Incremental Processing
    • more information on the toolkit can be found here, and the source code is here)

All slides in one pdf (17 MB!).

Slide Revision History

Annotated Bibliography

An annotated (but, alas, not nearly as complete as we’d like it to be) bibliography is here.


Let us know what you thought about the tutorial, what you took away, what you’d rather have heard, what you liked, what you didn’t, projects that you’re planning to do in this area, ideas you have…

  1. If you print out the expanded slides, you will have enough scrap paper to write on for the next several months…  ↩