Multimodal interaction : how to interact with the whole body

Humans use a variety of modalities to communicate, including speech, gesture, facial expression and body movement. This lesson traces the history of interactive systems that go beyond the classic input-output of mouse, keyboard and screen, to work that combines several modalities, such as speech and gesture. In particular, it presents applications in the field of creativity, where users use their whole body to control the system.