Version 4 (modified by masc01, 13 years ago) (diff)


SEMAINE-1.0: The first public SEMAINE demonstrator system

Released 23 December 2008.

The aim of SEMAINE is to build a Sensitive Artificial Listener (SAL) – a multimodal dialogue system with the social interaction skills needed for a sustained conversation with a human user.

As a snapshot of “work in progress”, the demonstrator aims to illustrate the following:

  • the SEMAINE project has proposed a system architecture for realising multimodal analysis and generation in a user-and-ECA dialogue situation;
  • a SEMAINE API has been created to allow processing components to communicate with each others according to the architecture, using appropriate representation formats at interfaces between components;
  • an initial set of components exist to partially realise the core functions of a SAL system.

The system is not yet intended to function as a fully operational, real-time SAL system; its main aim is to give an “early view” to technologically interested experts, indicating the direction in which the work is going. Individuals and research teams interested in cooperation around the SEMAINE platform are explicitly invited to contact the project team.

Installation and Use

As a pre-condition for installing and running the SEMAINE-1.0 system, you need to make sure that you have installed the Required Software.

The system comes in three parts.

  • SEMAINE-1.0-java. The core part is written in Java. It is needed for all configurations of the system.

The full system with speech input and audio-visual output requires at least two machines: one running Linux, and one running Windows.

Background Information

Detailed information on the system and the underlying software architecture can be found in this deliverable report.