[Elsnet-list] CfP: AISB symposium on Multimodal Output Generation

M.Theune at ewi.utwente.nl M.Theune at ewi.utwente.nl
Mon Nov 5 11:10:58 CET 2007

[Appologies for multiple postings.]

3 and 4 April 2008, Aberdeen, Scotland, UK http://www.csd.abdn.ac.uk/~ivdsluis/mog2008/


An important aspect of the new generation of intelligent systems is the 
possibility to employ more than one output modality when interacting 
with the user. A quick and successful interaction is expected when, for 
instance, the system's output is presented to the user via 
multimedia/hypermedia in which text and graphics are merged, or by a 
conversational agent that combines the use of speech and gesture. In 
such multimodal systems sophisticated specifications are needed to 
combine the different output modalities in such a way that each bit of 
information is presented in the most appropriate manner (i.e., the 
system should select the most suitable modalities and modality 
combinations to convey information to the user).

The AISB symposium MOG 2008 aims to bring work on multimodal output 
generation from different disciplines together to establish common 
ground and discuss possible future collaborations. Besides contributions 
from research fields such as multimodal language generation and embodied 
conversational agents, we would like to bring in an additional angle by 
investigating how research on multimodal output generation can benefit 
from a non-engineering perspective on multimodality. For example, how 
can research done in psychology and cognitive sciences, related to 
understanding how humans perceive and process multimodal information, be 
properly formalized for the purposes of intelligent multimodal output 
generation? And to what extent is it possible to formalize existing 
theories about how meaning is made in multimodal communication (the 
semiotic perspective, represented by our guest speaker Prof. Eija 
Ventola) and use that for generating more meaningful multimodal output 
in the context of intelligent systems?

Thus, we invite technically oriented contributions as well as work in 
the area of human communication, such as cognitive models of multimodal 
communication and interaction. This way, we hope to combine an 
AI/engineering perspective with input from other disciplines such as 
linguistics and psychology, providing a forum where international 
researchers from different disciplinary backgrounds can exchange ideas 
on multimodal output generation and engage in scientific research 

MOG 2008 is a follow-up of MOG 2007, the workshop on Multimodal Output 
Generation organized on January 25-26, 2007, at the University of Aberdeen.


The symposium will take place in two consecutive days. Note that this is 
provisional depending on the number of submissions. Apart from the talks 
in which the participants present their work there will also be central 
discussions that should result in useful strategies for future work. All 
accepted papers will have a poster space on the same day as their paper 


We welcome submissions on issues such as modality choice, integration of 
output modalities, and meaning representation for multimodal output 
generation, where natural language (in the form of either text or 
speech) is one of the modalities. We aim to have a varied programme that 
reflects the different research fields involved in multimodal output 
generation. Possible topics are listed below, but this list is not 
intended to be exhaustive.

     * task-based modality choice (domain and data dependencies)
     * user-based modality choice (constraints, preferences and expertise)
     * cross-references between modalities (e.g., text and graphics)
     * dependencies between modalities (e.g., speech, mimics and gestures)
     * relation between input and output modalities
     * integration of modalities (models, levels, dependencies)
     * cognitive models for processing multimodal information
     * computational models for multimodal output generation
     * models of modality integration based on multimodal discourse analysis
     * usability and evaluation of existing models
     * knowledge representation for multimodal output generation
     * evaluation of (methods for generating) multimodal output
     * development of multimodal corpora from a generation perspective


Eija Ventola (University of Helsinki)
Second invited speaker to be announced.


We invite both long papers describing mature research (max. 8 pages) and 
short papers (max. 4 pages) describing plans, ideas and demos, which 
could invoke discussion and questions to be addressed in the future.

Accepted papers will be published in the AISB proceedings, with an ISBN 
number. Authors must sign a non-exclusive copyright declaration which 
gives AISB the right to publish the paper, but does not prevent the 
author from also publishing it in other venues after.

We intend to publish a special issue journal or book collection (e.g., 
LNCS or LNAI) based on a selection of the best papers from MOG 2007 and 
MOG 2008.

Paper formatting instructions and templates can be downloaded here:

Papers can be submitted by e-mail to: mog2008<at>ewi.utwente.nl 
(Substitute @ sign for <at>)


     * Submission of papers: January 7, 2008
     * Notification: February 15, 2008
     * Full paper deadline: March 16, 2008
     * Symposium dates: April 3-4, 2008

(Note that the symposium dates are provisional, subject to the number of 
final accepted papers.)


     * Mariët Theune, University of Twente, The Netherlands
     * Yulia Bachvarova, University of Twente, The Netherlands
     * Elisabeth André, University of Augsburg, Germany
     * Ielka van der Sluis, University of Aberdeen, UK


     * Adrian Bangerter, University of Neuchatel, Switzerland
     * Ellen Gurman Bard, University of Edinburgh, UK
     * John Bateman, University of Bremen, Germany
     * Harry Bunt, Tilburg University, The Netherlands
     * Justine Cassell, Northwestern University, US
     * Stephan Kopp, University of Bielefeld, Germany
     * Emiel Krahmer, Tilburg University, The Netherlands
     * Theo van Leeuwen, University of Technology Sydney, Australia
     * Anton Nijholt, University of Twente, The Netherlands
     * Jon Oberlander, University of Edinburgh, UK
     * Niels Ole Bernsen, University of Southern Denmark
     * Ehud Reiter, University of Aberdeen, UK
     * Jan Peter de Ruiter, Max Planck Institute, The Netherlands
     * Jacques Terken, Eindhoven University, The Netherlands
     * Eija Ventola, University of Helsinki, Finland
     * Ipke Wachsmuth, University of Bielefeld, Germany


The MOG 2008 Symposium is sponsored by the research project IMOGEN: 

MOG 2008 is endorsed by:
- SIGGEN, the ACL Special Interest Group on Generation
- SIGMEDIA, the ACL Special Interest Group on Multimedia Language 

AISB 2008

The MOG 2008 Symposium is part of the AISB 2008 Convention on 
Communication, Interaction and Social Intelligence, April 1-4, 2008, 
Aberdeen, Scotland. For information on travel, accommodation, and 
registration see the AISB 2008 website: 

Note that there is an AISB best student paper award, and student 
scholarships are available: 

MOG 2008 e-mail contact: mog2008<at>ewi.utwente.nl (Substitute @ sign 
for <at>)

More information about the Elsnet-list mailing list