Multi-Sensory Perceptive Systems: Human and Machine Processing of Multi-Modal Data

Schedule/Format

Presentation Abstracts

Organizers &
Participants

Bibliography

Demos &
Related Links

Internal

Scope

All perception is multi-sensory perception. Situations where animals are exposed to information from a single modality exist only in experimental settings in the laboratory. For a variety of reasons, research on perception has focused on processing within one sensory modality. Consequently, the state of knowledge about multi-sensory fusion in mammals is largely at the level of phenomenology, and the underlying mechanisms and principles are poorly understood. Recently, however, there has been a surge of interest in this topic, and this field is emerging as one of fast growing areas of research in perception.

Simultaneously and with the advent of low-cost, low-power multi-media sensors there has been renewed interest in automated multi-modal data processing. Whether it be in an intelligent room environment, heterogenous sensor array or the autonomous robot, robust integrated processing of multiple modalities has the potential to solve perception problems more efficiently by leveraging complementary sensor information.

Goals

The goals of this workshop are to further the understanding of the both the cognitive mechanisms by which humans (and other animals) integrate multi-modal data as well as the means by which automated systems may similarly function. It is not our contention that one should follow the other. It is our contention, that researchers in these different communities stand to gain much through interaction with each other. This workshop aims to bring these researchers together to compare methods and performance and to develop a common understanding of the underlying principles which might be used to analyze both human and machine perception of multi-modal data. Discussions and presentations will span theory, application, as well as relevant aspects of animal/machine perception.

Topical Issues

The workshop will emphasize a moderated discussion format with short presentations prefacing each of the discussions. The presentations and discussions would be organized around the following related questions: