| Title: |
Bayesian networks and information theory for audio-visual perception modeling |
| Authors: |
Besson, Patricia; Richiardi, Jonas; Bourdin, Christophe; Bringoux, Lionel; Mestre, Daniel R.; Vercher, Jean-Louis |
| Contributors: |
Institut des Sciences du Mouvement Etienne Jules Marey (ISM); Aix Marseille Université (AMU)-Centre National de la Recherche Scientifique (CNRS); Speech Processing and Biometrics Group (Laboratory of IDIAP; Signal Processing Institute; SwissFederal Institute of Technology ) (GTPB) |
| Source: |
ISSN: 0340-1200. |
| Publisher Information: |
CCSD; Springer Verlag |
| Publication Year: |
2010 |
| Collection: |
Aix-Marseille Université: HAL |
| Subject Terms: |
Graphical model; Information theory; Mutual information; Causal Bayesian networks; Decision process; Model elicitation; [SCCO.NEUR]Cognitive science/Neuroscience |
| Description: |
International audience ; Thanks to their different senses, human observers acquire multiple information coming from their environment. Complex cross-modal interactions occur during this perceptual process. This article proposes a framework to analyze and model these interactions through a rigorous and systematic data-driven process. This requires considering the general relationships between the physical events or factors involved in the process, not only in quantitative terms, but also in term of the influence of one factor on another. We use tools from information theory and probabilistic reasoning to derive relationships between the random variables of interest, where the central notion is that of conditional independence. Using mutual information analysis to guide the model elicitation process, a probabilistic causal model encoded as a Bayesian network is obtained. We exemplify the method by using data collected in an audio-visual localization task for human subjects, and we show that it yields a well-motivated model with good predictive ability. The model elicitation process offers new prospects for the investigation of the cognitive mechanisms of multisensory perception. |
| Document Type: |
article in journal/newspaper |
| Language: |
English |
| DOI: |
10.1007/s00422-010-0392-8 |
| Availability: |
https://hal.science/hal-01436027; https://hal.science/hal-01436027v1/document; https://hal.science/hal-01436027v1/file/Besson,%20Richardi,%20Bourdin,%20Bringoux,%20Mestre,%20Vercher%20%282010%29%20BiolCybern.pdf; https://doi.org/10.1007/s00422-010-0392-8 |
| Rights: |
https://about.hal.science/hal-authorisation-v1/ ; info:eu-repo/semantics/OpenAccess |
| Accession Number: |
edsbas.9D68400A |
| Database: |
BASE |