Towards Word Semantics from Multi-modal Acoustico-Motor Integration Application of the Bijama Model to the Setting of Action-Dependant Phonetic Representations
Olivier Ménard, Frédéric Alexandre and Hervé Frezza-Buet

Abstract

This paper presents a computational self-organizing model of multi-modal information, inspired from cortical maps. It shows how the organization in a map can be influenced by the same process occurring in other maps. We illustrate this approach on a phonetic - motor association, that shows that the organization of words can integrate motor constraints, as observed in humans.