Neumann J, Casas J, Macho D, Ruiz-Hidalgo J. Multimodal Integration of Sensor Network. In Artificial Intelligence Applications and Innovations. Boston: Springer; 2006. pp. 312–323.


At the Universitat Politècnica de Catalunya (UPC), a Smart Room has been equipped with 85 microphones and 8 cameras. This paper describes the setup of the sensors, gives an overview of the underlying hardware and software infrastructure and indicates possibilities for high- and low-level multi-modal interaction. An example of usage of the information collected from the distributed sensor network is explained in detail: the system supports a group of students that have to solve a lab assignment related problem.