Integration of audiovisual sensors and technologies in a smart room

At the Technical University of Catalonia (UPC), a smart room has been equipped with 85 microphones and 8 cameras. This paper describes the setup of the sensors, gives an overview of the underlying hardware and software infrastructure and indicates possibilities for high- and low-level multi-modal in...

Full description

Saved in:
Bibliographic Details
Published inPersonal and ubiquitous computing Vol. 13; no. 1; pp. 15 - 23
Main Authors Neumann, Joachim, Casas, Josep R., Macho, Dušan, Hidalgo, Javier Ruiz
Format Journal Article Publication
LanguageEnglish
Published London Springer-Verlag 01.01.2009
Springer Nature B.V
Subjects
Audiovisual communications
Automatic speech recognition
Automation
Computer Science
Enginyeria de la telecomunicació
Human-computer interaction
Mobile Computing
Original Article
Personal Computing
Sensors
Senyal, Teoria del (Telecomunicació)
Signal theory (Telecommunication)
Systems integration
User interface
User Interfaces and Human Computer Interaction
Àrees temàtiques de la UPC
Gesture Recognition
Automatic Speech Recognition
Central Logic
Speaker Identification
Microphone Array
Online AccessGet full text

Cover

More Information
Summary:At the Technical University of Catalonia (UPC), a smart room has been equipped with 85 microphones and 8 cameras. This paper describes the setup of the sensors, gives an overview of the underlying hardware and software infrastructure and indicates possibilities for high- and low-level multi-modal interaction. An example of usage of the information collected from the distributed sensor network is explained in detail: the system supports a group of students that have to solve a lab assignment related problem.
ISSN:1617-4909
1617-4917
DOI:10.1007/s00779-007-0172-1