MuViPro - Multicamera Video Processing

Type Start End
National Jan 2011 Aug 2014
Responsible URL
Josep R. Casas


Multicamera Video Processing exploiting scene information applied to Sports Events, Visual Interaction and 3DTV. Ref. TEC2010-18094, Spanish Ministerio de Ciencia e Innovación, now Ministerio de Economía y Competitividad


The major goal of the current project is to investigate the extension of video processing tools to more generic multicamera settings, and a wider range of video processing applications. This goal is stated through the following objectives:

  • Extension of existing and development of new video processing algorithms for visual analysis and representation considering the multiview and segmented views for multicamera setups and the available knowledge for controlled scenarios. In particular, low-level analysis algorithms including foreground detection and tracking, visual matching and 3D scene representation, high-level analysis algorithms such as human body analysis and the analysis of objects, text, faces and events, and video coding algorithms in multicamera settings for 3D and stereoscopic video signals
  • Focus new target applications such as sport events, 3DTV/Free view-point TV (FTV), and visual interaction where multi-camera setups and ‘a priori‘ knowledge of the scenario can be exploited for analysis and representation tasks. These three applications offer adequate and demanding scenarios to extend the tools developped for controlled environments to a wider set of multiple camera setups and scenarios.

The specific objectives for the extension of video processing algorithms are as follows

  • Low-level analysis algorithms: to improve the performance of available tools for foreground detection and tracking, visual matching and 3D scene representation considering a wide range of camera setups (including segmented and multiview multicamera setups) and study their extension to less controlled environments.
  • High-level analysis algorithms and video coding: to extend the tools for human body analysis and the analysis of objects, text, faces and events in the scene to the requirements of the new application scenarios and to exploit the particular setup of multicamera capture.

The specific objectives for the newly targeted applications have the common goal of evaluating the tools and proving their interest:

  • Sports events: definition of a processing strategy exploiting the knowledge of the scenario and the multicamera setup for the visual analysis and coding of sports footage
  • Visual interaction: increase the robustness of gesture detection for visual interaction either in multiview camera settings or in limited multicamera settings for office or home applications
  • 3DTV/FTV: algorithms for stereoscopic video analysis and coding will be extended to data from a new audiovisual production laboratory, which will be built in 2010 in the Signal Theory and Communications Department to foster research and technology transfer in 3DTV video and Free viewpoint TV applications


Varas D. Region-based Particle Filter Leveraged with a Hierarchical Co-clustering Marqués F. Signal Theory and Communications Department. 2016 .
Alcoverro M. Stochastic optimization and interactive machine learning for human motion analysis Pardàs M, Casas J. Signal Theory and Communications. 2014 . (17.16 MB)
Morros JR, Vilaplana V, Ruiz-Hidalgo J, Casas J, Gasull A, Marqués F, Pardàs M, Salembier P. Materials transversals per a l'aprenentatge actiu de les matèries de processat d'imatge i vídeo. In: Congrés Internacional de Docència Universitària i Innovació (CIDUI). Congrés Internacional de Docència Universitària i Innovació (CIDUI). Tarragona, Spain; 2014. (853.76 KB)
Bosio M. Hierarchical information representation and efficient classification of gene expression microarray data Salembier P, Oliveras A. TSC. 2014 ;PhD Thesis:150. (2.76 MB)
Suau X, Alcoverro M, López-Méndez A, Ruiz-Hidalgo J, Casas J. Real-time Fingertip Localization Conditioned on Hand Gesture Classification. Image and Vision Computing. 2014 ;32(8):522 - 532. (2.66 MB)
Giró-i-Nieto X, Martos M, Mohedano E, Pont-Tuset J. From Global Image Annotation to Interactive Object Segmentation. Multimedia Tools and Applications. 2014 ;70. (1.71 MB)
Palou G, Salembier P. Depth order estimation for video frames using motion occlusions. IET Computer Vision. 2014 ;8(2):152-160. (910.25 KB)
Palou G. Monocular Depth Estimation in Images and Sequences using Occlusion Cues Salembier P. Signal Theory and Communications. 2014 ;PhD:250. (107.61 MB)
Pont-Tuset J. Image Segmentation Evaluation and Its Application to Object Detection Marqués F. 2014 . (48.44 MB)
Palou G, Salembier P. Monocular Depth Ordering Using T-junctions and Convexity Occlusion Cues. IEEE Transactions on Image Processing. 2013 ;22(5): 1926 - 1939 . (2.64 MB)