MuViPro - Multicamera Video Processing

Type Start End
National Jan 2011 Aug 2014
Responsible URL
Josep R. Casas

Reference

Multicamera Video Processing exploiting scene information applied to Sports Events, Visual Interaction and 3DTV. Ref. TEC2010-18094, Spanish Ministerio de Ciencia e Innovación, now Ministerio de Economía y Competitividad

Description

The major goal of the current project is to investigate the extension of video processing tools to more generic multicamera settings, and a wider range of video processing applications. This goal is stated through the following objectives:

  • Extension of existing and development of new video processing algorithms for visual analysis and representation considering the multiview and segmented views for multicamera setups and the available knowledge for controlled scenarios. In particular, low-level analysis algorithms including foreground detection and tracking, visual matching and 3D scene representation, high-level analysis algorithms such as human body analysis and the analysis of objects, text, faces and events, and video coding algorithms in multicamera settings for 3D and stereoscopic video signals
  • Focus new target applications such as sport events, 3DTV/Free view-point TV (FTV), and visual interaction where multi-camera setups and ‘a priori‘ knowledge of the scenario can be exploited for analysis and representation tasks. These three applications offer adequate and demanding scenarios to extend the tools developped for controlled environments to a wider set of multiple camera setups and scenarios.

The specific objectives for the extension of video processing algorithms are as follows

  • Low-level analysis algorithms: to improve the performance of available tools for foreground detection and tracking, visual matching and 3D scene representation considering a wide range of camera setups (including segmented and multiview multicamera setups) and study their extension to less controlled environments.
  • High-level analysis algorithms and video coding: to extend the tools for human body analysis and the analysis of objects, text, faces and events in the scene to the requirements of the new application scenarios and to exploit the particular setup of multicamera capture.

The specific objectives for the newly targeted applications have the common goal of evaluating the tools and proving their interest:

  • Sports events: definition of a processing strategy exploiting the knowledge of the scenario and the multicamera setup for the visual analysis and coding of sports footage
  • Visual interaction: increase the robustness of gesture detection for visual interaction either in multiview camera settings or in limited multicamera settings for office or home applications
  • 3DTV/FTV: algorithms for stereoscopic video analysis and coding will be extended to data from a new audiovisual production laboratory, which will be built in 2010 in the Signal Theory and Communications Department to foster research and technology transfer in 3DTV video and Free viewpoint TV applications

Publications

Ventura C. Visual Object Analysis Using Regions and Interest Points Giró-i-Nieto X. ACM Multimedia. 2013 . (132.2 KB)
Ventura C, Tella M, Giró-i-Nieto X. UPC at MediaEval 2013 Hyperlinking Task. In: MediaEval 2013 Workshop. MediaEval 2013 Workshop. Barcelona, Catalonia: CEUR Workshop Proceedings Vol-1043; 2013. (1.62 MB)
Vilaplana V, Muntaner G. Salient Object Detection on a Hierarchy of Image Partitions. In: IEEE Int. Conf. in Image Processing, ICIP 2013. IEEE Int. Conf. in Image Processing, ICIP 2013. Melbourne, Australia; 2013.
Salvador J, Casas J. Multi-View Video Representation Based on Fast Monte Carlo Surface Reconstruction. IEEE Transactions on Image Processing. 2013 ;22(9):3342 - 3352. (6.16 MB)
Molina J, Escudero-Viñolo M, Signorelo A, Pardàs M, Ferran C, Bescós J, Marqués F, Martínez J. Real-time user independent hand gesture recognition from time-of-flight camera video using static and dynamic models. Machine vision and applications. 2013 ;24(1):187–204.
Maceira M, Morros JR, Ruiz-Hidalgo J. Fusion of colour and depth partitions for depth map coding. In: Digital Signal Processing. Digital Signal Processing. Santorini, Greece; 2013. (6.27 MB)
Suau X. Human body analysis using depth data Casas J, Ruiz-Hidalgo J. 2013 . (10.67 MB)
Gallego J. Parametric Region-Based Foreground Segmentation in Planar and Multi-View Sequences Pardàs M. 2013 . (70.23 MB)
Suau X, Ruiz-Hidalgo J, Casas J. Detecting End-Effectors on 2.5D data using Geometric Deformable Models: Application to Human Pose Estimation. Computer Vision and Image Understanding (CVIU). 2013 ;117(3). (1.44 MB)
López-Méndez A, Casas J. Can our TV robustly understand human gestures? Real-Time Gesture Localization in Range Data. In: Conference on Visual Media Production. Conference on Visual Media Production. London, UK: ACM; 2012. (5.62 MB)

Pages