BigGraph - Heterogeneous information and graph signal processing for the Big Data era. Application to high-throughput, remote sensing, multimedia and human computer interfaces.

Type Start End
National Jan 2014 Dec 2017
Responsible URL
Montse Pardàs / Javier Ruiz-Hidalgo

Reference

BIGGRAPH- TEC2013-43935-R, financed by the Spanish Ministerio de Economía y Competitividad and the European Regional Development Fund (ERDF) 

 

Description

The aim of this project is to contribute to the progress of both the theoretical aspects of the research related to graph and tree signals and to three major application areas related to Big Data.

Graph or tree representations have the intrinsic ability of structuring the content in a scalable manner and handling heterogeneous sources of information. Therefore, they are well suited to be applied in Big Data applications where the amount of information is extremely large and the heterogeneity of the sources very often present.

The project is structured in two workpackages. The first one deals with the representation and processing of heterogeneous information and graph signals. In many cases, the original data is unstructured and based on very simple or numerous primitives (image pixels, gene expressions, etc.). This is a serious drawback for many applications and there is a current trend in the research community to define meaningful primitives and to structure them. Graphs or trees are very attractive for this task as they are formed by nodes representing meaningful and possibly heterogeneous primitives and by edges representing relations between these primitives. Specific techniques to create graphs, trees and hierarchical graphs with various edge notions will be studied for different types of data: unordered data such as microarrays or consumer data, 2D images, 3D data from multi-camera systems, and videos.

From the graph and tree structures, graph and tree signals are constructed populating them with features attached to either the vertices or the edges. Most of classical graph theory has focused on the analysis of the graph structure. In this project we want to process the signals that are defined on a graph or tree support. A major objective is to develop a full toolkit for graph signal processing, which is an emerging topic in the scientific community. The project will develop signal processing tools in the context of Graphs and Trees including convolution-based and morphological filters, frequency analysis and transform, wavelet decomposition and processing in the transformed domain, down-sampling and up-sampling, interpolation, etc. Higher-level processing tools are also of interest, in particular, segmentation and classification algorithms.

The second workpackage deals with Big Data applications, and will show how difficult issues related to Big Data applications can be handled with tools developed in WP1. There are three different areas that will be tackled. For high throughput screening experiments, such as genomics and connectomics, the major challenges are to infer the structure of the data and to demonstrate the interest of advanced processing techniques applied on graph and tree signals to extract reliable information useful for biologists or doctors. For image and video applications, such as indexing and retrieval or remote sensing, the techniques developed in WP1 will allow us to deal with the heterogeneity of the data. In the context of geometric and temporal 3D applications, characterized by the complex handling of the geometrical information and its temporal evolution, we will develop a unified approach based on graphs for human body gestures recognition and scene understanding, and we will deal with data from multi-view plus depth scenarios.

Publications

Luque B, Morros JR, Ruiz-Hidalgo J. Spatio-Temporal Road Detection from Aerial Imagery using CNNs. In: International Conference on Computer Vision Theory and Applications. International Conference on Computer Vision Theory and Applications. Porto, Portugal; 2017. (6.14 MB)
Gurrin C, Giró-i-Nieto X, Radeva P, Dimiccoli M, Dang-Nguyen D-T, Joho H. LTA 2017: The Second Workshop on Lifelogging Tools and Applications. In: ACM Multimedia. ACM Multimedia. Mountain View, California USA: ACM; 2017. (309.94 KB)
Fernàndez D, Woodward A, Campos V, Jou B, Giró-i-Nieto X, Chang S-F. More cat than cute? Interpretable Prediction of Adjective-Noun Pairs. In: ACM Multimedia 2017 Workshop on Multimodal Understanding of Social, Affective and Subjective Attributes. ACM Multimedia 2017 Workshop on Multimodal Understanding of Social, Affective and Subjective Attributes. Mountain View, CA (USA): ACM SIGMM; 2017. (9.62 MB)
Martínez PA, Lin X, Castelán M, Casas J, Arechavaleta G. A closed-loop approach for tracking a humanoid robot using particle filtering and depth data. Intelligent Service Robotics. 2017 ;10(4):297–312. (88.92 KB)
Lidon A, Bolaños M, Dimiccoli M, Radeva P, Garolera M, Giró-i-Nieto X. Semantic Summarization of Egocentric Photo Stream Events. In: ACM Multimedia 2017 Workshop on Lifelogging Tools and Applications. ACM Multimedia 2017 Workshop on Lifelogging Tools and Applications. Mountain View, CA, USA: ACM; 2017. (3.08 MB)
Pujol-Miró A, Ruiz-Hidalgo J, Casas J. Registration of Images to Unorganized 3D Point Clouds Using Contour Cues. In: The 25th European Signal Processing Conference (EUSIPCO 2017). The 25th European Signal Processing Conference (EUSIPCO 2017). Kos island, Greece: Eurasip; 2017. (3.14 MB)
Lin X, Casas J, Pardàs M. 3D Point Cloud Segmentation Using a Fully Connected Conditional Random Field. In: The 25th European Signal Processing Conference (EUSIPCO 2017). The 25th European Signal Processing Conference (EUSIPCO 2017). Kos island, Greece: Eurasip; 2017. (2.34 MB)
Maceira M. Multi-view depth coding based on a region representation combining color and depth information Ruiz-Hidalgo J, Morros JR. Signal Theory and Communications (TSC). 2017 .
Torres J, Sastre F, Yagües M, Campos V, Giró-i-Nieto X. Scaling a Convolutional Neural Network for classification of Adjective Noun Pairs with TensorFlow on GPU Clusters. In: 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid). 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid). Madrid, Spain: IEEE; 2017.
Salvador A, Hynes N, Aytar Y, Marin J, Ofli F, Weber I, Torralba A. Learning Cross-modal Embeddings for Cooking Recipes and Food Images. In: CVPR. CVPR. Honolulu, Hawaii, USA: CVF / IEEE; 2017.

Pages