Xavier Giró

Position	e-mail
Associate Professor	xavier.giro@upc.edu

Office	Phone
D5-117 (Barcelona - Campus Nord) TR2-102 (Terrassa - ESEIAAT)	+34 934 015 769

Biography

Xavier Giro-i-Nieto is an associate professor at the Universitat Politecnica de Catalunya (UPC) in Barcelona, as member of the Intelligent Data Science and Artificial Intelligence Research Center (IDEAI-UPC) and Image Processing Group (GPI), and also a visiting researcher at Barcelona Supercomputing Center (BSC). He graduated in Telecommuncations Engineering at ETSETB (UPC) in 2000, after completing his master thesis on image compression at the Vrije Universiteit in Brussels (VUB) with Prof. Peter Schelkens. After working one year in Sony Brussels, he started a Phd on computer vision, supervised by Prof. Ferran Marqués. In parallel, he designed and taught courses at the ESEIAAT (video content delivery) and ETSETB (deep learning) schools at UPC, as well as the Master in Computer Vision of Barcelona (video analysis). He visited multiple times the Digital Video and MultiMedia laboratory directed by Prof. Shih-Fu Chang at Columbia University in New York between 2008-2014, with whom keeps collaborating. He also works closely with the Insight Center of Data Analytics at Dublin City University, as well as his industrial partners at Vilynx, Mediapro, and Crisalix. He serves as associate editor at IEEE Transactions in Multimedia and reviews for top tier conferences in machine learning (NeurIPS, ICML), computer vision (CVPR, ECCV, ICCV) and multimedia (ACMMM, ICMR).

Latest News

October 2020: I will participate in ACM ICMR 2020 with a demo paper, tutorial and as area chair for Doctoral Symposium in Dublin.
June 2020: Invited to open the ROBOTICS & AI Summer School organized by UPC IRI.
June 2020: Outstanding reviewer mention at CVPR 2020 (only 3.7%, 141 out of 3805).
June 2020: Two extended abstracts accepted in CVPR 2020 workshops: one by Mariona Carós on Visual Question Answering and Dialog, and another one by Benet Oriol in the Egocentric Perception, Interaction and Computing (EPIC).
June 2020: Paper on unsupervised reinforcement learning accepted at ICML 2020 leaded by Víctor Campos and co-authored with Jordi Torres from BSC and Alexander Trott, Caiming Xiong, Richard Socher from Salesforce Research.
June 2020: Invited talk on video analytics for deep learning at Walt Disney - Direct to Consumer and International.
June 2020: Serving as area chair for ACM Multimedia 2020.
May 2020: I will serve as area chair in WACV 2021. Paper submission on June 12th (first round) and August 21st (second round).
April 2020: Our Phd student Míriam Bellver starts an internship in Amazon Barcelona.
April 2020: Our Phd student Víctor Campos starts an internship in Deepmind London.

External activities

Associate Editor:

IEEE Transactions on Multimedia (2017-2020)

Area Chair:

ACM Multimedia (2020, 2019, 2016), WACV 2021

Reviewer

CVPR (2020, 2019), ICCV (2019, 2017), ECCV (2020), ICIP (2014, 2003), EUSIPCO 2011.
NeurIPS (2020, 2019, 2018, 2017), ICLR (2018, 2017), ICML (2020, 2019, 2018),
ACM Multimedia (2019, 2018, 2017, 2016, 2014), ACM ICMR (2020, 2019, 2018, 2017).
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Multimedia Tools and Applications (MTAP), EURASIP Journal on Image and Video Processing, Multimedia Systems (MMSJ), Image and Vision Computing (IMAVIS)

Tutorial

Deep Learning for Multimedia: ACM ICMR 2020, MMM 2019.

Organization Commitee

Deep Learning Barcelona (2019, 2018), Lifelogging Tools and Applications (LTA) workshop at ACM Multimedia 2016 & 2017.

Awards

Outstanding reviewer mention at CVPR 2020, Best paper award at the CVPR 2019 DeepVision Workshop, Best scanpath prediction in Salient360 ICME Challenge 2017, Best poster award at LSCVS NIPS workshop 2016, Best poster award at ICMR 2016, Among Top 10% papers in ICIP 2015, Winner of the LSUN Saliency prediction challenge in CVPRW 2015, 2nd place in ChaLearn Cultural Event Recognition Challenge in CVPRW 2015, 2nd place in MediaEval Social Event Detection 2014, 3rd place in MediaEval Social Event Detection 2013, Winner of the Videobrowser Showdown in MMM 2012.

Scientific IDs: Google Scholar, WoK Researcher ID: M-5834-2013, ORCID: 0000-0002-9935-5332, Scopus Author ID: 35098596700, UPC Futur

Journal Articles top

2020
M. Bellver, Salvador, A., Torres, J., and Giró-i-Nieto, X., “Mask-guided sample selection for Semi-Supervised Instance Segmentation”, Multimedia Tools and Applications, 2020. DOI Google Scholar BibTex (2.2 MB)

2019
C. Ventura, Varas, D., Vilaplana, V., Giró-i-Nieto, X., and Marques, F., “Multiresolution co-clustering for uncalibrated multiview segmentation”, Signal Processing: Image Communication, 2019. DOI Google Scholar BibTex (4.35 MB)

2018
M. Assens, McGuinness, K., O'Connor, N., and Giró-i-Nieto, X., “Scanpath and Saliency Prediction on 360 Degree Images”, Elsevier Signal Processing: Image Communication, 2018. Google Scholar BibTex (2.61 MB)
M. Dimiccoli, Gurrin, C., Crandall, D., Giró-i-Nieto, X., and Radeva, P., “Introduction to the special issue: Egocentric Vision and Lifelogging”, Journal of Visual Communication and Image Representation, 2018. DOI Google Scholar BibTex (116.21 KB)

2017
V. Campos, Jou, B., and Giró-i-Nieto, X., “From Pixels to Sentiment: Fine-tuning CNNs for Visual Sentiment Prediction”, Image and Vision Computing, 2017. DOI Google Scholar BibTex (1.92 MB)

Book Chapters and Bookstop

2018
V. Campos, Giró-i-Nieto, X., Jou, B., Torres, J., and Chang, S. - F., “Sentiment concept embedding for visual affect recognition”, in Multimodal Behavior Analysis in theWild, 1st ed., Elsevier, 2018. Google Scholar BibTex

2017
E. Mohedano, Salvador, A., McGuinness, K., Giró-i-Nieto, X., O'Connor, N., and Marqués, F., “Object Retrieval with Deep Convolutional Features”, in Deep Learning for Image Processing Applications, vol. 31, Amsterdam, The Netherlands: IOS Press, 2017. DOI Google Scholar BibTex
M. Bellver, Giró-i-Nieto, X., Marqués, F., and Torres, J., “Hierarchical Object Detection with Deep Reinforcement Learning”, in Deep Learning for Image Processing Applications, vol. 31, Amsterdam, The Netherlands: IOS Press, 2017. DOI Google Scholar BibTex

2012
C. Ventura, Martos, M., Giró-i-Nieto, X., Vilaplana, V., and Marqués, F., “Hierarchical Navigation and Visual Search for Video Keyframe Retrieval”, in Advances in Multimedia Modeling, vol. 7131, Springer Berlin / Heidelberg, 2012, pp. 652-654. DOI Google Scholar BibTex
E. Carcel, Martos, M., Giró-i-Nieto, X., and Marqués, F., “Rich Internet Application for Semi-automatic Annotation of Semantic Shots on Keyframes”, in Computational Intelligence for Multimedia Understanding, vol. 7242, Pisa, Italy: Springer-Verlag, 2012, pp. 172-182. DOI Google Scholar BibTex (6.93 MB)

Conference Papers top

2020
M. Caros, Garolera, M., Radeva, P., and Giró-i-Nieto, X., “Automatic Reminiscence Therapy for Dementia”, in ACM International Conference on Multimedia Retrieval (ICMR), Dublin, Ireland, 2020. DOI Google Scholar BibTex (4.37 MB)
V. Campos, Trott, A., Xiong, C., Socher, R., Giró-i-Nieto, X., and Torres, J., “Explore, Discover and Learn: Unsupervised Discovery of State-Covering Skills”, in International Conference on Machine Learning (ICML) 2020, 2020. Google Scholar BibTex (6.89 MB)
X. Giró-i-Nieto, “One Perceptron to Rule Them All: Language, Vision, Audio and Speech (tutorial)”, in ACM International Conference on Multimedia Retrieval (ICMR) 2020, Dublin, Ireland, 2020. DOI Google Scholar BibTex (313.96 KB)
B. Oriol, Luque, J., Diego, F., and Giró-i-Nieto, X., “Transcription-Enriched Joint Embeddings or Spoken Descriptions of Images and Videos”, in CVPR 2020 Workshop on Egocentric Perception, Interaction and Computing, Seattle, WA, USA, 2020. Google Scholar BibTex (96.79 KB)

2019
E. Ramon, Escur, J., and Giró-i-Nieto, X., “Multi-View 3D Face Reconstruction in the Wild using Siamese Networks”, in ICCV 2019 Workshop on 3D Face Alignment in the Wild Challenge Workshop (3DFAW), Seoul, South Corea, 2019. Google Scholar BibTex (227.12 KB)

Theses top

2019
A. Salvador, “Computer Vision beyond the visible: Image understanding through language”, Universitat Politecnica de Catalunya, Barcelona, 2019. Google Scholar BibTex

2016
C. Ventura, “Visual Object Analysis using Regions and Local Features”, 2016. Google Scholar BibTex (2.5 MB)

2012
X. Giró-i-Nieto, “Part-Based Object Retrieval With Binary Partition Trees”, Universitat Politècnica de Catalunya (UPC), Barcelona, Catalonia, 2012. Google Scholar BibTex (16.34 MB)

Other top

2020
P. Pérez-Granero, “2D to 3D body pose estimation for sign language with Deep Learning”. 2020. Google Scholar BibTex (2.97 MB)	Ms Thesis
J. Escur, “Attention-based multi-view 3D reconstruction models”. 2020. Google Scholar BibTex	Ms Thesis

2019
E. Ramon, Villar, J., Ruiz, G., Batard, T., and Giró-i-Nieto, X., “Plug-and-Train Loss for Model-Based Single View 3D Reconstruction”, BMVA Technical Meeting: 3D vision with Deep Learning. UPC, London, UK, 2019. Google Scholar BibTex (3.97 MB)	Unpublished
X. Giró-i-Nieto, “Deep Learning Representations for All (a.ka. the AI hype)”. 2019. Google Scholar BibTex (10.95 MB)	Presentation
J. José Nieto, “Video Saliency Prediction with Deep Neural Networks”. 2019. Google Scholar BibTex (2.17 MB)	Ms Thesis

Projects top

	A European AI On Demand Platform and Ecosystem	European	Jan 2019	Dec 2021
	Deep Learning for Video Analytics in Sport Events	National	Feb 2018	Jan 2021
	MALEGRA - Multimodal Signal Processing and Machine Learning on Graphs	National	Jan 2017	Dec 2020
	Deep Learning for 3D reconstruction and Simulation of Aesthetic Procedures	National	Jul 2017	Jun 2020
	Large Scale Video Tagging with Knowledge Bases	National	Jun 2017	May 2020

Research Areas top

	Region-based image and video processing	Internal	Jan 1992	Dec 2020
	Lifelogging	Internal	Feb 2014	Dec 2020
	Affective Computing	Internal	Jan 2015	Dec 2020
	Deep learning	Internal	Jun 2014	Dec 2020
	Saliency prediction	Internal	Feb 2015	Dec 2019

Demos and Resources top

	EgoMon Gaze & Video Dataset	Dataset	Jul 2016
	UPC at CVPRW Visual Question Answering Challenge 2016	Software	Jun 2016
	UPC at CVPRW ActivityNet Challenge 2016	Software	Jun 2016
	Faster R-CNN Features for Instance Search (software)	Software	May 2016
	Sentiment maps generator	Software	Apr 2016

Teaching top

Acronym	Title	Level	College
BIOM	Biometric Technologies	Master in Telecommunications Engineering (MET)	ETSETB - Telecom BCN
DLAI	Deep Learning for Artificial Intelligence	Master MET	ETSETB TelecomBCN
DLCV	Deep Learning for Computer Vision	Master in Telecommunications Engineering (MET)	ETSETB Telecom BCN
DLMM	Deep Learning for Multimedia	Master & PhD	Dublin City University
DLSL	Deep Learning for Speech and Language	BSc, MSc & Phd	ETSETB TelecomBCN
IDL	Introduction to Deep Learning	BSc	ETSETB TelecomBCN
GDSA	Multimedia Content Management and Delivery	Degree in Audiovisual Systems (3rd year)	Escola Superior d'Enginyeries Industrials, Aeroespacial i Audiovisual de Terrassa (ESEIAAT)
VA	Video Analysis	Master in Computer Vision (MCV)	UAB, UOC, UPC & UPF