Xavier Giró
Biography
Xavier Giro-i-Nieto is an associate professor at the Universitat Politecnica de Catalunya (UPC) in Barcelona, member of the Image Processing Group (GPI), Intelligent Data Science and Artificial Intelligence Research Center (IDEAI-UPC), Institute of Industrial Robotics (IRI), and also a visiting researcher at Barcelona Supercomputing Center (BSC). He graduated in Telecommunications Engineering at ETSETB (UPC) in 2000, after completing his master thesis on image compression at the Vrije Universiteit in Brussels (VUB) with Prof. Peter Schelkens. After working one year in Sony Brussels, he returned to UPC to obtain a PhD on computer vision, supervised by Prof. Ferran Marqués and Prof. Shih-Fu Chang from the Digital Video and MultiMedia laboratory at Columbia University, that he repeateadly visited between 2008-2014. Dr. Giró is the director of the Postgraduate on Artificial Intelligence with Deep Learning at UPC School, and also teaches undergradute and graduate course on deep learning at ESEIAAT and ETSETB schools at UPC, as well as the Master in Computer Vision of Barcelona. He regularly collaborates with the Insight Center of Data Analytics at Dublin City University, and is a member of the Governance Committee of the Science Foundation Ireland Centre for Research Training in Machine Learning. From a transfer technology perspective, he collaborates with Barcelona-based companies Crisalix and Viume, and was a member of the scientific advisory committee of Vilynx (acquired by Apple in 2020). He is a member iof ACM SIGMM and IEEE SPS, serves as associate editor at IEEE Transactions in Multimedia and reviews for top tier conferences in machine learning (NeurIPS, ICML), computer vision (CVPR, ECCV, ICCV) and multimedia (ACMMM, ICMR).
Latest News
- October 2021: Area chair in ICCV 2021 and ACM Multimedia 2021.
- Septembre 2021: Invited talk on Sign Language at the Irish Machine Vision and Image Processing Conference (IMVIP) & CMU VASC Seminar.
- July 2021: Two papers accepted in ICCV 2021. One on 3D head reconstruction, and another one of self-supervised learnig for remote sensing.
- July 2021: Invited at the Robotics & AI Summer School at IRI, International Summer School on Deep Learning 2021 and PAISS 2021 Summer School (social guest).
- March 2021: Míriam Bellver defended her Phd thesis on image and video segmentation with low supervision. She has joined Amazon Barcelona.
- March 2021: Our new How2Sign dataset for sign language was accepted in CVPR 2021, lead by our Phd candidate Amanda Duarte.
- March 2021: Andreu Girbau defended his industrial PhD on multiple object tracking. Co-advised with Ferran Marqués and Ignais Rius (Automatic TV). He will join the National Institute of Informatics (NII) in Tokyo.
- December 2020: Víctor Campos defended his PhD thesis "Deep Learning that Scales: Leveraging Compute and Data". He has joined Deepmind London.
- October 2020: Appointed as member of the Governance Committee of the Science Foundation Ireland Centre for Research Training in Machine Learning.
- October 2020: Recognized among the 10% top reviewers for NeurIPS 2020.
External activities
- Associate Editor:
- Area Chair:
- Reviewer
- CVPR (2021, 2020, 2019), ICCV (2019, 2017), ECCV (2020), ICIP (2014, 2003), EUSIPCO 2011.
- NeurIPS (2021, 2020, 2019, 2018, 2017), ICLR (2018, 2017), ICML (2020, 2019, 2018),
- ACM Multimedia (2019, 2018, 2017, 2016, 2014), ACM ICMR (2021, 2020, 2019, 2018, 2017).
- IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Multimedia Tools and Applications (MTAP), EURASIP Journal on Image and Video Processing, Multimedia Systems (MMSJ), Image and Vision Computing (IMAVIS)
- Tutorial
- Deep Learning for Multimedia: ACM ICMR 2020, MMM 2019.
- Organization Commitee
- Deep Learning Barcelona (2019, 2018), Lifelogging Tools and Applications (LTA) workshop at ACM Multimedia 2016 & 2017, Annual Catalan Meeting on Computer Vision (2020).
- Awards & recognitions
- Top 10% reviewer at NeurIPS 2020, Top 33% reviewer at ICML 2020, Outstanding reviewer mention at CVPR 2020, Best paper award at the CVPR 2019 DeepVision Workshop, Best scanpath prediction in Salient360 ICME Challenge 2017, Best poster award at LSCVS NIPS workshop 2016, Best poster award at ICMR 2016, Among Top 10% papers in ICIP 2015, Winner of the LSUN Saliency prediction challenge in CVPRW 2015, 2nd place in ChaLearn Cultural Event Recognition Challenge in CVPRW 2015, 2nd place in MediaEval Social Event Detection 2014, 3rd place in MediaEval Social Event Detection 2013, Winner of the Videobrowser Showdown in MMM 2012.
- Advisor for the awarded MSc thesis of Adrià Romero (Càtedra Telefònica 2017), Víctor Campos (ACIA 2017), Dèlia Fernàndez (MCV 2016) and Òscar Mañas (MCV 2020).
Scientific IDs: Google Scholar, WoK Researcher ID: M-5834-2013, ORCID: 0000-0002-9935-5332, Scopus Author ID: 35098596700, UPC Futur
Journal Articles top
, “Mask-guided sample selection for Semi-Supervised Instance Segmentation”, Multimedia Tools and Applications, 2020. (2.2 MB) |
|
, “Multiresolution co-clustering for uncalibrated multiview segmentation”, Signal Processing: Image Communication, 2019. (4.35 MB) |
|
, “Scanpath and Saliency Prediction on 360 Degree Images”, Elsevier Signal Processing: Image Communication, 2018. (2.61 MB) |
|
, “Introduction to the special issue: Egocentric Vision and Lifelogging”, Journal of Visual Communication and Image Representation, 2018. (116.21 KB) |
|
, “From Pixels to Sentiment: Fine-tuning CNNs for Visual Sentiment Prediction”, Image and Vision Computing, 2017. (1.92 MB) |
Book Chapters and Bookstop
| , “Sentiment concept embedding for visual affect recognition”, in Multimodal Behavior Analysis in theWild, 1st ed., Elsevier, 2018. |
| , “Object Retrieval with Deep Convolutional Features”, in Deep Learning for Image Processing Applications, vol. 31, Amsterdam, The Netherlands: IOS Press, 2017. |
| , “Hierarchical Object Detection with Deep Reinforcement Learning”, in Deep Learning for Image Processing Applications, vol. 31, Amsterdam, The Netherlands: IOS Press, 2017. |
| , “Hierarchical Navigation and Visual Search for Video Keyframe Retrieval”, in Advances in Multimedia Modeling, vol. 7131, Springer Berlin / Heidelberg, 2012, pp. 652-654. |
|
, “Rich Internet Application for Semi-automatic Annotation of Semantic Shots on Keyframes”, in Computational Intelligence for Multimedia Understanding, vol. 7242, Pisa, Italy: Springer-Verlag, 2012, pp. 172-182. (6.93 MB) |
Conference Papers top
| , “Deep variational autoencoders for population genetics: applications in classification, imputation, dimensionality reduction, and novel lossless data compression”, in American Society of Human Genetics (ASHG), Virtual, In Press. |
|
, “Seasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing Data”, in International Conference in Computer Vision (ICCV), Virtual, In Press. (1.79 MB) |
| , “H3D-Net: Few-Shot High-Fidelity 3D Head Reconstruction”, in International Conference on Computer Vision (ICCV), Virtual, In Press. |
|
, “SynthRef: Generation of Synthetic Referring Expressions for Object Segmentation”, in NAACL Visually Grounded Interaction and Language (ViGIL) Workshop, Virtual, 2021. (794.97 KB) |
|
, “PixelEDL: Unsupervised Skill Discovery and Learning from Pixels”, in CVPR 2021 Embodied AI Workshop, 2021. (1.55 MB) |
Theses top
| , “Sports broadcasting and multiple object tracking with deep learning methods”, 2021. |
| , “Image and Video Object Segmentation in Low Supervision Scenarios”, Universitat Politecnica de Catalunya, Barcelona, 2021. |
|
, “Deep Learning that Scales: Leveraging Compute and Data”, Universitat Politècnica de Catalunya, Barcelona, Catalonia, 2020. (8.55 MB) |
| , “Computer Vision beyond the visible: Image understanding through language”, Universitat Politecnica de Catalunya, Barcelona, 2019. |
|
, “Visual Object Analysis using Regions and Local Features”, 2016. (2.5 MB) |
Other top
|
, “Object Model Adaptation for Multiple Object Tracking”, 2021. (785.3 KB) |
Report |
|
, “Deep Learning Representations for All (a.ka. the AI hype)”. 2021. (10.95 MB) |
Presentation |
| , “Unsupervised learning with applications in genomic”, vol. BSc Data Science Engineering. 2021. | Ms Thesis |
|
, “Unsupervised skill learning from pixels”. 2021. (19.61 MB) |
Ms Thesis |
|
, “2D-to-3D Lifting of Sign Language Body Poses with Recurrent Neural Networks”, UPC ETSETB TelecomBCN, Barcelona, 2021. (340.44 KB) |
Report |
Projects top
 |
DeeLight: Efficient Deep Learning for Video Sequences and Point Clouds | National | Sep 2021 | Aug 2024 |
 |
High-Fidelity 3D Full Head Reconstruction from Few lmages | National | Aug 2021 | Jun 2024 |
 |
A European AI On Demand Platform and Ecosystem | European | Jan 2019 | Dec 2021 |
 |
MALEGRA - Multimodal Signal Processing and Machine Learning on Graphs | National | Jan 2017 | Jun 2021 |
 |
Deep Learning for Video Analytics in Sport Events | National | Feb 2018 | Jan 2021 |
Research Areas top
 |
Deep Genomics | Internal | Jan 2021 | Jul 2022 |
 |
Sign Language Recognition, Translation and Production | Internal | May 2017 | May 2022 |
 |
Language and Vision | Internal | Feb 2016 | Dec 2021 |
 |
Multimodal Deep Reinforcement Learning | Internal | Sep 2016 | Jul 2021 |
 |
Remote Sensing Image Processing | Internal | Jan 2010 | Jun 2021 |
Demos and Resources top
 |
EgoMon Gaze & Video Dataset | Dataset | Jul 2016 |
 |
UPC at CVPRW Visual Question Answering Challenge 2016 | Software | Jun 2016 |
 |
UPC at CVPRW ActivityNet Challenge 2016 | Software | Jun 2016 |
 |
Faster R-CNN Features for Instance Search (software) | Software | May 2016 |
 |
Sentiment maps generator | Software | Apr 2016 |