Deep Learning for 3D reconstruction and Simulation of Aesthetic Procedures

Type Start End
National Jul 2017 Jun 2020
Responsible URL
Xavier Giró-i-Nieto Industrial Doctorates

Reference

2017-DI-028

Description

he aim of this project is to increase the accuracy and realism of 3D reconstruction and 3D aesthetic procedure simulations using novel deep learning techniques.

Deep learning has flooded several technical fields which years ago were approached by totally different algorithms. The availability of huge amounts of data, the improvements in parallel processing hardware and the open sourcing of frameworks to train deep neural models have been key factors to train these models successfully in reasonable amounts of time, reaching state-of-the-art results in many subfields of natural language processing and image processing. These techniques are not limited to 1D or 2D; they are also suitable for 3D. As shown in recent publications, different deep neural network architectures combined with multi-view geometry theory can be employed to solve problems like 3D reconstruction, 3D recognition and 3D shape alignment. Moreover, a subbranch called generative models is obtaining very promising results using the novel Generative Adversarial Networks (GANs and its variants), especially in image synthesis.

In this project, we will explore these novel deep learning techniques and how to combine them with multi-view geometry fundamentals to create new pipelines that increase the accuracy and the realism of existing methods for 3D reconstruction of body parts and its simulation in both geometric and texture spaces.

Collaborators

Xavier Giró Associate Professor xavier.giro@upc.edu