Research

Before founding Volograms, I was a Postdoctoral Research Fellow at V-SENSE, Trinity College Dublin, where I was advised by Prof. Aljosa Smolic. I did my PhD at GTI, Universidad Politécnica de Madrid, under the supervision of Prof. Francisco Morán.

My research interests are computer vision, 3D reconstruction, volumetric video and image processing. I’m especially interested in the reconstruction of the shape an appearance of human models. Representative papers are highlighted.

Publications

Using facial detection and tracking to simulate “mirror therapy” to help patients with facial paralysis.

A robust, autonomous method for tracking volumetric sequences which can detect missing geometry and propagate user edits.

A self-regulating filter that is capable of performing accurate upsampling of dynamic point cloud data sequences captured using wide-baseline multi-view camera setups.

A method for augmenting hand-drawn characters and creatures with global illumination effects.

A semi-automatic method for creating shades and self-shadows in cel animation.

An approach to upsampling point cloud sequences captured through a wide baseline camera setup in a spatio-temporally consistent manner.

A scalable pipeline for Free-Viewpoint Video (FVV) content creation, considering also visualisation in Augmented Reality and Virtual Reality.

The interactive prototype visualises Jonathan Swift in AR, allowing the user to be immersed in world of cultural heritage.

Virtual Play is a reinterpretation of Play, with a view to engaging a 21st Century viewership that is increasingly accessing content via VR.

A new fully automatic pipeline for generating shading effects on hand-drawn characters.

A semi-automatic method for creating shades and self-shadows in cel animation.

Virtual Play is a reinterpretation of Play, with a view to engaging a 21st Century viewership that is increasingly accessing content via VR.

A simulation framework for a 3D high-resolution imaging radar at 300 GHz with mechanical scanning.

We propose a technique based on epipolar geometry restrictions to significantly cut down on processing time and an efficient implementation thereof on a GPU.

We present a static multi‐texturing system yielding a seamless texture atlas calculated by combining the colour information from several photos from the same subject covering most of its surface.

We propose a hybrid 3D modeling and rendering approach called SPLASH to combine the modeling flexibility and robustness of SPLAts together with the rendering simplicity and maturity of meSHes.

We propose a novel technique for modeling and rendering a 3D point cloud obtained from a set of photographs of a real 3D scene as a set of textured elliptical splats.

We present a fully automatic low-cost system for generating animatable and statically multi-textured avatars of real people captured with several standard cameras.

A technique to merge a VH-based 3D mesh of a reconstructed humanoid and the depth data of its face, captured by a single structured light projector.

We propose a new method to automatically refine a facial disparity map obtained with standard cameras and under conventional illumination conditions by using a smart combination of traditional computer vision and 3D graphics techniques.

We present an innovative system to encode and transmit textured multi-resolution 3D meshes in a progressive way, with no need to send several texture images, one for each mesh LOD.

We introduce an innovative, semi-automatic method to transform low resolution facial meshes into high definition ones, based on the tailoring of a generic, neutral human head model.

We introduce a simple and innovative method to compare any two texture maps, regardless of their sizes, aspect ratios, or even masks, as long as they are both meant to be mapped onto the same 3D mesh.

We introduce an automatic technique for mapping onto a 3D triangle mesh a high resolution texture synthesized from several pictures taken by standard cameras surrounding the object.

Patents

A method comprising providing a plurality of images of a scene captured by a plurality of image capturing devices.

A method for generating a realistic 3D reconstruction model for an object or being.

This page was "stolen" from Jon Barron's website. You can find the source code here.