MICA - Towards Metrical Reconstruction of Human Faces [ECCV2022]

Face reconstruction and tracking is a building block of numerous applications in AR/VR, human-machine interaction, as well as medical applications. Most of these applications rely on a metrically correct prediction of the shape, especially, when the reconstructed subject is put into a metrical context (i.e., when there is a reference...

6 minute read

Audio-driven Neural Rendering of Portrait Videos

This work proposes a novel way of synthesizing audio-driven portrait videos. We show that photo-realistic images can be rendered based on a small, fully connected neural network with the positional encoding of 3D face surface and additional audio-features extracted from an arbitrary English speech. The method is based on the...

2 minute read

Parallel Mesh Simplification For Planar Surfaces

This work elaborates a parallel algorithm based on quadric error metric and adaptive thresholding to simplify a triangle mesh. The approach emphasizes planar surfaces as a target to simplify. The main goal was to create a framework able to produce high-quality progressive meshes based on reconstructed ones from the environment....

1 minute read

Vulkan Path Tracer Sandbox

This project is an engine where you can create/test new shaders in real-time physically based ray tracing system. The main idea is that users can test their own integrators in predefined environment with assets like: meshes, materials, lights and textures. The Vulkan pipeline is abstracted in a shaders form and...

1 minute read

Software Rasterizer

CPU implementation of a very efficient rasterizer which utilizes AVX2 instructions and lock-free multi-threading programming. Using tiled rendering the program consumes 8 pixels at the same time, which together with std::execution threading library makes it very fast and robust. The viewer of the project is a very simple OpenGL applicatoin...

1 minute read

RGB Face Reconstruction

Photometric based markerless facial tracking using analysis-by-synthesis approach for 3DMMs face parameters optimization. All the computational parts of our pipeline were ran on GPU using CUDA and OpenGL. Our energy function consists of a sparse landmark term, a dense photometric term and a regularizer term. This energy function is minimized...

1 minute read