Photometric based markerless facial tracking using analysis-by-synthesis approach for 3DMMs face parameters optimization. All the computational parts of our pipeline were ran on GPU using CUDA and OpenGL. Our energy function consists of a sparse landmark term, a dense photometric term and a regularizer term. This energy function is minimized using iteratively reweighted least squares method (IRLS). Each Gauss-Newton update is solved using preconditioned conjugate gradients method (PCG).

RGB Face Tracking and Reconstruction

RGB Face Tracking and Reconstruction

Mustafa Işık, Patrick Radner, Wojciech Zielonka
Technical University of Munich

Photometric based markerless facial tracking using analysis-by-synthesis approach for 3DMMs face parameters optimization. All the computational parts of our pipeline were ran on GPU using CUDA and OpenGL. Our energy function consists of a sparse landmark term, a dense photometric term and a regularizer term. This energy function is minimized using iteratively reweighted least squares method (IRLS). Each Gauss-Newton update is solved using preconditioned conjugate gradients method (PCG).

RGB Face Tracking and Reconstruction