Photometric based markerless facial tracking using analysis-by-synthesis approach for 3DMMs face parameters optimization. All the computational parts of our pipeline were ran on GPU using CUDA and OpenGL. Our energy function consists of a sparse landmark term, a dense photometric term and a regularizer term. This energy function is minimized using iteratively reweighted least squares method (IRLS). Each Gauss-Newton update is solved using preconditioned conjugate gradients method (PCG).

The code can be found in the repository.

The report is availalbe below.