Face Technology in AR/VR

Year: 2017 - 2019

The Oculus Rift VR Headset

At Facebook AR/VR and Oculus I’ve worked on the research and development of technologies to represent, reconstruct, animate, and track the human face on platforms ranging from PC, mobile device, to the Oculus headset. This work required writing performance optimized C++ code, implementing traditional computer vision algorithms, and developing novel deep learning algorithms. I’ve contributed individually and as a project lead.

Related to our work, Facebook Reality Labs (FRL) is pioneering the effort to construct photorealistic avatars. Learn more about this technology in this FRL blog post.

Technologies

  • Python
  • C++
  • Eigen
  • Pytorch
  • Caffe2