Facebook Jobs

Mobile facebook Logo

Job Information

Facebook Research Intern, Photorealistic Telepresence (PhD University Student) in Pittsburgh, Pennsylvania


Facebook's mission is to give people the power to build community and bring the world closer together. Through our family of apps and services, we're building a different kind of company that connects billions of people around the world, gives them ways to share what matters most to them, and helps bring people closer together. Whether we're creating new products or helping a small business expand its reach, people at Facebook are builders at heart. Our global teams are constantly iterating, solving problems, and working together to empower people around the world to build community and connect in meaningful ways. Together, we can help people build stronger communities - we're just getting started.


Facebook Reality Labs in Pittsburgh is looking for exceptional interns to help us create a revolution in virtual reality: achieving true photorealistic telepresence, where you can be with anyone, anywhere, at anytime. We have made some important advances, but it will take a diverse team with a wide spectrum of skills to accomplish this future. If you have expertise in computer vision, machine learning, and computer graphics, we expect you will find the work here highly intriguing. We are looking for motivated software, electrical, and mechanical engineers; and strong math skills are always a huge plus. We publish our work at leading conferences and journals. Come join us as we make photorealistic telepresence in VR happen!

Available projects may include, but are not limited to:

  • Multiview Data Compression for Machine Perception

  • Multi-modal Face Tracking

  • CNN Acceleration for realtime tracking

  • Full Body Tracking from the Headset

  • Speech Aware Gesturing for Dialogue Avatars in VR

  • Realtime Markerless Motion Capture for Faces and Bodies

  • High Fidelity Face Model Fitting to Photo Collections

  • Building a Multi-scale Body Rig

  • Building a Multicamera Head Mounted System

  • Realtime Gaze Tracking using EOG

  • High-Fidelity Tongue Rigging

  • High-Precision 3D Hair Reconstruction

  • 3D Audio Reconstruction from Multiple Microphones

  • Geometric Camera Calibration

  • Photometric Camera Calibration

  • High Fidelity Hand Model Reconstruction and Tracking

  • Speech Synthesis

  • High Fidelity Geometrical and Photometric 3D Reconstruction of Eyes

  • 3D Eyelash Reconstruction

  • High-Frequency Reflectance Capture of Faces and Bodies

Required Skills:

  1. Solve real problems in enabling Photorealistic Telepresence

  2. Collaboration with and support of other researchers across various disciplines

  3. Communication of research agenda, progress, and results

Minimum Qualifications:

  1. In the process of obtaining a Masters or PhD degree in the field of Audio Processing, Computer Vision, Computer Graphics, Robotics, Machine Learning, or similar

  2. Must be currently enrolled in a full-time degree program and returning to the program after the completion of the internship/co-op

  3. 1+ years experience with solving inverse problems in imaging emphasizing modeling, algorithm development, and hardware prototyping

  4. 2+ years experience with scientific programming languages such as Matlab, Python, or similar

  5. Must be available for a 3, 4, or 6-month internship between January 1, 2019 and December 31, 2019

  6. Interpersonal experience: cross-group and cross-culture collaboration

  7. Must obtain work authorization in country of employment at the time of hire, and maintain ongoing work authorization during employment

Preferred Qualifications:

  1. In the process of obtaining a PhD degree in the field of Audio Processing, Computer Vision, Computer Graphics, Robotics, Machine Learning, or similar

  2. Experience with systems building in C++

  3. Experience with OpenCV, TensorFlow, Ceres, or Caffe2

  4. Experience with Machine Learning for Sequence Prediction, NLP, or Speech Synthesis

  5. Experience with Machine Learning for 3D Data (such as meshes, point clouds, and voxels)

  6. Experience with Machine Learning for Visual Synthesis

  7. Proven track record of achieving significant results as demonstrated by patents and first-authored publications at leading workshops or conferences such as ICCV, CVPR, NIPS, SIGGRAPH, ICASSP, or similar

  8. Demonstrated engineering experience via an internship, work experience, coding competitions, or widely used contributions in open source repositories (e.g., GitHub)

Industry: Internet

Equal Opportunity: Facebook is proud to be an Equal Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Facebook is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@fb.com.