"Alerted.org

Summary:

The Meta Reality Labs Research Team is pioneering the future of AR and VR by bringing together world-class researchers, developers, and engineers. Our mission is to advance computer graphics and display technologies, with a focus on perceptually optimized rendering, display hardware modeling, and generative AI for immersive experiences. We are currently seeking a Research Scientist Intern to contribute to our cutting-edge project on trainable perceptual metrics and end-to-end differentiable display waveguide models for AR/VR systems.This internship offers a unique opportunity to work at the intersection of computer vision, computational neuroscience, and hardware modeling. You will help develop perceptually driven, trainable image quality metrics grounded in human vision, and apply them to optimize AR/VR rendering and display pipelines. The work will involve building differentiable models of display hardware, integrating perceptual losses into machine learning workflows, and demonstrating practical improvements in image quality and power efficiency for next-generation AR/VR devices.Our internships are twelve (12) to twenty-four (24) weeks long, with various start dates throughout the year.

Required Skills:

Research Scientist Intern, Machine Learning and Perception Science (AR) (PhD) Responsibilities:

1. Collaborate with researchers and engineers in graphics, vision science, and hardware modeling to develop differentiable display waveguide models.

2. Design and implement trainable loss functions based on human visual system principles.

3. Build and optimize differentiable simulators for display waveguides and hardware, enabling joint optimization of rendering and display parameters.

4. Review state-of-the-art research in perceptual modeling, display hardware simulation, and computation imaging/optics.

5. Evaluate and demonstrate improvements in perceptual image quality and power efficiency using developed models and metrics.

6. Prepare research results for publication in top-tier conferences (e.g., SIGGRAPH, CVPR, IEEE VR).

Minimum Qualifications:

Minimum Qualifications:

7. Currently has, or is in the process of obtaining, a PhD degree in Computer Science, Electrical Engineering, Vision Science, Computational Neuroscience, or a related field

8. Experience with Python (or similar) scripting and ML frameworks such as PyTorch or TensorFlow

9. Experience in software design and programming in C/C++

10. Understanding of computer graphics, image processing, display hardware

11. Must obtain work authorization in the country of employment at the time of hire and maintain ongoing work authorization during employment

Preferred Qualifications:

Preferred Qualifications:

12. Intent to return to a degree-program after the completion of the internship

13. Experience with perceptual modeling, computational neuroscience, or display hardware simulation

14. Track record of first-authored publications at leading conferences in computer vision, graphics, or machine learning (e.g., SIGGRAPH, CVPR, NeurIPS)

15. Familiarity with differentiable simulation, hardware modeling, or ML-based optimization for physical systems

16. Experience with generative models (e.g., diffusion models, auto-regressive models) and perceptual loss functions

17. Understanding of waveguide optics and familiarity with simulation frameworks like Lumerical, Virtual Lab, FRED, LightTools or Zemax

18. Familiarity in using machine learning and deep neural networks for simulating or optimizing optical devices in distributed systems and parallel computing environments

19. Familiarity with code profiling, debugging, and optimization tools in the context of ML and hardware simulation

20. Ability to read, trace, and refactor code in complex research projects

21. Experience working and communicating cross functionally in a team environment

Public Compensation:

$7,650/month to $12,134/month + benefits

**Industry:** Internet

Equal Opportunity:

Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at [email protected].