"Alerted.org

Summary:

We are seeking a Research Scientist with expertise at the intersection of human and machine perception excited about pushing the boundaries of our understanding of vision to improve design of sensor-to-display control pipelines for augmented reality products. Unlike standard 2D displays designed for relatively static viewers and environments, AR displays must adapt dynamically to user behavior and their environments to ensure seamless blending of virtual and real world objects. Achieving such dynamic adaptation requires advancing definitions and implementation of models of human perception beyond sensory encoding limitations that have found success for more traditional displays. With this challenge in mind, we seek researchers with expertise in dimensionality reduction methods, modern DeepNet architectures and representation learning to develop and test novel computational perceptual spaces that serve to establish core requirements for automatic display control for AR glasses. Reality Labs (RL) brings together world-class, cross-disciplinary science and engineering teams with the shared goal of developing the next generation of AI for AR technologies. In this role, you will be embedded in a multidisciplinary team of scientists and engineers exploring innovative approaches to using data from egocentric cameras and motion detectors (IMU) and knowledge about human visual processes to model image encoding by the eye and applying those models to predict the AR display image quality. Projects take advantage of internal resources in mechanical, electrical, optical, and software engineering, allowing us to confront scientific and product engineering challenges which cannot necessarily be answered with existing products or prototypes.

Required Skills:

Research Scientist, Applied Perception Science (PhD) Responsibilities:

1. Identify, develop, implement, and evaluate methods for learning robust representations to ground models human visual performance from egocentric video data

2. Learn, evaluate, and use color and spatially calibrated camera and image processing pipeline to estimate physical scene parameters (e.g. luminance, chromaticity, 3D geometry as a function of visual direction)

3. Utilize Meta’s large infrastructure to scale and speed up experimentation

4. Write modular research code that can be reused in other contexts.

5. Collaborate with experts in image quality computer and human vision

Minimum Qualifications:

Minimum Qualifications:

6. Currently has, or is in the process of obtaining a Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta.

7. Currently has or is in the process of pursuing a PhD in Machine Learning, Computer Vision, Vision Science, Applied Statistics, Computational Neuroscience, or a related field. Degree must be completed prior to joining Meta

8. Proficiency in python and machine learning libraries (numpy, scikit-learn, scipy, pandas, matplotlib, tensorflow, pytorch)

9. 2+ Years of experience in approaches to using self-supervised learning for computer vision including DeepMetric learning / neural network embedding methods

10. Experience in understanding of approaches to characterize the statistics of natural images and/or how to use properties of network layers to characterize high level scene/image properties

11. Experience with research involving defining problems, exploring solutions, and analyzing and presenting results

12. Experience in communicating effectively with a broad range of stakeholders, collaborators and clients, at different levels

13. Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment

Preferred Qualifications:

Preferred Qualifications:

14. Understanding of color image processing pipelines

15. Understanding of modern adaptive camera and image processing pipelines

16. Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, as well as first-authored publications at leading workshops or conferences

17. Experience working and communicating cross-functionally in a team environment

Public Compensation:

$117,000/year to $173,000/year + bonus + equity + benefits

**Industry:** Internet

Equal Opportunity:

Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at [email protected].