"Alerted.org

Do you have expertise in evaluating and implementing Generative AI models?

Are you passionate about applying data science to advance healthcare and education?

About our Team

Elsevier is singularly focused on helping healthcare and health education professionals improve clinical outcomes through evidence-based methods. Our data science team works on designing, building, and maintaining NLP solutions for Generative AI Evaluation of Health and Health Education applications.

About the Role

We are seeking an experienced Senior Data Scientist III to join our Applied AI Evaluation team. You will lead the design, implementation, and maintenance of NLP solutions for Generative AI evaluation, focusing on CK AI and Sherpath AI products. This role requires expertise in data science, mentoring capabilities, and the ability to deliver production-ready solutions.

Responsibilities

• Designing and conducting experiments to assess generative AI model performance

• Developing metrics, benchmarks, and evaluation frameworks

• Creating production-ready Python packages for evaluation pipeline components

• Evaluating AI models against healthcare domain standards

• Integrating data science components and conduct quality assessments

• Developing automated evaluation and maintenance tools

• Mentoring junior team members and providing technical leadership

• Collaborating with technology teams for pipeline deployment

• Implement and maintain product performance reporting

• Contributing to new methodologies and governance frameworks

Requirements

• Advanced degree in computer science, data science, AI, mathematics, or statistics

• 2+ years post-PhD or 5+ years post-Master's or 10+ years post-Bachelor's relevant experience

• Expertise in Generative AI model evaluation and metric development

• Proficiency in Python, SQL, R, and Java

• Experience with ML algorithms, deep learning, and neural networks

• Strong background in GitLab/GitHub and cloud computing

• Proven experience with *nix systems and Jupyter notebook hubs

• Ability to build and test new processes while mentoring others

• Healthcare domain knowledge highly desirable

• Track record of developing novel code solutions and best practices

Working for you

We know that your wellbeing and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:- Health Benefits: Comprehensive, multi-carrier program for medical, dental and vision benefits- Retirement Benefits: 401(k) with match and an Employee Share Purchase Plan- Wellbeing: Wellness platform with incentives, Headspace app subscription, Employee Assistance and Time-off Programs- Short-and-Long Term Disability, Life and Accidental Death Insurance, Critical Illness, and Hospital Indemnity- Family Benefits, including bonding and family care leaves, adoption and surrogacy benefits- Health Savings, Health Care, Dependent Care and Commuter Spending Accounts- Up to two days of paid leave each to participate in Employee Resource Groups and to volunteer with your charity of choice

-----------------------------------------------------------------------

Elsevier is an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law. We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form: https://forms.office.com/r/eVgFxjLmAK , or please contact 1-855-833-5120.

Please read our Candidate Privacy Policy (https://www.relx.com/careers/join-us/privacy) .

RELX is a global provider of information-based analytics and decision tools for professional and business customers, enabling them to make better decisions, get better results and be more productive.

Our purpose is to benefit society by developing products that help researchers advance scientific knowledge; doctors and nurses improve the lives of patients; lawyers promote the rule of law and achieve justice and fair results for their clients; businesses and governments prevent fraud; consumers access financial services and get fair prices on insurance; and customers learn about markets and complete transactions.

Our purpose guides our actions beyond the products that we develop. It defines us as a company. Every day across RELX our employees are inspired to undertake initiatives that make unique contributions to society and the communities in which we operate.