"Alerted.org

Job Title: QA Engineer, GenAI

Type: Contract – 6 + months – strong likelihood of extension

Contractor Work Model : Can work Remote EST, must be available for onsite 1x quarterly

Job Description:

We are seeking a highly skilled QA Engineer with expertise in GenAI, Automation with Python, and SQL for a large, enterprise healthcare client. This role involves hands-on technical tasks with a focus on developing and testing advanced solutions in an AI-driven environment.

Required Skills & Experience:

+ Experience : 8+ years in QA engineering

+ GenAI : 1-3 years of hands-on experience working with LLMs and other GenAI tools. Gen AI Testing experience including but not limited to LLMs, Amazon Frameworks (eg. Sagemaker, Lamda, S3, Kendra), and Contextual Comparison Methodologies

+ Automation : Proficiency in Python for automation and scripting.

+ SQL : Strong ability to write and execute queries on the fly.

+ Leadership : Ability to mentor junior team members

Preferred Qualifications

+ Functional knowledge of Agile, Spiral and Waterfall methodologies

+ Proven experience with the execution and administration of Quality/Process Improvement best practices.

+ Experience working with Program/Project Quality Assurance/Process Improvement Plans.

+ Experience working with Quality Gates or Quality Checkpoints as part of the SDLC.

Gen AI Testing experience including but not limited to LLMs, Amazon Frameworks (eg. Sagemaker, Lamda, S3, Kendra), and Contextual Comparison Methodologies

+ Automation

+ Python

+ Ability to gather information and resolve issues independently.

+ Ability to identify, manage and track progress of small to medium complexity projects to support organizational long range business objectives.

+ Experience with quality assurance and process improvement, and methodologies and practices in an IT project development, custom software solutions and maintenance environment.

Key Responsibilities:

+ Work with GenAI tools, specifically Compass, and leverage Amazon technologies including Kendra and SageMaker.

+ Write and optimize SQL queries quickly to solve data-related challenges.

+ Lead automation efforts using Python in a dynamic testing environment.

+ Utilize contextual comparison tools for automation, ensuring accuracy through matching methodologies and metric thresholds.

+ Provide leadership and mentoring to the QA team, guiding them in GenAI and automation best practices.

+ Collaborate with cross-functional teams to ensure product quality and integrity in AI-powered solutions.

Education:

+ Education Level: Bachelor's Degree

+ Education Details: Computer Science or related technical field

In Lieu of Education

In lieu of a Bachelor's degree, an additional 4 years of relevant work experience is required in addition to the required work experience.

The incumbent is required to immediately disclose any debarment, exclusion, or other event that makes them ineligible to perform work directly or indirectly on Federal health care programs. Must be able to effectively work in a fast-paced environment with frequently changing priorities, deadlines, and workloads that can be variable for long periods of time. Must be able to meet established deadlines and handle multiple customer service demands from internal and external customers, within set expectations for service excellence. Must be able to effectively communicate and provide positive customer service to every internal and external customer, including customers who may be demanding or otherwise challenging.

System One, and its subsidiaries including Joulé, ALTA IT Services, and Mountain Ltd., are leaders in delivering outsourced services and workforce solutions across North America. We help clients get work done more efficiently and economically, without compromising quality. System One not only serves as a valued partner for our clients, but we offer eligible employees health and welfare benefits coverage options including medical, dental, vision, spending accounts, life insurance, voluntary plans, as well as participation in a 401(k) plan.

System One is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, age, national origin, disability, family care or medical leave status, genetic information, veteran status, marital status, or any other characteristic protected by applicable federal, state, or local law.

#LI-CB5

Ref: #850-Rockville (ALTA IT)

System One, and its subsidiaries including Joulé, ALTA IT Services, CM Access, TPGS, and MOUNTAIN, LTD., are leaders in delivering workforce solutions and integrated services across North America. We help clients get work done more efficiently and economically, without compromising quality. System One not only serves as a valued partner for our clients, but we offer eligible full-time employees health and welfare benefits coverage options including medical, dental, vision, spending accounts, life insurance, voluntary plans, as well as participation in a 401(k) plan.

System One is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, age, national origin, disability, family care or medical leave status, genetic information, veteran status, marital status, or any other characteristic protected by applicable federal, state, or local law.