"Alerted.org

Cognizant is one of the world’s leading professional services companies, we help our clients modernize technology, reinvent processes, and transform experiences, so they can stay ahead in our constantly evolving world. We are looking to expand our team working in office in Seattle, Washington! Do you thrive in a busy environment and able to multi-task successfully? If so, please apply today!

Job Description:

• Working with large language model validation, ensuring the LLM performs at an

acceptable level of accuracy and reliability across different models

• Fix implementation: Identify and address issues in synthetic data and manual tests

by comparing various models, fixing schemas

• Create, curate diverse set of test cases and scenarios to challenge and refine LLM’s

• Monitor Pipelines, triage failures, triage, and escalate critical pipeline failures

• End to end, functional, regression testing on client software & hardware

ie: Phones, tablets, watches, home speakers, Bluetooth accessories software &

hardware

• Manual testing with AI, Personal Assistants such as Alexa, Siri, Google

• Perform test planning, test case development, and manual test execution

• Analyzing test failures and filing detailed defect reports

Requirements for the role:

• 3+ years of professional work experience in Blackbox Quality Assurance, with experience in software testing, AI technologies or LLM evaluation

• Knowledge of data analysis & strong understanding of software testing methodologies

• Strong understanding of software testing methodologies

• Proficiency in test planning, test design, test authoring, and execution

• Experience in test planning, test design, test authoring, and execution

•Analyzing test results, identify defects, patterns of issues, troubleshoot, file detailed defect reports

• Meticulous with attention to detail

• Possess excellent written and verbal communications skills in English

Ideal Requirements:

• Experience with Artificial Intelligence, Machine Learning, ie: Chat GBT

• Previous experience with annotation and data analytics is a plus

• Experience with test automation frameworks and tools

• Able to work in a fast paced dynamic environment

• Able to work in a fast paced dynamic environment

• Curious and proactive. Loves to learn and explore

Nice to have:

• Bachelor’s degree in computer science or related field

Hourly Rate and Other Compensation:

The hourly rate for this position is between $27.00 - $32.00 per hour, depending on experience and other qualifications of the successful candidate.

This position is also eligible for Cognizant’s discretionary annual incentive program, based on performance and subject to the terms of Cognizant’s applicable plans.

**Benefits** : Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:

+ Medical/Dental/Vision/Life Insurance

+ Paid holidays plus Paid Time Off

+ 401(k) plan and contributions

+ Long-term/Short-term Disability

+ Paid Parental Leave

+ Employee Stock Purchase Plan

**Disclaimer:** The hourly rate, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.

Cognizant is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.