"Alerted.org

GitLab CI/CD API Testing Analyst

(Jobs in Madison, WI)

Requirement id 155895

Job title Analyst

Job location in Madison, WI

Skills required Software Testing Experience, GitLab, CI/CD, API Testing

Open Date 10-Nov-2025

Close Date

Job type Contract

Duration 7 Months

Compensation DOE

Status requirement ---

Job interview type ---

Email Recruiter:coolsoft

Job Description Analyst: Software Testing Experience, GitLab, CI/CD, API Testing

Start date : 12/01/2025

End Date : 06/30/2026

Submission deadline : 11/17/2025 4:00:00 PM

Client Info : Supreme Court

Note:

* Interview Process: via Teams

* Duration of Contract: 6/30/26, extension for high-performing candidates is expected

* Local or remote? Candidates must be CURRENT WI residents. No relocation allowed. This position will work 100% onsite, Mon-Fri 8am-5pm.

Description :

We are seeking a highly motivated and experienced Test Automation Engineer to design, develop, and

maintain automated end-to-end and accessibility test suites for our critical eCourts and Case

Management applications. This role is central to improving our software quality, accelerating our release

cycles, and ensuring compliance. The ideal candidate will have deep expertise in Playwright, extensive

experience with GitLab CI/CD, and a strong background in developing robust, scalable test automation

frameworks.

Key Responsibilities

Test Automation Framework Development and Execution

• Design and Build: Design, develop, and maintain scalable and reliable end-to-end (E2E)

automated test suites using Playwright for web applications, including those requiring eCourts-

authenticated (e.g., CC eFiling) and OVL-authenticated (e.g., Case Management) access.

• Develop & Maintain: Develop & maintain robust test frameworks using Playwright tailored for

end-to-end testing across multiple web browsers and environments.

• Collaborate with development and QA teams for automated test execution strategies.

• Accessibility Testing: Create and deploy an automated accessibility test suite for public sites

(e.g., WICourts.gov) utilizing a standard tool like Axe.

• Regression Management: Translate existing manual regression test suites (currently

in Digital.ai) into automated regression test suites within the new framework.

• Test Design & Execution: Create detailed test plans and automated scripts based on project

requirements. Execute functional, regression, performance, and UI tests leveraging Playwright.

• Quality Assurance Metrics: Monitor automation test results and generate insights. Implement

actionable improvements for consistent pipeline and testing enhancements.

• Troubleshooting & Debugging: Diagnose issues, debug test failures, and work closely with

product teams to resolve bugs efficiently.

• Maintenance: Continuously improve and update existing test cases and automation scripts to

align with new software features and changes, ensuring test stability and relevance.

• Collaboration: Partner with DevOps, Development, and QA teams to ensure testing is an

integral part of the software lifecycle. Advocate for test automation best practices.CI/CD Integration and Tooling

• GitLab Integration: Integrate test suite execution directly into the GitLab deploy pipeline,

ensuring automated regression testing runs against every development environment.

• Visibility & Reporting: Implement solutions (e.g., custom dashboards or integration with existing

overviews) to ensure clear, immediate visibility of automated test results, highlighting test failures

and environment status.

• Process Compliance: Collaborate with software development supervisors to establish a formal

process that includes the verification of automated test results as a mandatory step in the pre-

release process.

Mentorship and Documentation

• Tooling Setup: Assist analysts (Sam and Lexie) with setting up their local development

environments, including Visual Studio and Playwright, enabling them to generate and contribute

tests to the central repository.

• Documentation: Create and maintain comprehensive documentation detailing the processes for

creating new automated tests, executing them, and

Call502-379-4456 Ext 100for more details. Please provide Requirement id: 155895 while calling.

EOE Protected Veterans/Disability