"Alerted.org

Make your mark at Comcast -- a Fortune 30 global media and technology company. From the connectivity and platforms we provide, to the content and experiences we create, we reach hundreds of millions of customers, viewers, and guests worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and solutions that our customers love. We create space to innovate, and we recognize, reward, and invest in your ideas, while ensuring you can proudly bring your authentic self to the workplace. Join us. You’ll do the best work of your career right here at Comcast. (In most cases, Comcast prefers to have employees on-site collaborating unless the team has been designated as virtual due to the nature of their work. If a position is listed with both office locations and virtual offerings, Comcast may be willing to consider candidates who live greater than 100 miles from the office for the remote option.)

Job Summary

Comcast’s Observability Program provides critical platform services across the company, ensuring teams can monitor, analyze, and optimize application performance. As an Engineer 3, you will play a key role in designing, developing, and maintaining observability platforms, including MetriX, OCP, ADE, Tracing, Grafana, and Elasticsearch.

This position requires a high level of technical expertise, problem-solving skills, and experience working in large-scale, high-traffic distributed systems. You will collaborate with teams across Comcast to enhance logging, metrics, tracing, visualization, and alerting capabilities while leading efforts to improve automation, scalability, and reliability.

Job Description

This team has members in Reston, VA; West Chester, PA; and our downtown Philadelphia offices, and we will equally consider candidates in these locations. It is not open for remote/virtual hire.

_We are unable to provide sponsorship for this role now or in the future._

Core Responsibilities:

+ **Software Development & Platform Engineering**

+ Design, develop, and maintain **observability platforms** using **Python** and **Golang** .

+ Build and enhance **React-based frontends** for observability dashboards and self-service tools.

+ Implement **RESTful APIs** and microservices.

+ Develop and manage infrastructure using **Kubernetes** and **Docker**

+ Automate observability tooling and deployment processes using **Helm, Terraform, and Ansible** .

+ **Observability & System Monitoring**

+ Architect **scalable and resilient** observability solutions for logging, metrics, and tracing.

+ Optimize and scale **Elasticsearch, Prometheus/VictoriaMetrics, and Grafana** for high-volume data ingest and queries.

+ Integrate **OpenTelemetry** for distributed tracing and RED metric generation.

+ Improve **real-time anomaly detection** pipelines with **ADE (Anomaly Detection Exporter)** .

+ **Operational Excellence & Support**

+ Provide **technical leadership** in incident response, troubleshooting, and resolution.

+ Collaborate with internal teams to improve observability **best practices** and operational insights.

+ Participate in an **on-call rotation** for platform support, including **after-hours and weekends** .

+ Enhance **CI/CD automation** to streamline deployments and reduce manual intervention.

+ **Mentorship & Leadership**

+ Lead technical discussions and provide **guidance to junior engineers** .

+ Advocate for **best practices** in observability, software development, and automation.

+ Contribute to **technical documentation** and internal knowledge-sharing initiatives.

Required skills & experience:

+ **Python** (4+ years) and **JavaScript (React)** (3+ years)

+ Experience with **Kubernetes, Docker, and container orchestration** (3+ years)

+ Expertise in **REST API development** (3+ years)

+ Experience working with **Linux environments and shell scripting (Bash, Python, or similar)**

+ Strong understanding of **CI/CD pipelines** and **GitOps workflows**

+ Familiarity with **Helm, Terraform, Ansible, and Packer**

+ Experience troubleshooting **large-scale distributed systems**

+ Excellent **communication, collaboration, and problem-solving skills**

Preferred/Nice-to-have:

+ Experience with **Golang**

+ Knowledge of **Microsoft Graph API**

+ Background in **enterprise-scale observability systems**

+ Experience with **multi-cloud observability architectures (AWS, Azure, GCP)**

Employees at all levels are expected to:

+ Understand our Operating Principles; make them the guidelines for how you do your job.

+ Own the customer experience - think and act in ways that put our customers first, give them seamless digital options at every touchpoint, and make them promoters of our products and services.

+ Know your stuff - be enthusiastic learners, users and advocates of our game-changing technology, products and services, especially our digital tools and experiences.

+ Win as a team - make big things happen by working together and being open to new ideas.

+ Be an active part of the Net Promoter System - a way of working that brings more employee and customer feedback into the company - by joining huddles, making call backs and helping us elevate opportunities to do better for our customers.

+ Drive results and growth.

+ Respect and promote inclusion & diversity.

+ Do what's right for each other, our customers, investors and our communities.

Disclaimer:

This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.

Comcast is proud to be an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law.

Skills:

Git; Kubernetes; RESTful APIs; Linux; Python (Programming Language); Agile Methodology

Base pay is one part of the Total Rewards that Comcast provides to compensate and recognize employees for their work. Most sales positions are eligible for a Commission under the terms of an applicable plan, while most non-sales positions are eligible for a Bonus. Additionally, Comcast provides best-in-class Benefits to eligible employees. We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That’s why we provide an array of options, expert guidance and always-on tools, that are personalized to meet the needs of your reality – to help support you physically, financially and emotionally through the big milestones and in your everyday life. Please visit the compensation and benefits summary (https://jobs.comcast.com/benefits) on our careers site for more details.

Education

Bachelor's Degree

While possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience.

Relevant Work Experience

5-7 Years

**Job Family Group:** Engineering