"Alerted.org

Job Description

Responsibilities:

• Develop and operationalize data pipelines to support Data Science and analytical models.

• Install, patch, upgrade, and administer software systems for data pipelines (ETL, data quality, distributed processing, streaming platforms).

• Ensure compliance with security, documentation, governance, and standards.

• Perform DevOps tasks and orchestrate data marts and analytical processes.

• Monitor, secure, and track data usage and analytic product performance.

• Collaborate with internal teams to deliver accurate, accessible API services.

• Mentor junior Data Engineers on best practices and technology usage.

• Research and evaluate emerging technologies for organizational fit.

Day to Day:

One of Insight Global clients is looking for a Data Engineer to come join their team. This individual will be responsible for attending daily stand-up meetings to discuss projects, roadblocks, and priorities. They will check in on the status of overnight data pipeline runs and address any issues to ensure data integrity. The engineer will integrate new data sources into the data warehouse, collaborating with analysts and stakeholders to meet data requirements. They will also be responsible for performing data cleaning and transformation using tools like SQL and Python. Other responsibilities will include meeting with data scientists to support upcoming projects. They will also design and implement data models, optimize database performance, and build scalable data pipelines using cloud platforms. While document data processes and infrastructure changes. Additionally, they will respond to ad-hoc data requests, provide insights for decision-making, and tune data system performance.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to [email protected] learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.

Skills and Requirements

• 6+ years of experience designing, developing, and implementing data solutions.

• Advanced SQL skills with experience in Oracle, Microsoft SQL Server, and Postgres.

• Advanced programming experience in Python, and Polars

• Strong experience with Linux systems.

• Experience building data pipelines with Airflow.

• Familiarity with Kubernetes.

• Bachelor’s degree in IT, Computer Science, Statistics, or related field (or equivalent experience). Pluses:

• Experience working with Confluence and Kafka.

• Exprince working with ML Algorithms

• Experience working for a financial company

• Experience with ETL tools such as Airflow, SSIS, Informatica, dbt.

• Familiarity with Anaconda, Kafka, RabbitMQ, Jupyter Notebook, Tableau.

• Master’s degree in related field