• Senior Data Engineer

    Insight Global (Moncks Corner, SC)


    Job Description

    Insight Global is hiring a Senior Data Engineer to join one of our top utility customers in South Carolina. This organization is focused on providing reliable electrical utility services across the state and is driving towards modernizing their existing Data Infrastructure. In this role, you will build, upgrade, and manage the Databricks, cloud based data engineering platforms, and work alongside the Data Scientists to drive AI and ML projects for the organization. This role will require advanced level skills in Python programming and SQL, Databricks, and building ETL jobs and pipelines.

    Responsibilities:

    - Serve as a Senior level engineer driving strategy, modernization, and upgrades to the organizations existing data infrastructure.

     

    - Modernize and engineer solutions to allow for more advanced Data utilization for AI and ML model implementation.

     

    - Optimize the company’s utilization of Databricks and other cloud based data engineering platforms

     

    - Leverage Python programming and SQL scripting to upgrade the current data infrastructure

     

    - Manage and develop advanced ETL jobs and data pipelines for the organization

     

    The compensation range for this position is between $120,000 and $180,000 per year depending on experience and education.

     

    We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to [email protected] learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.

     

    Skills and Requirements

     

    - 5 or more years of experience in Data Engineering based roles

     

    - Bachelor’s Degree in any technology based degree

     

    - Strong skills in Python programming and SQL for Data Engineering tasks

     

    - High level experience with Databricks as a platform and optimizing organization’s use of Databricks

     

    - Experience with ETL jobs and data pipeline builds - Experience with Informatica implementations and migrations

     

    - Knowledge of Snowflake as a technology

     

    - Any skills with DataIQ, PowerBI, and/or Pentaho

     

    - Master’s Degree in any field