• Senior Data Engineer

    Insight Global (Norcross, GA)


    Job Description

    We are looking for an experienced and highly skilled Senior Data Engineer to join our Data Engineering Team. In this role, you will design, develop, and optimize data solutions leveraging Microsoft Azure data services. You will collaborate closely with a team of data professionals, business stakeholders, and data analysts to deliver robust, efficient, and secure data solutions.

     

    We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to [email protected] . The EEOC "Know Your Rights" Poster is available here (https://www.eeoc.gov/sites/default/files/2023-06/22-088\_EEOC\_KnowYourRights6.12ScreenRdr.pdf) .

     

    To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .

     

    Skills and Requirements

     

    Expert-level experience with Azure Data Services including Azure Data Factory, Azure Databricks, Azure SQL Database, and Azure Data Lake Storage.

     

    Proficiency in SQL, Python, Shell scripting, and PowerShell (preferred- very interesting Unix scripting

     

    Extensive experience with data integration, ETL processes, data warehousing, and data modeling concepts.

     

    Strong knowledge of data governance, data security, and best practices.

     

    Proven capability in developing and maintaining high-performance data ingestion pipelines.

     

    Familiarity with various integration connectors (APIs, File systems, SFTP/FTPS, Streaming Data, DB Connectors, SOAP, REST).

     

    Demonstrated experience in securing communications between data endpoints.

     

    Experience with orchestration tools, especially Apache Airflow.

     

    Experience with Agile methodologies and software development lifecycle (SDLC). Experience using BI tools and reporting solutions.

     

    Advanced knowledge of performance tuning and optimization of data services. null

     

    We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [email protected].