• Data Engineer

    Insight Global (Seattle, WA)


    Job Description

    We are seeking an experienced Data Engineer with deep expertise in enterprise-scale metadata management platforms, data governance frameworks, and AI-ready infrastructure design. This role will architect and optimize a Redshift-centric data ecosystem leveraging AWS native services to enable robust metadata management, data lineage, and governance capabilities that support both operational analytics and future AI/ML workloads.

    Key Responsibilities

    • Design and implement scalable metadata management infrastructure using AWS Glue Data Catalog, Redshift Spectrum, and Lake Formation.

    • Develop and maintain data lineage systems, ensuring transparency and traceability across complex data flows.

    • Manage schema evolution and orchestrate cross-system data mapping for diverse data sources.

    • Establish and enforce data governance policies, including compliance, security, and discoverability standards.

    • Automate metadata ingestion and implement data quality frameworks to ensure accuracy and consistency.

    • Architect infrastructure that supports AI/ML readiness through advanced tagging, cataloging, and governance protocols.

    • Collaborate with cross-functional teams to integrate metadata solutions into enterprise data platforms.

    • Optimize performance and scalability of AWS-based data ecosystems for large-scale analytics.

     

    We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to [email protected] learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.

     

    Skills and Requirements

    AWS Expertise:

    • AWS Glue Data Catalog

    • Redshift Spectrum

    • Lake Formation

    Metadata Management:

    • Enterprise-scale metadata platforms

    • Automated metadata ingestion

    Data Governance:

    • Framework design and implementation

    • Compliance and security protocols

    Data Architecture:

    • Redshift-centric ecosystems

    • Schema evolution and versioning

    • Cross-system data mapping

    Data Lineage:

    • Design and deployment of lineage tracking systems

    Data Quality:

    • Frameworks for validation and consistency

    AI/ML Enablement:

    • Infrastructure design for future AI workloads

    • Advanced tagging and cataloging strategies

    Programming & Tools:

    • Proficiency in Python, SQL

    • Familiarity with ETL orchestration tools (e.g., AWS Glue, Apache Airflow)