- Microsoft Corporation (New York, NY)
- …AI) is seeking experienced Data Engineers to help build mission critical data pipelines that ingest, process and publishes data streams from our personal AI, Copilot ... The Data Platform Engineering team is responsible for building core data pipelines that help fine tune models, support introspection and retrospection of data… more
- Meta (New York, NY)
- …largest data sets and build on top of hyper-scale data pipelines . **Required Skills:** Security Engineer - Surface Coverage, Detection Engineering Responsibilities: ... attack testing automation to validate detection coverage 8. Build logging pipelines using our custom datasets and infrastructure **Minimum Qualifications:** Minimum… more
- CGI Technologies and Solutions, Inc. (New York, NY)
- …ensuring security, performance, and scalability. * Oversee implementation of data pipelines and processing frameworks using Apache Spark (PySpark), Hadoop ecosystem, ... for monitoring and caching * Maintain oversight of production deployment pipelines , release packages, runbooks, and support operational resilience * Participate in… more
- Robert Half Technology (New York, NY)
- …this role, you will be instrumental in designing, developing, and optimizing data pipelines and systems to support business needs. This position requires a strong ... data governance and orchestration. Responsibilities: * Develop and maintain scalable data pipelines using Python and Apache Spark, ensuring adherence to clean coding… more
- New York Times (New York, NY)
- …You will build a team of engineers focused on deploying and managing real-time pipelines and APIs in an event-driven architecture to process event streams and serve ... as an Engineering Manager leading a data engineering team building production data pipelines and data products. + 5+ years of full-time data engineering experience… more
- Anywhere Real Estate (New York, NY)
- …capabilities. + Design, build, and maintain robust, scalable, and reliable data pipelines and ETL processes. + Develop and maintain data infrastructure and platforms ... principles and technologies. + 10+ years' experience with data pipelines , ETL processes, and data warehousing. + 5+ years'...and data warehousing. + 5+ years' experience building data pipelines using Kafka, Kafka Connect, Airflow, and Snowflake. +… more
- S&P Global (New York, NY)
- …lead multiple engineering teams responsible for our CMS platform, content pipelines , publishing tools, editorial workflows, and integrations with front-end delivery ... understanding of content modeling, editorial workflows, version control, and publishing pipelines . + Proven track record in architecting and scaling web platforms,… more
- Cognizant (Albany, NY)
- …most successful businesses - our clients. **Responsibilities** + Build and deliver data pipelines to store data in a way that is accessible, performant, secure, and ... deliver ingestion, search, metadata cataloging and scheduling of data pipelines + Data engineering in line with standard processes...background in relational data models + Exposure in Data Pipelines & SQL / NoSQL (eg Cassandra, HBase) and… more
- Capital One (New York, NY)
- …to deliver optimized ML models at scale. + Construct optimized data pipelines to feed ML models. + Leverage continuous integration and continuous deployment ... field + 3+ years of experience building production-ready data pipelines that feed ML models + 3+ years of...Platform + Experience designing, implementing, and scaling complex data pipelines for ML models and evaluating their performance +… more
- S&P Global (New York, NY)
- …development of custom AI architecture for batch and stream processing-based AI ML pipelines including data ingestion to preprocessing to scaled AI model compute and ... issues related to machine learning model deployments and data pipelines , and develop innovative solutions + Serve as a...experience with version control systems (eg, Git) and CI/CD pipelines . + Strong familiarity with higher level trends in… more