- Amazon (New York, NY)
- …sense of ownership, bias for action, urgency, and drive - Experience with Big Data technologies such as Spark , Hadoop or any other distributed data ... engine - Experience working with Amazon Web Services - Experience in SQL and data modeling skills Amazon is an equal opportunity employer and does not discriminate… more
- Acxiom (Albany, NY)
- …or relevant certifications (AWS, GCP, Kubernetes, etc.) + Understanding of big data processing frameworks (Apache Spark , Hadoop ecosystem) and data ... and implement robust automation solutions for big data processing systems (SQL and Spark -based) +...big data processing systems (SQL and Spark -based) + Ensure scalable, reliable, and secure deployment pipelines… more
- Molina Healthcare (Albany, NY)
- …using solutions such as Kafka, Storm or Spark -Streaming + Proven experience on Big Data tools such as, Spark , Hive, Impala, Polybase, Phoenix, Presto, ... all the aspects of architecture, design and implementation of Data Management solution using Big Data...Lake, Azure Databricks, etc.) + Expert level experience on Hadoop cluster components and services (like HDFS, YARN, ZOOKEEPER,… more
- Synchrony (New York, NY)
- …/ Architect + Strong experience and deep understanding of ETL, data warehousing, data lake technologies ( Hadoop & Spark ) and analytics concepts. + Well ... Engineer to lead the development of consumer-centric low latency analytic environment leveraging Big Data and AWS technologies. The Technical Lead must have a… more
- CVS Health (New York, NY)
- …pipelines: Jenkins, GIT, or Control-M; * " Big data " platforms including Hadoop (Azure, GCP, or AWS) and Spark , Airflow, Kafka, Hbase, Pig, or NoSQL; ... reporting use cases; * Machine Learning and NLP (Scikit-Learn, SpaCity, Pytorch, or Spark NLP); * End-to-end data science lifecycle/workflow; and * Developing … more
- CVS Health (New York, NY)
- … NLP); Extract/Transform/Load (ETL) processes; Cloud components including cluster management; Data warehousing; Big Data implementation; Machine learning ... hiring for the following role in New York, NY: Data Engineer to Develop, build and manage large-scale ...Amazon Web Services (AWS), or Google Cloud Platform (GCP); Hadoop and HDFS; Spark , PySpark, or Scala;… more
- CVS Health (New York, NY)
- …Python, R, SAS, Julia, Gurobi, or CPLEX; " Big data " platforms including Hadoop (Azure, GCP, or AWS) and Spark , Airflow, Kafka, Hbase, Pig, or NoSQL; ... analytical and reporting use cases; and Large-scale Spark , Data Warehouse, or Big Data implementation. Pay Range: $111966.00/year to $170000.00/year.… more
- American Express (New York, NY)
- …and statistical tools (eg, Hive, PySpark, scikit-learn etc.) is required. + Experience in Big Data environment, inclusive of data mining techniques and ... Proficiency in CRM tools, Salesforce, or statistical software programs + Experience with Hadoop and Spark is a plus **Qualifications** Salary Range: $55,000.00… more
- Capital One (New York, NY)
- …with AWS + 4+ years experience with Distributed data /computing tools (MapReduce, Hadoop , Hive, EMR, Kafka, Spark , Gurobi, or MySQL) + 4+ year experience ... Lead Data Engineer Do you love building and pioneering...apply) + At least 2 years of experience in big data technologies + At least 1...least 2 years of experience in big data technologies + At least 1 year experience with… more
- Publicis Groupe (New York, NY)
- …models, including machine learning algorithms and AI; we process, integrate and manipulate big data with distributed systems and customer data pipelines; ... distributed computing systems to ingest, access and integrate disparate big data sources. + Conducting extensive exploratory...or R, SQL, and distributed computing systems such as Hadoop or AWS. Familiarity with Linux and/or Spark… more