-
Data Engineer
- Insight Global (Seattle, WA)
-
Job Description
Job Description
This Databricks subject matter expert will be coming in to assist a senior data engineering team to evaluate and assess their current usage of Databricks at an enterprise-level. They will consult on areas like: code best practices, performance tuning, cluster configurations, visualization and reporting as well as table and schema design to make recommendations. This person will collaborate with the team to implement these recommendations. This is an opportunity to work across multiple cloud providers with cutting edge technology and have an impact across an entire corporation.
We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form (https://airtable.com/app21VjYyxLDIX0ez/shrOg4IQS1J6dRiMo) . The EEOC "Know Your Rights" Poster is available here (https://www.eeoc.gov/sites/default/files/2023-06/22-088\_EEOC\_KnowYourRights6.12ScreenRdr.pdf) .
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .
Skills and Requirements
Required Skills & Experience
* 5+ years of experience in data engineering.
* Proficiency in SQL, Python,
* High quality SQL writing experience
* Python or PySpark for coding
* Experience with using Scala
* Experience with big data tools (e.g., Spark, Hadoop).
* AWS or Azure familiarity
* Advanced Databricks understanding - coding best practices, cluster configuration, visualization and reporting, table and schema design (Delta Tables, Unity Catalog)
-Experience assessing, recommending, implementing best/optimal practices within Databricks
* Familiarity with data modeling and database design.
* Strong problem-solving skills and attention to detail.
Nice to Have Skills & Experience
* Master's degree in a relevant field.
* Certifications in cloud platforms (e.g., AWS Certified Data Analytics, Google Professional Data Engineer).
* Knowledge of machine learning frameworks (e.g., TensorFlow, PyTorch). null
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [email protected].
-