Shift Assignment: Night Shift
We are looking for an experienced Data Engineer to join our team. The ideal candidate will have expertise in the Azure Data Factory (ADF), Databricks, SQL and data warehouse concepts. In this role, you will be responsible for creating, maintaining, and optimizing data pipelines and processes, building and deploying data models, and ensuring data integrity.
Responsibilities
- Design and develop data pipelines/processes using ADF, Databricks, and SQL.
- Design and develop data models to support business requirements.
- Analyze and optimize data pipelines and data models.
- Monitor data pipelines, data models, and data integrity.
- Work closely with other teams to ensure data quality and accuracy.
- Implement best practices for data security and privacy.
- Troubleshoot data-related issues.
