This job offer is no longer available
About
Build and maintain Azure Data Factory pipelines to ingest data from multiple sources Write Python code in Databricks to clean raw data and move it into the silver layer, ensuring deduplication and validation Monitor daily jobs, troubleshoot failures, and implement automated checks for data quality
Required Qualifications
5+ years of experience in Data Engineering with a focus on ETL/ELT pipelines in a cloud environment Proficiency in building and optimizing data pipelines using Azure Data Factory and Databricks Strong proficiency in SQL for data analysis and Python for scripting and transformation Experience implementing automated data quality checks and a proactive approach to identifying pipeline failures Bachelor's degree in Computer Science, Software Engineering, Data Engineering, or a closely related technical field
Languages
- English
Notice for Users
This job was posted by one of our partners. You can view the original job source here.