À propos
Build and maintain Azure Data Factory pipelines to ingest data from multiple sources Write Python code in Databricks to clean raw data and move it into the silver layer, ensuring deduplication and validation Monitor daily jobs, troubleshoot failures, and implement automated checks for data quality
Required Qualifications
5+ years of experience in Data Engineering with a focus on ETL/ELT pipelines in a cloud environment Proficiency in building and optimizing data pipelines using Azure Data Factory and Databricks Strong proficiency in SQL for data analysis and Python for scripting and transformation Experience implementing automated data quality checks and a proactive approach to identifying pipeline failures Bachelor's degree in Computer Science, Software Engineering, Data Engineering, or a closely related technical field
Compétences linguistiques
- English
Avis aux utilisateurs
Cette offre provient d’une plateforme partenaire de TieTalent. Cliquez sur « Postuler maintenant » pour soumettre votre candidature directement sur leur site.