Cette offre d'emploi n'est plus disponible
À propos
Job Description: We are looking for a highly skilled and hands-on Senior Data Engineer with strong expertise in Azure data technologies, Databricks, PySpark, and large-scale ETL/ELT pipeline development. The ideal candidate will be responsible for designing, developing, monitoring, and supporting enterprise-grade data workflows while ensuring data quality, governance, and operational excellence.
This role requires close collaboration with business, analytics, and engineering teams to build scalable and reliable data solutions supporting critical business operations and analytics initiatives.
Key Responsibilities Design, develop, and maintain scalable ETL/ELT data pipelines using Azure Data Factory (ADF), Azure Databricks, and PySpark. Build and optimize large-scale structured and unstructured data processing workflows. Develop and manage workflow orchestration using Airflow / Astronomer. Monitor, troubleshoot, and support production data pipelines and workflows. Ensure data quality, validation, governance, and lineage across data platforms. Work closely with business stakeholders, analytics teams, and cross-functional engineering teams to gather requirements and deliver data solutions. Improve pipeline performance, scalability, reliability, and operational efficiency. Support end-to-end data lifecycle management and operational ownership. Must Have Skills
Strong hands-on experience with: Azure Data Factory (ADF) Azure Databricks PySpark / Spark SQL Advanced SQL
Experience building and supporting: Production-grade ETL/ELT pipelines End-to-end data workflows Large-scale structured and unstructured data processing
Strong expertise in: Airflow / Astronomer Workflow orchestration Pipeline monitoring and troubleshooting
Good understanding of: Data quality and validation Data governance and lineage Production support and operational ownership
Excellent communication and stakeholder management skills. Candidate must be a hands-on engineer and comfortable working directly with business and analytics teams. Good to Have Skills
Experience with marketing analytics platforms and campaign/impression/spend data. Exposure to: Client Fabric Snowflake dbt Delta Lake Kafka / Event Hub streaming pipelines
Experience with: CI/CD for data pipelines Real-time or near-real-time data processing Data governance frameworks
Company Benefits & Culture
Comprehensive health insurance plans Opportunities for professional development and career growth Inclusive and dynamic work environment
For immediate consideration please click APPLY to begin the screening process with Alex.
Compétences linguistiques
- English
Avis aux utilisateurs
Cette offre a été publiée par l’un de nos partenaires. Vous pouvez consulter l’offre originale ici.