Cette offre d'emploi n'est plus disponible
À propos
Job Summary: We are seeking a Senior Databricks Data Engineer with strong experience in enterprise-scale data migration, development, production deployment, and support. The ideal candidate will have extensive hands-on expertise in Azure Databricks, PySpark, Python, SQL, and Azure cloud services, along with experience managing end-to-end data engineering solutions in production environments.
Key Responsibilities: • Design, develop, and maintain scalable data pipelines and ETL/ELT workflows using Python, PySpark, and SQL. • Lead and support large-scale data migration and modernization initiatives. • Build, optimize, and maintain Azure Databricks workloads, including cluster configuration, autoscaling, governance, and performance tuning. • Deploy and support production data solutions, ensuring stability, reliability, and operational excellence. • Troubleshoot and resolve production issues and participate in on-call support rotations. • Collaborate with business stakeholders, application teams, and data consumers to gather requirements and translate them into technical solutions. • Develop and maintain Infrastructure-as-Code using ARM Templates. • Implement CI/CD pipelines using Azure DevOps and GitLab. • Configure and manage Azure services including Storage Accounts, Synapse Analytics, Key Vault, VMSS, Function Apps, Web Apps, Log Analytics Workspace, Azure Container Apps, and Container Instances. • Implement secure access controls using Azure Active Directory, Managed Identities, and Service Principals. • Partner with networking and security teams to ensure secure and compliant cloud environments. • Monitor system performance, implement alerting, and optimize cloud resource utilization and costs. • Ensure compliance with data governance, security, and lineage requirements. • Participate in Agile ceremonies including sprint planning, standups, reviews, and retrospectives.
Required Qualifications: • 8+ years of experience in Data Engineering and Data Platform development. • Strong hands-on experience with Python, PySpark, and advanced SQL. • Extensive experience with Azure Databricks in enterprise environments. • Proven experience delivering large-scale migration projects. • Experience with production deployments and post-production support. • Strong knowledge of Azure cloud services including: Azure Storage Accounts Azure Synapse Analytics Azure Key Vault VM Scale Sets (VMSS) Function Apps Web Apps Log Analytics Workspace Managed Identities and Service Principals • Experience with ARM Templates and Infrastructure-as-Code. • Hands-on experience with GitLab and Azure DevOps. • Familiarity with Azure networking and security concepts. • Experience supporting production environments and handling critical incidents. • Strong communication and stakeholder management skills. Preferred Qualifications: • Experience working on cloud modernization initiatives. • Experience with Azure Container Apps and Container Instances. • Knowledge of data governance and compliance frameworks. • Experience collaborating with both legacy and modern application teams. • Prior experience in large enterprise environments.
Work Breakdown: • 60% Development • 20% Business & Stakeholder Collaboration • 20% Production Support and Operations
Company Benefits & Culture
Competitive salary and benefits package Supportive and collaborative work environment Opportunities for professional growth and development
For immediate consideration please click APPLY to begin the screening process with Alex.
Compétences linguistiques
- English
Avis aux utilisateurs
Cette offre a été publiée par l’un de nos partenaires. Vous pouvez consulter l’offre originale ici.