Azure Databricks Architect with DBT

Job Title: Senior Azure Databricks Architect with DBT

Location: Remote

Job Type: Contract To Hire (C2H)

Job Description

The Senior Azure Databricks Architect will be responsible for designing, architecting, and optimizing large-scale data platforms and Lakehouse solutions on Azure. This role requires deep expertise in Azure Databricks, Apache Spark, PySpark, Delta Lake, and hands-on experience building enterprise transformation frameworks using DBT. The architect will define end-to-end solution architecture, modernize data ecosystems, and guide engineering teams on coding standards, performance tuning, and CI/CD best practices. This position requires strong leadership, technical depth, and the ability to collaborate with engineering, analytics, and business teams.

Key Responsibilities:

Lead architecture, design, and implementation of scalable data platforms using Azure Databricks, PySpark, Spark SQL, and Delta Lake.

Define Lakehouse and medallion architecture patterns for ingestion, transformation, and consumption.

Architect reusable and modular PySpark data transformation frameworks optimized for scale and cost.

Design data modeling structures aligned with DBT, Lakehouse, and enterprise ELT best practices.

Integrate Databricks with Azure services such as ADF, Synapse, Event Hub, Key Vault, and Azure DevOps.

Implement DBT best practices including modular SQL, data testing, versioning, documentation, and lineage.

Integrate DBT with Databricks SQL, Unity Catalog, and CI/CD pipelines.

Mentor developers on DBT transformations and ELT architecture patterns.