Sr. Azure Data Engineer

Title: Azure Data Engineer
Location: Remote (Preference for Texas-based candidates)
Duration: Through August 31, 2026, with the potential for extension
Submission Deadline: October 19, 2025, at 2:00 PM CST
Work Arrangement: Fully remote. Candidates must currently reside in Texas.

We're looking for an experienced Azure Data Engineer to design, develop, and optimize enterprise-grade data solutions leveraging the Databricks Unified Analytics Platform. This role centers around building high-performance data pipelines, implementing efficient ETL/ELT processes, and ensuring robust data governance and security practices. You'll play a key part in advancing data engineering, analytics, and machine learning initiatives across a data-driven enterprise.

Responsibilities

• Design and develop scalable, high-throughput data pipelines and workflows.
• Implement and maintain ETL/ELT processes for both structured and unstructured datasets.
• Optimize Apache Spark jobs for better performance and cost control.
• Integrate solutions with Azure Data Factory and related Azure services.
• Automate builds and deployments using CI/CD pipelines and version control tools.
• Collaborate closely with data scientists, analysts, and business stakeholders.
• Enforce data quality, lineage, and security standards using Delta Lake or Unity Catalog.
• Support governance, metadata management, and compliance initiatives.

Required Skills and Experience

• 10 years: Hands-on experience with ETL/ELT workflows for structured and unstructured data.
• 8 years: CI/CD automation, deployment management, and data modeling with strong database design skills.
• 8 years: Expertise in Azure Data Lake, Data Warehouse, and other data storage architectures.
• 8 years: Strong background in data validation, governance, and compliance including encryption and access control.
• 8 years: Proficiency in Python, R, and SQL.
• 8 years: Experience working in Azure Cloud, DevOps, and Agile environments.
• 5 years: Solid understanding of Databricks (Spark, Delta Lake, Notebooks, Clusters, Jobs).
• 5 years: Integration experience with Azure Data Factory.
• 5 years: Proven ability to optimize Spark jobs for performance and cost efficiency.
• 5 years: Deep understanding of Apache Spark architecture (RDDs, DataFrames, Spark SQL).

Preferred Qualifications

• Familiarity with machine learning frameworks such as MLflow, Scikit-learn, or TensorFlow.
• Databricks Certified Associate Developer for Apache Spark.
• Microsoft Certified Azure Data Engineer Associate credential.

Job Type: Contract

Pay: $ $72.52 per hour

Expected hours: 40 per week

Application Question(s):

• Please apply only if you do not require sponsorship now or in the future.

Work Location: Remote