XX
Data Engineer - DatabricksProphecy TechnologiesUnited States
XX

Data Engineer - Databricks

Prophecy Technologies
  • US
    United States
  • US
    United States

About

Job Summary:
The Senior Data Engineer will be responsible for designing, building, and maintaining scalable data pipelines and cloud-based data solutions. This role focuses on developing robust ETL/ELT processes, optimizing Databricks environments, and enabling data-driven decision-making through high-quality data models and governed data platforms. The engineer will collaborate closely with cross-functional teams to ensure reliable, secure, and cost-effective data solutions.
Location:
Seattle, WA
Experience:
• 7+ years of experience in Data Engineering or related roles
• Strong hands-on experience with Databricks Cloud Data Platform
• Proven experience working in cloud environments (Azure preferred)
Key Responsibilities:
• Design, build, and deploy data extraction, transformation, and loading (ETL/ELT) pipelines from databases, APIs, and data files
• Develop and support scalable data pipelines within Databricks Cloud Data Platform
• Build and maintain data models aligned with domain expertise and evolving business needs
• Monitor, tune, and optimize Databricks cluster performance for cost-effective scaling
• Implement and maintain
Delta Lake
for reliable, versioned, and high-performance data storage
• Automate CI/CD pipelines for data workflows using
Azure DevOps
• Collaborate with cross-functional teams to support data governance using
Databricks Unity Catalog
• Ensure data quality, integration, and transformation best practices
• Communicate technical concepts clearly to non-technical stakeholders
Required Skills & Experience:
• Strong programming skills in
Python / PySpark ,
SQL , or
Scala
• Hands-on experience with
Databricks (Required)
• Experience with workflow orchestration tools such as:
- Databricks Jobs
- Azure Data Factory pipelines
• Strong understanding of cloud data architectures (Azure preferred)
• Deep knowledge of database and storage concepts:
- Data Lakes
- Relational Databases
- NoSQL
- Graph Databases
- Data Warehousing
Competencies:
• Cloud Data Engineering
• Data Modeling & Architecture
• Performance Optimization
• CI/CD & Automation
• Data Governance & Collaboration
• Strong Communication Skills
Preferred Skills:
• Experience with Azure-native services
• Familiarity with enterprise data governance frameworks
• Experience working in large-scale or enterprise data environments
  • United States

Languages

  • English
Notice for Users

This job comes from a TieTalent partner platform. Click "Apply Now" to submit your application directly on their site.