Cette offre d'emploi n'est plus disponible
Data Engineer - Databricks
Prophecy Technologies
- United States
- United States
À propos
The Senior Data Engineer will be responsible for designing, building, and maintaining scalable data pipelines and cloud-based data solutions. This role focuses on developing robust ETL/ELT processes, optimizing Databricks environments, and enabling data-driven decision-making through high-quality data models and governed data platforms. The engineer will collaborate closely with cross-functional teams to ensure reliable, secure, and cost-effective data solutions.
Location:
Seattle, WA
Experience:
• 7+ years of experience in Data Engineering or related roles
• Strong hands-on experience with Databricks Cloud Data Platform
• Proven experience working in cloud environments (Azure preferred)
Key Responsibilities:
• Design, build, and deploy data extraction, transformation, and loading (ETL/ELT) pipelines from databases, APIs, and data files
• Develop and support scalable data pipelines within Databricks Cloud Data Platform
• Build and maintain data models aligned with domain expertise and evolving business needs
• Monitor, tune, and optimize Databricks cluster performance for cost-effective scaling
• Implement and maintain
Delta Lake
for reliable, versioned, and high-performance data storage
• Automate CI/CD pipelines for data workflows using
Azure DevOps
• Collaborate with cross-functional teams to support data governance using
Databricks Unity Catalog
• Ensure data quality, integration, and transformation best practices
• Communicate technical concepts clearly to non-technical stakeholders
Required Skills & Experience:
• Strong programming skills in
Python / PySpark ,
SQL , or
Scala
• Hands-on experience with
Databricks (Required)
• Experience with workflow orchestration tools such as:
- Databricks Jobs
- Azure Data Factory pipelines
• Strong understanding of cloud data architectures (Azure preferred)
• Deep knowledge of database and storage concepts:
- Data Lakes
- Relational Databases
- NoSQL
- Graph Databases
- Data Warehousing
Competencies:
• Cloud Data Engineering
• Data Modeling & Architecture
• Performance Optimization
• CI/CD & Automation
• Data Governance & Collaboration
• Strong Communication Skills
Preferred Skills:
• Experience with Azure-native services
• Familiarity with enterprise data governance frameworks
• Experience working in large-scale or enterprise data environments
Compétences linguistiques
- English
Avis aux utilisateurs
Cette offre a été publiée par l’un de nos partenaires. Vous pouvez consulter l’offre originale ici.