Data Engineer

Job Title: Data Engineer (Databricks & Power Platform Automate)

Location: London, ideally. We are open to Birmingham, Manchester, or Newcastle.

Duration: 6+ months contract

Overview:

We are looking for a skilled Data Engineer with expertise in Databricks and Microsoft Power Platform Automate engines to design, build, and optimize data workflows and automation solutions.

Key Responsibilities:

• Develop, implement, and maintain data pipelines using Databricks (Apache Spark, Delta Lake, MLflow).
• Design and optimize ETL/ELT workflows to process large datasets efficiently.
• Automate data processing and integration tasks using Power Automate, Power Apps, and Power BI.
• Work with Azure Data Services (Azure Data Lake, Synapse Analytics, Data Factory, Azure SQL) to manage data storage and processing.
• Create low-code automation workflows to enhance data accessibility and business process efficiency.
• Implement API integrations and Power Automate connectors to link various data sources.
• Monitor, troubleshoot, and optimize data workflows for performance and reliability.
• Collaborate with data analysts, business stakeholders, and software teams to enable self-service analytics and reporting.
• Stay updated on emerging trends in Databricks, Power Platform, and cloud automation technologies.

Required Skills & Qualifications:

• 3+ years of experience in data engineering, ETL development, or cloud data processing.
• Strong knowledge of Power Automate and Power Apps for workflow automation and process optimization.
• Experience with Azure Data Services (Data Lake, Synapse, Azure SQL, Data Factory).
• Proficiency in SQL and Python for data transformation and automation.
• Hands-on experience with API integration, REST services, and Power Platform connectors.
• Strong analytical and problem-solving skills, with the ability to work independently or in a team.