Data EngineerZonal Retail Data Systems Limited • Edinburgh, Scotland, United Kingdom
Dieses Stellenangebot ist nicht mehr verfügbar
Data Engineer
Zonal Retail Data Systems Limited
- Edinburgh, Scotland, United Kingdom
- Edinburgh, Scotland, United Kingdom
Über
*Job Summary: *
We are looking for a passionate Data Engineer to bring their knowledge and experience to our team and help drive forward the Data Engineering function. You will help design and contribute to the development of a robust, managed and accessible data foundation.
To succeed in this Data Engineering role, you should have strong analytical skills and the ability to combine data from many different sources. Required Data Engineer skills also include familiarity with key programming languages and knowledge of best practice development and approaches.
If you are detail-oriented, with excellent organisational skills and experience in this field, we’d love to hear from you.
*Responsibilities*
· Comfortable creating data pipeline architecture and RESTful Api interfaces as part of a data solution
· Design, build and maintain end-to-end data pipelines for multi-tenant data processing system using python, databricks SDK and databricks workflows
· Design and maintain multi-tenant data processing systems.
· Integrate with Azure cloud services (inc Storage, Service Bus, Monitor, Key Vault)
· Build and maintain Docker containers and manage applications on Kubernetes.
· Maintain Azure DevOps build and deployment pipelines for CI/CD.
· Manage data quality, monitor accuracy and completeness, and advise ways that data quality can be improved.
· Identify, root cause analysis, and fix incidents related to data management
· Performance monitor data and reporting platforms
· Work as part of a team to deliver projects to meet the needs of the business
· Routinely provide status updates to colleagues and stakeholder groups
*Requirements and skills*
· Advanced programming knowledge of Python including the FastAPI Framework and Object Oriented Programming.
· Proven experience working with PySpark and Spark SQL for data transformation.
· Proven experience working with Azure cloud services specifically in Azure Data Factory, Storage, Service Bus and Azure Monitor or similar on AWS/GCP.
· Containerisation and orchestration using docker and Kubernetes
· Strong understanding of databricks workflow orchestration, data validation patterns.
· Strong understanding of multi-tenant architecture and event driven architecture.
· Experience with SQL database design, normalisation.
· Hands on experience with DevOps and CI/CD.
· Experience working with data visualization tools and techniques.
· Strong problem-solving skills and attention to detail.
· Excellent communication and collaboration skills.
· Be able to clearly document and communicate complex data concepts to a varied audience.
*It’s a bonus if you have*
* Proven experience of Databricks especially around data ingest and pipelines.
* Experience in Data Science and Machine Learning models
* Data Engineering certifications
* Experience within hospitality, retail, payments or other guest facing systems
* Excellent communication and stakeholder management
* Degree in Computer Science, IT, or similar field; a Master’s is a plus
Job Types: Full-time, Permanent
Pay: £45,000.00-£65,000.00 per year
Work Location: Hybrid remote in Edinburgh EH3 5DA
Sprachkenntnisse
- English
Hinweis für Nutzer
Dieses Stellenangebot wurde von einem unserer Partner veröffentlicht. Sie können das Originalangebot einsehen hier.