About
The ideal person would have strong commercial experience in real-time data engineering and cloud technologies, and be able to apply this expertise to business problems to generate value.
We currently work in an AWS, Snowflake, dbt, Looker, Python, Kinesis and Airflow stack and are building out our real-time data streaming capabilities using Kafka. You should be comfortable with these or comparable technologies.
As an individual contributor, you will take ownership of well-defined projects, collaborate with senior colleagues on architectural decisions, and contribute to improving data engineering standards, documentation, and team practice.
The successful candidate will join our cross functional development teams and actively participate in our agile delivery process. Our dynamic Data & AI team will also support you, and you will benefit from talking data with our other data engineers, data scientists, and ML and analytics engineers.
Responsibilities
Contribute to our data engineering roadmap.
Collaborate with senior data engineers on data architecture plans.
Managing Kafka in production
Collaborating with cross-functional teams to develop and implement robust, scalable solutions.
Supporting the elicitation and development of technical requirements.
Building, maintaining and improving data pipelines and self-service tooling to provide clean, efficient results.
Develop automated tests and monitoring to ensure data quality and data pipeline reliability.
Implement best practices in data governance through documentation, observability and controls.
Using version control and contributing to code reviews.
Supporting the adoption of tools and best practices across the team.
Mentoring junior colleagues where appropriate.
Requirements Essential
Solid commercial experience in a mid-level data engineering role.
Excellent production-grade Python skills.
Previous experience with real-time data streaming platforms such as Kafka/Confluent/Google Cloud Pub/Sub.
Experience handling and validating real-time data.
Experience with stream processing frameworks such as Faust/Flink/Kafka Streams, or similar.
Comfortable with database technologies such as Snowflake/PostgreSQL and NoSQL technologies such as Elasticsearch/MongoDB/Redis or similar.
Proficient with ELT pipelines and the full data lifecycle, including managing data pipelines over time.
Good communication skills and the ability to collaborate effectively with engineers, product managers and other internal stakeholders.
Desirable
An understanding of JavaScript/TypeScript.
An understanding of Docker.
Experience with Terraform
Experience with EKS/Kubernetes
Experience developing APIs.
Studies have shown that women and people who are disabled, LGBTQ+, neurodiverse or from ethnic minority backgrounds are less likely to apply for jobs unless they meet every single qualification and criteria. We're committed to building a diverse, inclusive, and authentic workplace where everyone can be their best, so if you're excited about this role but your past experience doesn't align perfectly with every requirement on the Job Description, please apply anyway - you may just be the right candidate for this or other roles in our wider team.
Benefits
Medicash healthcare scheme (reclaim costs for dental, physiotherapy, osteopathy and optical care)
Life Insurance scheme
25 days holiday + bank holidays + your birthday off (rising to 28 after 3 consecutive years with the business & 30 after 5 years)
Employee Assistance Programme (confidential counselling)
Gogeta nursery salary sacrifice scheme (save up to 40% per year)
Enhanced parental leave and pay including 26 weeks' full maternity pay and 8 weeks' paternity leave
#J-18808-Ljbffr
Languages
- English
Notice for Users
This job comes from a TieTalent partner platform. Click "Apply Now" to submit your application directly on their site.