Data Engineer - Databricks Specialist
The AA
- Basingstoke, England, United Kingdom
- Basingstoke, England, United Kingdom
Über
Employment Type Permanent, full time
Job Overview Are you passionate about data and eager to make a significant impact? The AA is a well‐loved brand with a range of driver services that extends far beyond most people realise. We have an enviable set of data assets from breakdown, service, repair, insurance, telematics, digital interactions, car dealers and driving schools. Our growing team is modernising our data infrastructure to a cutting‐edge cloud platform and enabling machine learning and GenAI. Join us at an exciting time and be part of a team that is driving meaningful change for our customers, colleagues and shareholders.
What I will be doing
Design, build and operate production‑grade Databricks Lakehouse solutions, including structured streaming pipelines using Python and PySpark.
Own and evolve Unity Catalog‑based governance to ensure secure, discoverable and well‑managed data assets.
Develop and maintain event‑driven data pipelines, integrating closely with backend engineering teams.
Implement and support CI/CD pipelines in Azure DevOps to enable reliable, automated Databricks deployments.
Create high‑quality, analytics‑ready datasets that deliver actionable business insight at scale.
Proactively improve performance, reliability, automation and observability across the Databricks data platform.
What do I need We are intentionally setting a high bar for Databricks experience. You should be able to demonstrate deep, hands‑on capability, not just theoretical knowledge.
Essential Experience
Significant, hands‑on experience with Azure Databricks in a production environment.
Proven experience building Spark/Databricks pipelines using Python and PySpark.
Strong experience with structured streaming and event‑driven architectures.
Practical experience implementing and operating Unity Catalog.
Solid understanding of Lakehouse design principles, including dimensional and analytical modelling.
Experience building and maintaining CI/CD pipelines, ideally using Azure DevOps.
Confidence working with large‑scale data, performance tuning and troubleshooting complex pipelines.
You Have We understand that “Databricks experience” can mean different things. For this role we mean:
Designed and built Databricks pipelines end‑to‑end.
Made architectural decisions within Databricks environments.
Worked with Spark internals, optimisation techniques and cluster configuration.
Operated Databricks solutions in live, business‑critical contexts.
Benefits
25 days annual leave plus bank holidays + holiday buying scheme.
Worksave pension scheme with up to 7% employer contribution.
Free AA breakdown membership from Day 1 plus 50% discount for family and friends.
Discounts on AA products including car and home insurance.
Employee discount scheme that gives access to a car salary sacrifice scheme plus great discounts on healthcare, shopping, holidays and more.
Company‑funded life assurance.
Diverse learning and development opportunities to support career progression.
Dedicated Employee Assistance Programme and a 24/7 remote GP service for you and your family.
Equal Opportunity We’re an equal opportunities employer and welcome applications from everyone. The AA values diversity and the difference this brings to our culture and our customers. We actively seek people from diverse backgrounds to join us and become part of an inclusive company where you can be yourself, be empowered to be your best and feel like you truly belong. We have five communities to bring together people with shared characteristics and backgrounds and drive positive change.
Seniority Level Not Applicable
Job Function Information Technology
Industries Motor Vehicle Manufacturing, Financial Services, and Insurance
#J-18808-Ljbffr
Sprachkenntnisse
- English
Hinweis für Nutzer
Dieses Stellenangebot stammt von einer Partnerplattform von TieTalent. Klicken Sie auf „Jetzt Bewerben“, um Ihre Bewerbung direkt auf deren Website einzureichen.