This job offer is no longer available
Data Engineer
SF Partners Admin
- Worcester, England, United Kingdom
- Worcester, England, United Kingdom
About
Worcestershire (Hybrid ā 1 day per week) Ā£80,000 - Ā£85,000 + Bonus + Excellent Pension SC Clearance Required (DV eligible)
The Opportunity We are supporting a specialist technology consultancy delivering advanced data and AI solutions within highly secure government environments. This is a genuinely unique engineering role, focused on solving complex challenges at scale by working with extremely large, text-heavy datasets to support real-world, high-impact outcomes. If you enjoy tackling complex data problems in distributed systems rather than standard reporting or dashboarding, this role will be a strong fit. The Role Work with multi-terabyte to large-scale datasets (100TB+), primarily text-based Build and optimise data ingestion and processing pipelines Improve batch processing performance and throughput across large datasets Solve challenges related to scalability, reliability, and data flow Contribute to the development of distributed data platforms Collaborate within a highly technical, research-driven environment What We're Looking For Experience working with large-scale datasets (multi-terabyte minimum) Strong background in data engineering within distributed systems Proven ability to b...
Languages
- English
Notice for Users
This job was posted by one of our partners. You can view the original job source here.