Cette offre d'emploi n'est plus disponible
Lead Python Architect
SoHo Dragon
- London, England, United Kingdom
- London, England, United Kingdom
À propos
We are seeking a high-caliber Lead Python Architect to serve as the technical engine-room
lead for an enterprise-wide data modernization. Reporting to the Overall Architecture Lead,
you will act as the Technical Lieutenant responsible for the foundational Design
Specification and the long-term Engineering Roadmap.
The mission is to move from a legacy Azure Synapse environment to a modern Fabric
Lakehouse, but with a strategic twist: we are architecting for Data Portability. We require a
Spark expert likely with deep Databricks or Open-Source experience to ensure that
while we leverage Fabric for its BI-led ecosystem, our core logic remains platform-agnostic
and built on Delta Lake standards.
Core Responsibilities
Architectural Blueprint & Design Specification
As the primary technical designer, you will own the technical design specifications for the
entire Lakehouse estate. You will be responsible for ensuring every architectural decision
from schema enforcement to Delta Lake optimization supports a BI-led, high-performance
outcome. This includes defining the 'Gold Standard' for PySpark development and designing
metadata and security layers that protect the enterprise while maintaining the flexibility of
open-source standards.
Migration Strategy & Roadmap Planning
You will play a pivotal role in defining the Migration Roadmap, partnering with leadership
to determine the sequence of the transition. Your expertise will be used to decide where to
refactor legacy logic versus where to re-platform, ensuring the roadmap minimizes business
disruption while aggressively de-risking the Synapse-to-Spark transition. You will also
select the companion tooling for CI/CD, testing, and observability that will sustain the
platform for years to come.
High-Stakes Delivery & Framework Engineering
This is a 'Playing Coach' position that requires significant hands-on execution. You will lead
the 'Migration Factory' by personally refactoring complex legacy T-SQL and proprietarySynapse utilities into optimized, reusable PySpark modules. By building the foundational
ingestion and transformation templates, you will provide the blueprint that our global
engineering teams (UK, EU, and Offshore) will scale across the organization.
Technical Leadership & Performance Authority
Beyond the code, you are the final escalation point for the engineering function. You will
lead code reviews and perform deep-dive Spark performance tuning to ensure the BI layer
receives data at peak efficiency. Your goal is to mentor the team and set a standard of
engineering excellence that bridges the gap between high-level strategy and production-
grade delivery.
Required Skills & Experience
The Strategy-to-Execution Bridge: Proven ability to translate high-level CDO strategy
into detailed High-Level (HLD) and Low-Level Design (LLD) documents that engineers
can execute.
The Spark 'Engine Room': Expert-level PySpark mastery. You understand the Catalyst
Optimizer, memory management, and why 'Open Standards' (Delta Lake) are the
superior choice for long-term portability.
Synapse Migration Mastery: Extensive experience auditing legacy Synapse
environments and mapping out a clean, sequenced path to a Spark-native future.
Roadmap Discipline: Experience planning and executing multi-phase migrations in
complex enterprise environments, balancing 'quick wins' for stakeholders with
architectural integrity.
Backend Software Engineering: Strong Python fundamentals; you treat data pipelines
as software products, prioritizing modularity, testability, and idempotency.
The Profile of Success
A Technical Anchor: You lead through competence and are equally comfortable in a
roadmap planning session or a deep-dive code review.
An 'Open' Advocate: You have a visceral distaste for vendor lock-in and a passion for
building portable, high-quality data estates.
A Delivery Engine: You have a bias for action and believe that the best way to lead a
global team is by setting the standard through the quality of your own architectural blueprints and code.
Job Types: Full-time, Temp to perm
Contract length: 12 months
Pay: £100,000.00-£150,000.00 per year
Work Location: Hybrid remote in London
Compétences linguistiques
- English
Avis aux utilisateurs
Cette offre a été publiée par l’un de nos partenaires. Vous pouvez consulter l’offre originale ici.