Python Data Engineer Azure & PySparkBrightbox GRP • London, England, United Kingdom

Cette offre d'emploi n'est plus disponible

Python Data Engineer Azure & PySpark

Brightbox GRP

London, England, United Kingdom

London, England, United Kingdom

Trouver des emplois similaires

À propos

SC Cleared Python Data Engineer Azure & PySpark Contract | £400£458 per day (Inside IR35) SC Clearance is essential We are looking for an experienced Data Engineer with strong Python skills to join a delivery-focused team working on complex data platforms in Azure. Although this is a data engineering role, the lead engineer is specifically looking for someone who is highly competent in Python, as a significant part of the work involves developing and maintaining complex, test-driven data flows. You will be responsible for building scalable data pipelines using Python and PySpark, optimizing Delta Lake storage, and deploying solutions in a containerised Azure environment. Quality, maintainability, and automated testing are key to this role. What youll be doing Designing and building robust data pipelines using Python and PySpark Developing complex data flows with a strong focus on clean, testable Python code Writing unit and BDD tests using Behave, including mocking and patching Creating and optimizing Delta Lake tables for performance and reliability Working with Docker to support consistent development and deployment Integrating Azure services such as Azure Functions, Key Vault, and Blob Storage Collaborating with engineering and DevOps teams on CI / CD pipelines Troubleshooting and tuning Spark jobs in pro...
#J-18808-Ljbffr

London, England, United Kingdom

Compétences linguistiques

English

Avis aux utilisateurs

Cette offre a été publiée par l’un de nos partenaires. Vous pouvez consulter l’offre originale ici.

Trouver des emplois similaires