Dieses Stellenangebot ist nicht mehr verfügbar
Senior Software Data Engineer
Madfish
- London, England, United Kingdom
- London, England, United Kingdom
Über
Remote Job Type:
Full-Time (6-month contract with possibility of extension)
About Us We are a SaaS company that collects large-scale web data, analyzes it, and transforms it into actionable consumer insights for global brands. Our offerings include:
Data-driven dashboards for eCommerce, product development, and social platforms
Classified catalogs of products, reviews, and social content (posts, videos, comments, etc.)
Data drops and analytical outputs used by enterprise clients
We work with massive datasets and cutting-edge technologies, and we value collaboration, problem-solving, and continuous learning.
Role Overview We are looking for a highly skilled
Senior Software Data Engineer
to design, build, and optimize scalable data pipelines using
AWS
and the
Databricks (DBX)
ecosystem.
You will play a key role in ensuring the accuracy, reliability, and timeliness of our data outputs while contributing to our ML, MLflow, and LLM-driven capabilities.
You will collaborate closely with cross-functional teams including R&D, Product, and Delivery to validate features, troubleshoot issues, and deliver high-quality insights to clients.
Key Responsibilities
Design, build, and optimize scalable data pipelines using
PySpark
and
AWS services
Deliver production-grade data outputs with high accuracy and reliability
Develop automated testing frameworks to support end-to-end data quality
Integrate
ML ,
MLflow , and
LLM-based workflows
into data pipelines
Troubleshoot and resolve complex data and pipeline-related issues
Collaborate with Product Managers and Delivery Analysts to ensure release readiness
Maintain clear documentation and promote best practices across data engineering
Contribute to continuous improvement of our data infrastructure and workflows
Requirements
5+ years
of professional experience as a Data Engineer
Strong expertise in
PySpark ,
Python , and
SQL
Experience with
AWS
data ecosystem
Practical background in
automated testing and QA
for data pipelines
Strong debugging and performance optimization skills
Experience working with
Databricks (DBX)
Excellent communication skills in English and ability to collaborate across teams
Nice to Have
Experience working with
big data
and
data lake
architectures
Familiarity with
CI/CD
and DevOps practices
Experience with
MLflow
or LLM-driven pipelines
Knowledge of data governance and monitoring frameworks
#J-18808-Ljbffr
Sprachkenntnisse
- English
Hinweis für Nutzer
Dieses Stellenangebot wurde von einem unserer Partner veröffentlicht. Sie können das Originalangebot einsehen hier.