Dieses Stellenangebot ist nicht mehr verfügbar
Über
The Senior Data Engineer will support the development and enhancement of foundational datasets derived from clickstream and quality-of-service telemetry data.
This role is part of the Product Performance Data Solutions team and focuses on building scalable, reliable data pipelines and shared libraries that empower engineering, analytics, and operational teams.
The ideal candidate will bring strong expertise in SQL, Scala, Python, and distributed data technologies, along with the ability to collaborate effectively across technical and business teams.
This position plays a key role in driving data-driven decision-making and ensuring high data quality, operational efficiency, and platform reliability.
Key Responsibilities
Maintain, update, and expand existing data pipelines using Python and Spark while adhering to strict uptime SLAs. Architect, design, and develop shared libraries in Scala and Python to standardize business logic across data pipelines. Work with a modern tech stack including Airflow, Spark, Databricks, Delta Lake, Snowflake, Scala, and Python. Collaborate closely with product managers, architects, and engineers to support data initiatives and stakeholder needs. Develop and document internal and external standards for pipeline configurations, naming conventions, and partitioning strategies. Ensure operational efficiency and dataset quality to meet reliability and accuracy requirements for engineering, analytics, and data science teams. Participate actively in Agile/Scrum ceremonies, contributing to team processes and continuous improvement efforts. Engage with internal customers to understand requirements, build relationships, and support both innovation and incremental enhancements. Maintain detailed documentation to ensure data governance and support ongoing data quality efforts. Required Qualifications
Expert-level SQL skills. Extensive experience working with Scala. Strong hands-on experience with Python, Spark, and Airflow. Experience with distributed data processing technologies such as Databricks, Delta Lake, and Snowflake. Proven ability to drive outcomes independently and proactively. Strong communication skills for conveying technical concepts to both technical and non-technical audiences. Preferred Qualifications
Experience working with clickstream or user browsing behavior datasets. Experience supporting large-scale streaming or digital product data systems. Primary Skills
Python Spark Airflow Scala
Sprachkenntnisse
- English
Hinweis für Nutzer
Dieses Stellenangebot wurde von einem unserer Partner veröffentlicht. Sie können das Originalangebot einsehen hier.