Data Engineer II5014 Disney Entertainment & Sports LLC • New York, New York, United States
Data Engineer II
5014 Disney Entertainment & Sports LLC
- New York, New York, United States
- New York, New York, United States
Über
We are seeking a passionate Data Engineer to join the Product Performance Team within the Data Organization at Disney ESPN & Entertainment Technology. Your role will own the development of reliable data solutions that measure the product performance of Disney+. You will design, build, and test core algorithms and data models that generate precise and dependable browse, playback attribution, and search data, which serve as the governed source‑of‑truth for measuring Disney+ product engagement and driving critical business decisions. Responsibilities
Design, develop, and optimize large-scale batch and real‑time data pipelines using Spark Structured Streaming on Databricks. Collaborate with Data Analysts to develop reports and dashboards on Snowflake. Write production‑grade, maintainable code primarily in Scala and SQL. Implement complex data transformations using Spark SQL and core Spark APIs. Own the end‑to‑end lifecycle of data products from ingestion, transformation, orchestration, to consumption by analytics, ML, and reporting teams. Design and maintain workflow orchestration using Apache Airflow or Databricks. Build and manage infrastructure on AWS with expertise in cloud‑native data architectures. Implement data quality, monitoring, alerting, and lineage solutions. Perform performance tuning of Spark jobs, cluster optimization on Databricks, and cost optimization on AWS. Required Education, Experience & Skills
3+ years of hands‑on data engineering experience. Proficient in Spark Structured Streaming and the Databricks platform (Unity Catalog, Delta Lake, Workflows, Cluster management). Strong programming skills in Scala and Python; advanced SQL skills for writing complex, optimised queries. Hands‑on experience building and scheduling workflows in Apache Airflow. Working knowledge of AWS services for data engineering. Solid understanding of data modelling concepts. Experience with CI/CD for data pipelines (Git, Jenkins, GitHub Actions, etc.). Familiarity with Snowflake is a strong plus. Experience with streaming technologies beyond Spark (Kinesis, Flink) is a plus. Excellent problem‑solving, communication, and leadership skills. Bachelor’s degree in Computer Science or an equivalent field. Hiring Range: United States – New York, NY – $112,000 to $150,100 per year. Base pay will be adjusted for internal equity, geographic location, experience, and skills. Bonus and/or long‑term incentive units may be provided as part of the compensation package, along with a full range of medical, financial, and other benefits. Employment Type: Full Time. City: New York, NY, USA. Posted: 2026‑06‑22.
#J-18808-Ljbffr
Sprachkenntnisse
- English
Hinweis für Nutzer
Dieses Stellenangebot stammt von einer Partnerplattform von TieTalent. Klick auf „Jetzt Bewerben”, um deine Bewerbung direkt auf deren Website einzureichen.