Sr. Data Engineer - US (Remote)Luxury Presence • New York, New York, United States
Sr. Data Engineer - US (Remote)
Luxury Presence
- New York, New York, United States
- New York, New York, United States
À propos
As a Sr. Data Engineer, you’ll be a technical leader at the center of this transformation. You’ll shape platform architecture, drive AI‑powered product delivery, and raise the bar for what a small, AI‑augmented engineering team can accomplish. What You’ll Do
Build and scale high‑throughput streaming pipelines ingesting 400M+ monthly MLS updates across 350+ integrations using Airflow, Spark Streaming, Kafka, and Iceberg – ensuring reliability, performance, and data correctness. Model and deliver high‑quality, production‑grade real estate datasets that power core product experiences, focusing on data modeling, transformation logic, and balancing freshness, accuracy, and cost. Strengthen data quality and observability by implementing/improving data quality checks, monitoring, and alerting to detect issues early and reduce downstream impact. Leverage AI to improve data operations, contributing to AI‑driven tooling that helps triage, debug, and resolve data quality issues, increasing team efficiency and reducing manual intervention. Attributes
You already build with AI daily. You use Claude Code as a core part of your workflow, not as a novelty. You have strong opinions, loosely held, about how AI changes software architecture, team structure, and engineering culture. You think in systems and connect technical decisions to customer outcomes and long‑term business value. You communicate clearly and directly, explaining complex tradeoffs to product, design, and executive stakeholders. You thrive in ambiguity and speed, working for a fast‑growing company where the roadmap evolves and ownership is real. You enjoy fun at work, celebrating wins and maintaining a healthy team culture. Skills and Experience
6+ years of professional data engineering or software engineering experience. Strong experience with distributed data processing and streaming systems (Spark / PySpark, Kafka). Proficiency in Python (Pydantic preferred) and familiarity with Node/TypeScript is a plus. Experience building and maintaining data pipelines on AWS using Airflow, Spark Streaming, and Iceberg. Solid understanding of data modeling and working with large‑scale datasets. Familiarity with event‑driven systems and ingestion patterns (Kafka, SQS). Experience implementing data quality checks, monitoring, and debugging data issues. Interest in applying AI/ML or automation to improve data workflows is a plus. Proven track record leading high‑impact initiatives from concept through production in a SaaS environment. Expert‑level grasp of software design principles and experience with multi‑tenant platform architectures. Tech Stack
Backend: Python, PySpark, Pydantic, Node/TypeScript Data: Iceberg, Postgres Infrastructure: AWS, Kubernetes, Airflow, Spark Streaming Messaging: Kafka, SQS $150,000 - $190,000 a year Luxury Presence is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, or national origin.
#J-18808-Ljbffr
Compétences linguistiques
- English
Avis aux utilisateurs
Cette offre provient d’une plateforme partenaire de TieTalent. Cliquez sur « Postuler maintenant » pour soumettre votre candidature directement sur leur site.