Cette offre d'emploi n'est plus disponible
Senior Lead Data Engineer - Brillio LLC
Gravity Engineering Services Pvt Ltd.
- Saint Louis, California, United States
- Saint Louis, California, United States
À propos
Design, build, and maintain large‑scale data pipelines using Python, Apache Spark, and SQL across AWS services (S3, Redshift, Glue).
Lead a cross‑functional team of data engineers, providing mentorship, code reviews, and best‑practice guidance.
Implement and manage Airflow DAGs for orchestrating batch and streaming workflows, ensuring reliability and observability.
Collaborate with data scientists and business stakeholders to translate analytical requirements into robust data solutions.
Optimize performance, cost, and scalability of data infrastructure, applying advanced techniques such as partitioning, caching, and query tuning.
Requirements
10+ years of data engineering experience with a proven track record in large‑scale, cloud‑native environments.
Expertise in Python, Apache Spark, SQL, and AWS data services (Glue, Redshift, Athena).
Strong experience with Airflow or similar workflow orchestration tools.
Excellent leadership, communication, and problem‑solving skills.
Hands‑on experience with data modeling, ETL design, and performance tuning.
#J-18808-Ljbffr
Compétences linguistiques
- English
Avis aux utilisateurs
Cette offre a été publiée par l’un de nos partenaires. Vous pouvez consulter l’offre originale ici.