Data Engineer: Build Scalable AI-Driven Data PipelinesVericence • New York, New York, United States
Dieses Stellenangebot ist nicht mehr verfügbar
Data Engineer: Build Scalable AI-Driven Data Pipelines
Vericence
- New York, New York, United States
- New York, New York, United States
Über
Core Skills & Experience
Strong hand‑on experience with Python and PySpark, including deep understanding of Spark concepts, performance tuning, and scalable data processing
Experience with modern data platforms such as Snowflake, Databricks, or similar cloud‑based solutions
Solid understanding of data pipeline design, development, orchestration, and monitoring for batch and streaming workloads
Familiarity with Medallion Architecture (bronze, silver, gold layers) and best practices for data transformation
Strong knowledge of autoscaling, cluster optimization, and cost‑efficient data processing in distributed/cloud environments
Experience with CI/CD, DevOps practices, and version control; exposure to Terraform or Infrastructure‑as‑Code tools is preferred
Ability to collaborate effectively with business, analytics, and engineering teams to deliver scalable and reusable data solutions
#J-18808-Ljbffr
Sprachkenntnisse
- English
Hinweis für Nutzer
Dieses Stellenangebot wurde von einem unserer Partner veröffentlicht. Sie können das Originalangebot einsehen hier.