Dieses Stellenangebot ist nicht mehr verfügbar
Data Engineer
Quadrant IQ Solutions LLC
- New York, New York, United States
- New York, New York, United States
Über
Job Type: W2
Visa's Accepted: H4-EAD, GC-EAD, L2S, GC, USC, H1B
Must-Have Skills
Python & PySpark
– Expert-level proficiency with
very strong Apache Spark
experience (large-scale data processing, optimization, performance tuning).
AWS Cloud
ECS (Elastic Container Service)
–
Required
AWS Glue
and/or
AWS Lake Formation
– Strongly preferred
Data Warehousing
Snowflake
or
Teradata
(hands-on experience with large analytical datasets)
Core Responsibilities
Design, build, and optimize
high-performance Spark-based data pipelines
using Python/PySpark.
Develop and maintain
ETL/ELT workflows
for large-scale structured and semi-structured data.
Deploy and manage data workloads on
AWS ECS .
Implement data ingestion, transformation, and governance using
AWS Glue / Lake Formation .
Integrate data pipelines with
Snowflake or Teradata
for analytics and reporting.
Ensure scalability, reliability, and performance of distributed data processing systems.
Collaborate with analytics, platform, and cloud engineering teams.
Seniority level
Mid-Senior level
Employment type
Full-time
Job function
Data Engineering
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
Sprachkenntnisse
- English
Hinweis für Nutzer
Dieses Stellenangebot wurde von einem unserer Partner veröffentlicht. Sie können das Originalangebot einsehen hier.