Senior PySpark Data EngineerTata Consultancy Services • Irving, Texas, United States
Dieses Stellenangebot ist nicht mehr verfügbar
Senior PySpark Data Engineer
Tata Consultancy Services
- Irving, Texas, United States
- Irving, Texas, United States
Über
Roles & Responsibilities
Design, develop, and maintain robust, scalable high-performance data pipelines using PySpark.
Create data pipelines, ensuring data quality, and implement ETL processes to migrate and deploy data across systems.
Migrate Ab Initio ETL applications into PySpark-based pipelines.
Migrate on-prem workloads into cloud (AWS, Databricks, Snowflake) based on use cases.
Collaborate with cross-functional teams to identify and resolve data-related issues.
Stay updated with the latest advancements in data engineering and integrate innovative approaches.
Qualifications
8+ years of professional experience in Hadoop, PySpark/Python development.
Proven expertise in PySpark and experience handling large volumes of data.
3+ years of experience in AWS, Databricks, Snowflake, Airflow.
Familiarity with CI/CD pipelines and version control systems (e.g., Git).
Strong debugging and problem-solving skills.
Excellent communication and collaboration skills.
Bachelor’s degree in Computer Science (or related field).
Good to Have Skills
AWS EKS experience, Docker, and containers.
Salary Range: $120,000 to $140,000 per year
#J-18808-Ljbffr
Sprachkenntnisse
- English
Hinweis für Nutzer
Dieses Stellenangebot wurde von einem unserer Partner veröffentlicht. Sie können das Originalangebot einsehen hier.