This job offer is no longer available
About
Client:TCS
ob Title: Senior Data Engineer
Experience
8-12 years of experience in Data Engineering, Cloud Data Platforms, and large-scale data processing.
Key Skills & Technologies
Programming:
Python (strong), Java (basic knowledge) Cloud:
AWS (Glue, S3, Lambda, Athena, Redshift) ETL / Data Processing:
AWS Glue, PySpark, batch & streaming pipelines Databases:
SQL, NoSQL, data warehouses Data Formats:
Parquet, Avro, JSON, CSV Version Control & CI/CD:
Git, basic DevOps pipelines Monitoring & Security:
Logging, IAM, data security best practices Roles & Responsibilities
Data Engineering & Pipeline Development
Design, build, and maintain scalable
data pipelines
using
Python and AWS Glue . Develop
ETL/ELT workflows
to ingest, transform, and load data from multiple sources into cloud data platforms. Optimize Glue jobs for performance, cost, and scalability. Cloud Data Platform Management
Work extensively on
AWS cloud services
including S3, Glue, Lambda, Athena, and Redshift. Ensure high availability, reliability, and fault tolerance of data solutions. Implement data partitioning, compression, and lifecycle management strategies. Data Modeling & Warehousing
Design and implement
data models
for analytics and reporting. Support dimensional and normalized data models for downstream BI and analytics tools. Ensure data quality, consistency, and governance across platforms.
Bhargav Akkula
Senior Account Manager
Purple Drive Technologies LLC
Certified Minority Business Enterprise (MBE)
Cell +1 732-200-2392
Mailto:Bhargav.ak@purpledrive.com
Website: http://purpledrive.com
Languages
- English
Notice for Users
This job was posted by one of our partners. You can view the original job source here.