AWS Data Engineer
Tata Consultancy Services
- Charlotte, North Carolina, United States
- Charlotte, North Carolina, United States
Über
Essential Technical Skills
Lambda
S3
EventBridge
Kinesis (Data Streams & Firehose)
Glue (ETL & Crawlers)
Step Functions
Amazon Connect
Athena
Macie
Proficient In
Python
PySpark
Glue Crawlers for schema discovery and cataloging
Parquet‑based data storage
Building scalable data pipelines
Event‑driven architectures (Pub/Sub model)
Terraform (Infrastructure as Code)
CI/CD tools and automation pipelines
Messaging platforms like Kafka and Amazon EventBridge
Designing real‑time data processing systems
Using Glue Crawlers & Athena for data lake architectures
Roles & Responsibilities
Develop a comprehensive plan for migrating near real‑time fraud detection campaigns from on‑premises systems to AWS.
Design and implement event‑driven architectures to process inbound dialer data (fraud events) using services such as Amazon EventBridge, Kafka, Kinesis Data Streams, and Kinesis Firehose.
Build and manage scalable data pipelines using AWS Glue (ETL jobs, Crawlers), PySpark, and Python for data ingestion, transformation, and processing.
Configure and manage Glue Crawlers to automatically discover schemas and update the Data Catalog.
Store and optimize data using Parquet format and enable analytics through Amazon Athena for efficient querying.
Develop integrations between Customer Profiles and messaging platforms to automatically trigger profile updates and downstream processes.
Implement automation to trigger fraud‑related outbound calls based on updates in customer profiles.
Design and orchestrate workflows using AWS Step Functions to manage complex processing pipelines.
Provision and manage cloud infrastructure using Terraform (Infrastructure as Code).
Optimize system architecture for scalability, reliability, cost‑efficiency, and ensure data integrity and security.
Conduct end‑to‑end testing of the entire framework to validate functionality, performance, and reliability.
Deploy, automate, and manage resources using CI/CD pipelines.
Continuously monitor system performance and implement optimizations post‑deployment.
Maintain detailed documentation of architecture, workflows, and operational processes.
Qualifications BACHELOR OF COMPUTER SCIENCE
Salary Range $120,000 to $135,000 per year
#J-18808-Ljbffr
Sprachkenntnisse
- English
Hinweis für Nutzer
Dieses Stellenangebot stammt von einer Partnerplattform von TieTalent. Klick auf „Jetzt Bewerben”, um deine Bewerbung direkt auf deren Website einzureichen.