This job offer is no longer available
Engineer- System Management
Tata Consultancy Services
- Allen, Texas, United States
- Allen, Texas, United States
About
Must Have Technical/Functional Skills
Big Data Admin for AWS EMR (Elastic MapReduce) Big Data and Hadoop ecosystem.
Experience with Terraform, CloudFormation, and other DevOps tools.
Strong Linux administration and scripting (Bash, Python).
Familiarity with AWS services like S3, EC2, IAM, CloudWatch.
Roles & Responsibilities AWS EMR (Elastic MapReduce) Big Data Administrator is responsible for designing, deploying, configuring, and maintaining big data environments on AWS using EMR, Hadoop, Spark, Hive, and related technologies.
Key Responsibilities
EMR Cluster Administration:
Provision, configure, and manage Amazon EMR clusters.
Optimize sizing, auto-scaling, and performance.
Manage Hadoop components including HDFS, YARN, Hive, and Spark.
Big Data Platform Operations:
Install, configure, and upgrade big data tools.
Monitor cluster health and troubleshoot failures.
Manage data ingestion pipelines including Kafka, Kinesis, and AWS Glue.
Security, Compliance & IAM:
Implement EMR security with IAM, Kerberos, KMS, and VPC configurations.
Ensure compliance with organizational standards.
Automation & DevOps:
Automate EMR provisioning using CloudFormation, CDK, or Terraform.
Build CI/CD pipelines using AWS tools or Jenkins.
Implement cost optimization strategies.
Monitoring & Troubleshooting:
Use CloudWatch, CloudTrail, and EMR Console for diagnostics.
Tune Spark and Hive jobs for performance.
Collaboration & Support:
Work closely with data engineers and cloud teams.
On-call assistance.
Education Bachelor’s Degree
Salary Range: $100,000 - $120,000 a year
#J-18808-Ljbffr
Languages
- English
Notice for Users
This job was posted by one of our partners. You can view the original job source here.