Engineer- System ManagementTata Consultancy Services • Allen, Texas, United States
Engineer- System Management
Tata Consultancy Services
- Allen, Texas, United States
- Allen, Texas, United States
À propos
Must Have Technical/Functional Skills
Big Data Admin for AWS EMR (Elastic MapReduce) Big Data and Hadoop ecosystem.
Experience with Terraform, CloudFormation, and other DevOps tools.
Strong Linux administration and scripting (Bash, Python).
Familiarity with AWS services like S3, EC2, IAM, CloudWatch.
Roles & Responsibilities AWS EMR (Elastic MapReduce) Big Data Administrator is responsible for designing, deploying, configuring, and maintaining big data environments on AWS using EMR, Hadoop, Spark, Hive, and related technologies.
Key Responsibilities
EMR Cluster Administration:
Provision, configure, and manage Amazon EMR clusters.
Optimize sizing, auto-scaling, and performance.
Manage Hadoop components including HDFS, YARN, Hive, and Spark.
Big Data Platform Operations:
Install, configure, and upgrade big data tools.
Monitor cluster health and troubleshoot failures.
Manage data ingestion pipelines including Kafka, Kinesis, and AWS Glue.
Security, Compliance & IAM:
Implement EMR security with IAM, Kerberos, KMS, and VPC configurations.
Ensure compliance with organizational standards.
Automation & DevOps:
Automate EMR provisioning using CloudFormation, CDK, or Terraform.
Build CI/CD pipelines using AWS tools or Jenkins.
Implement cost optimization strategies.
Monitoring & Troubleshooting:
Use CloudWatch, CloudTrail, and EMR Console for diagnostics.
Tune Spark and Hive jobs for performance.
Collaboration & Support:
Work closely with data engineers and cloud teams.
On-call assistance.
Education Bachelor’s Degree
Salary Range: $100,000 - $120,000 a year
#J-18808-Ljbffr
Compétences linguistiques
- English
Avis aux utilisateurs
Cette offre provient d’une plateforme partenaire de TieTalent. Cliquez sur « Postuler maintenant » pour soumettre votre candidature directement sur leur site.