Hadoop Administration

Role: Hadoop Administrator
Location: Charlotte, North Carolina (Strictly Local Candidates Only)
Type: Contract | W2 Only

Overview
We are seeking a highly skilled Hadoop Administrator to join our data management team. This role involves managing and optimizing large-scale data environments, ensuring the seamless operation of Hadoop ecosystems, and supporting our big data initiatives. The ideal candidate will have extensive experience with cloud platforms, data warehousing, and a strong foundation in various data technologies to facilitate efficient data processing and analysis.

Responsibilities

Install, configure, and administer Hadoop ecosystem components including HDFS, YARN, Hive, Spark, HBase, Oozie, Sqoop, Kafka, Ranger, and Knox.

Manage Hadoop cluster capacity planning, performance monitoring, troubleshooting, and upgrades.

Perform user provisioning, Kerberos authentication setup, and cluster security hardening using Ranger/Knox.

Handle Hadoop cluster health, NameNode operations, failover management, and high availability setups.

Develop automation scripts (Shell/Python) for monitoring, deployment, and maintenance tasks.

Manage Azure cloud resources: Azure Data Lake, Azure Blob Storage, HDInsight, Azure Data Factory, Azure Kubernetes Service, and Azure VM clusters.

Configure and monitor Azure networking, access control, service principals, role-based access, and Azure Key Vault.

Implement backup/restore strategies, disaster recovery, cluster patching, and version upgrades.

Perform log analysis, job debugging, resource allocation tuning for Hadoop/Spark jobs.

Collaborate with Data Engineers, Cloud Engineers, and DevOps teams to support CI/CD pipelines and data workflows.

Ensure compliance with security, governance, and operational procedures across Hadoop and Azure environments.

Required Skills

Strong hands-on experience with Hadoop administration (HDFS, YARN, Hive, Spark, Ambari/Cloudera Manager).

Experience managing Azure cloud resources: ADLS, ADF, HDInsight, Azure VMs, Azure Backup, IAM/RBAC.

Strong understanding of Linux/Unix administration, networking, and distributed computing.

Knowledge of security frameworks: Kerberos, SSL/TLS, Ranger, Knox, Azure AD.

Scripting experience: Shell, Python, PowerShell.

Experience with monitoring tools (Grafana, Prometheus, Ambari Metrics, Azure Monitor).

Good troubleshooting skills for cluster performance, job failures, and resource issues.

Job Types: Full-time, Contract

Pay: $ $68.00 per hour

Work Location: In person