This job offer is no longer available
About
Hadoop // Big Data Engineer Location
Charlotte, NC // New York City, NY (onsite) Duration
Full Time Responsibilities Define end?to?end architecture for data platforms, streaming systems, and web applications. Ensure alignment with enterprise standards, security, and compliance requirements. Evaluate emerging technologies and recommend adoption strategies. Design and implement data ingestion, transformation, and processing pipelines using Hadoop, PySpark, and related tools. Optimize ETL workflows for large?scale datasets and real?time streaming. Integrate Apache Kafka for event?driven architectures and messaging. Build and maintain backend services using Python and microservices architecture. Develop responsive, dynamic front?end applications using Angular. Implement RESTful APIs and ensure seamless integration between components. Work closely with product owners, business analysts, and DevOps teams. Mentor junior developers and data engineers. Participate in agile ceremonies, code reviews, and design discussions.
Required Skills & Qualifications
Strong experience with Hadoop ecosystem (HDFS, Hive, Spark). Proficiency in PySpark for distributed data processing. Advanced programming skills in Python. Hands?on experience with Apache Kafka for real?time streaming. Expertise in designing scalable, secure, and high?performance systems. Familiarity with microservices, API design, and cloud?native architectures. Knowledge of CI/CD pipelines, containerization (Docker/Kubernetes). Exposure to cloud platforms (AWS, Azure, GCP).
Additional Skills
Knowledge of CI/CD pipelines, containerization (Docker/Kubernetes). Exposure to cloud platforms (AWS, Azure, GCP).
Seniority Level
Mid?Senior level Employment Type
Full?time Job Function
Information Technology Industry
IT Services and IT Consulting #J-18808-Ljbffr
Languages
- English
Notice for Users
This job was posted by one of our partners. You can view the original job source here.