Hadoop Data Engineer

Collabera

United States

United States

Ähnliche Jobs finden

Über

Job Title: Hadoop Data Engineer Location: Chicago, IL/Denver, CO/Washington DC (Local Only No relocation - In person Interview ) Work Arrangement: Fully Onsite Client Industry: Banking Duration: 12 Months Contract Day-to-Day: Design, develop, and maintain batch and near-real-time data pipelines using Spark Structured Streaming, MapReduce, and other Big Data frameworks. Ingest data from multiple sources such as message queues (Kafka), file shares, REST APIs, and relational databases. Transform, clean, and validate data in HDFS, Hive, Impala, or Spark SQL. Convert and manage data in formats like JSON, CSV, XML to support downstream analytics. Perform data validation, profiling, and analysis to identify anomalies and ensure data integrity. Troubleshoot issues in data pipelines, SQL jobs, or Spark applications, including slow-running jobs or failures. Must Haves: Strong SQL Skills – one or more of MySQL, HIVE, Impala, SPARK SQL Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xml Experience working with SPARK Structured steaming Experience working with Hadoop/Big Data and Distributed Systems Working experience with Spark, Sqoop, Kafka, MapReduce, NoSQL Database like HBase, SOLR, CDP or HDP, Cloudera or Hortonworks, Elastic Search, Kibana, etc. Hands on programming experience in at least one of Scala, Python, PHP, PLUSES Banking or finance Compensation Hourly Rate: 60$-65$ per hour This range reflects base compensation and may vary based on location, market conditions, experience, and candidate qualifications. Benefits: The Company offers the following benefits for this position, subject to applicable eligibility requirements: medical insurance, dental insurance, vision insurance, 401(k) retirement plan, life insurance, long-term disability insurance, short-term disability insurance, paid parking/public transportation, (paid time, paid sick and safe time, hours of paid vacation time, weeks of paid parental leave, paid holidays annually - AS Applicable) About Us At Collabera, we don’t just offer jobs—we build careers. As a global leader in talent solutions, we provide opportunities to work with top organizations, cutting-edge technologies, and dynamic teams. Our culture thrives on innovation, collaboration, and a commitment to excellence. With continuous learning, career growth, and a people-first approach, we empower you to achieve your full potential. Join us and be part of a company that values passion, integrity, and making an impact. Ready to Apply? Apply now or reach out to Pritam Palai at pritam.palai@collabera.com for more information. We look forward to speaking with you!

United States

Sprachkenntnisse

English

Hinweis für Nutzer

Dieses Stellenangebot wurde von einem unserer Partner veröffentlicht. Sie können das Originalangebot einsehen hier.

Ähnliche Jobs finden