Big Data Engineer

Virtual Vocations Inc

United States

United States

About

To drive the development and optimization of scalable data platforms in the AWS Cloud, the remote Big Data Engineer will design and maintain large-scale data pipelines and API-driven microservices while ensuring high performance and reliability in a long-term contract role. Key responsibilities
Design, build, and maintain large-scale batch and real-time data pipelines using Spark, Hadoop, and AWS EMR Develop, deploy, and optimize API-based microservices leveraging Java, Scala, and AWS API Gateway Implement data ingestion, transformation, and automation workflows with PySpark, Snowflake, and Airflow
Required qualifications
7+ years of experience designing, developing, and testing Big Data solutions (batch and APIs) Deep hands-on AWS experience, including EMR, EC2, ECS, S3, Step Functions, and API Gateway Proficiency in Scala, PySpark, and Java (REST APIs, SOAP web services) Strong knowledge of Hadoop, HDFS, Spark, MapReduce, and Cassandra Solid Linux administration skills with shell scripting and Python automation

United States

Languages

English

Notice for Users

This job was posted by one of our partners. You can view the original job source here.

Find similar jobs