Offres d'emploi
Trouvez des postes près de chez vous, sur site, hybrides ou à distance.- Emplois similaires à : Spark with Scala (Data Engineer)
Spark with Scala (Data Engineer)
Ca OneIrving
Role Spark with Scala (Data Engineer)Location Irving, TX onsiteMust have skillsScalaApache SparkSQLPythonDesirable skillsAWSUNIX shell scriptingResponsibilitiesAt least 5+ years of experience and stro
Senior Data Engineer — Spark, Python & Scala
LTMIrvingLTM in Irving, Texas is seeking a Senior Data Engineer with 3 to 5 years of experience to design and optimize big scalable data processing solutions. The ideal candidate will have expertise in Python,
Senior Data Engineer - Spark/Flink/Scala
Omega Solutions IncUnited StatesScala EngineerWe are looking for Scala Engineers with experience with batch and/or streaming jobs. We utilize Spark for batch jobs and Flink for real-time streaming jobs. Experience with Hadoop, Hive,
Senior Spark & Scala Data Engineer - Onsite Irving, TX
Ca OneIrvingCa One is seeking a Data Engineer skilled in Spark and Scala to join their team in Irving, TX. The ideal candidate will have at least 5 years of experience and a strong command of Scala, Apache Spark,
Software Engineer - Analytics Engine (Scala, Spark)
Roberts RecruitingUnited StatesSoftware EngineerWe're seeking a software engineer to design and develop our Predictive Analytics Engine. Successful candidates will live and breathe server-side development and be very interested in
AI Big Data Engineer: Scalable Spark & Hadoop Pipelines
ManpowerGroup Global, Inc.RockvilleManpowerGroup Global, Inc. is seeking a highly skilled AI Big Data Engineer to design and develop data processing systems. The successful candidate will work in Rockville, MD or Tysons Corner, VA, foc
AI Big Data Engineer: Scalable Spark & Hadoop Pipelines
ManpowerGroup Global, Inc.WaterfordManpowerGroup Global, Inc. is seeking a highly skilled AI Big Data Engineer to design and develop data processing systems. The successful candidate will work in Rockville, MD or Tysons Corner, VA, foc
Senior Data Engineer: Spark & Fabric, Cloud-Scale Data
Praxair Deutschland GmbHNorth TonawandaPraxair Deutschland GmbH is seeking a Senior Data Engineer to enhance its Americas IT software and architecture team. This role involves designing robust data pipelines and optimizing cloud-scale data
Data Engineer - TB-Scale Real-Time Spark Pipelines
MagniteNew YorkMagnite is seeking a Data Engineer to join their Innovative Services Group in New York. In this role, you will build and optimize data pipelines using technologies such as Apache Spark and Python, pro
Senior Data Engineer: Spark, Databricks & Lakehouse Architect
CitiIrvingCiti is looking for an Applications Development Senior Programmer Analyst based in Irving, Texas. This role involves developing and maintaining ETL/ELT pipelines using PySpark and Spark SQL, contribut
PySpark Data Engineer – Spark, Hadoop & AI Analytics
InfosysIrvingInfosys is looking for a candidate to join their Data and Analytics (DNA) unit, transforming data into actionable insights. You will contribute to software solutions, facilitate discussions, and enhan
Senior Data Engineer: AWS Data Pipelines & Spark
Grape UpPolandGrape Up is seeking an experienced Data Engineer to implement scalable architectures and manage high volumes of simulation data. The ideal candidate will have a Master’s degree in a related field and
Hybrid Cloud Data Engineer Databricks & Spark
byebyeofficeFranklin Parkbyebyeoffice is seeking a skilled Data Engineer to join their Franklin Park, IL team, focusing on building and modernizing cloud-based data platforms using Databricks and Apache Spark. The ideal candi
Hybrid Senior Data Engineer - Databricks & Spark
84.51Deerfield84.51 is looking for a Senior Data Engineer to build solutions that manage big data for data scientists and products. The role demands a hybrid work model, requiring presence in the office three days
Senior AWS Data Engineer: Spark, EMR & Big Data
Career Steer ServicesNew YorkCareer Steer Services is looking for an experienced Aws Data Engineer to join our team. This full-time role requires 5+ years of software development experience and expertise in AWS EMR and big data t
Remote Data Engineer: AWS/Databricks, Spark & Python
AGM SolutionsLittle ItalyAGM Solutions cerca un Data Engineer per un progetto full remote. Il candidato ideale avrà una laurea in discipline tecnico-scientifiche e almeno 2 anni di esperienza nel ruolo, con competenze in AWS
Data Engineer - Real-Time Pipelines, AWS & Spark
Gravity Engineering Services Pvt Ltd.WilmingtonGravity Engineering Services Pvt Ltd. is looking for a Data Engineer in Wilmington, Massachusetts. You will design and maintain data pipelines, implement data models and leverage AWS services for proc
Hybrid Data Engineer: Spark, Kafka & AWS Pipelines
Purchasing PowerHanna CityPurchasing Power is seeking a Data Engineer to develop our enterprise data platform in a hybrid work model based in Atlanta. This role involves building and maintaining data pipelines, ensuring data q
Senior Hadoop Data Engineer | Spark & ETL Expert
QodeGranite HeightsQode is seeking a Hadoop Data Engineer to design, develop, and maintain large-scale data processing systems in a distributed environment. The role focuses on enabling data-driven decision-making in ba
Delta Lake Data Engineer - Fabric & Spark Specialist
Cronos EuropaCedar GroveCronos Europa, located in the Town of Belgium, Wisconsin, is seeking a skilled Data Engineer to focus on executing and delivering data solutions effectively. In this role, you will build and optimize
Senior Data Engineer - Enterprise Data Frameworks (Java Spark Focus)
Citizens BankUnited StatesJob DescriptionSenior Java Data Engineer Enterprise Data FrameworksRole SummaryThe Enterprise Data Frameworks team is seeking a Senior Java focused software engineer who builds and maintains large sca
Senior Hadoop Data Engineer | Spark & ETL Expert
QodeWausauQode is seeking a Hadoop Data Engineer to design, develop, and maintain large-scale data processing systems in a distributed environment. The role focuses on enabling data-driven decision-making in ba
Data Engineer II: Spark, Databricks, Real-Time Pipelines
Disney Cruise Line - The Walt Disney CompanyNew YorkDisney Cruise Line - The Walt Disney Company is seeking a Data Engineer to join the Product Performance Team within their Data Organization. The role involves designing and testing core algorithms tha
Senior Data Engineer — Remote in Ukraine (Azure, Spark)
EPAM Systems, Inc.New YorkEPAM Systems, Inc. is seeking a highly skilled Senior Data Engineer to design, develop, and maintain robust data solutions for business needs. The ideal candidate should have over 5 years of expertise
Senior Java Big Data Engineer AWS, Spark & Kafka
6AM CityBrooklyn6AM City, LLC is seeking a Java Big Data Engineer for a hybrid role in Columbus, OH. The position requires strong experience in Java, Scala, and Python, along with expertise in AWS and streaming data
Spark with Scala (Data Engineer)
- Irving, Texas, United States
- Irving, Texas, United States
À propos
Location Irving, TX onsite
Must have skills
Scala
Apache Spark
SQL
Python
Desirable skills
AWS
UNIX shell scripting
Responsibilities
At least 5+ years of experience and strong knowledge in Scala programming language.
Able to write clean, maintainable and efficient Scala code following best practices.
Good knowledge on the fundamental Data Structures and their usage.
At least 5+ years of experience in designing and developing large scale, distributed data processing pipelines using Apache Spark and related technologies.
Having expertise in Spark Core, Spark SQL and Spark Streaming.
Experience with Python, Hadoop, HDFS, Hive and other BigData technologies. Familiarity with Data warehousing and ETL concepts and techniques.
Working knowledge in AWS (Glue EMR) etc. is good to have.
Having expertise in Database concepts and SQL/NoSQL operations.
UNIX shell scripting will be an added advantage in scheduling/running application jobs.
At least 5 years of experience in Project development life cycle activities and maintenance/support projects.
Work in an Agile environment and participation in scrum daily standups, sprint planning reviews and retrospectives.
Understand project requirements and translate them into technical solutions which meet the project quality standards.
Ability to work in a team in diverse/multiple stakeholder environment and collaborate with upstream/downstream functional teams to identify, troubleshoot and resolve data issues.
Strong problem solving and good analytical skills.
Excellent verbal and written communication skills.
Experience and desire to work in a Global delivery environment.
Stay up to date with new technologies and industry trends in Development.
#J-18808-Ljbffr
Compétences linguistiques
- English
Cette offre provient d’une plateforme partenaire de TieTalent. Cliquez sur « Postuler maintenant » pour soumettre votre candidature directement sur leur site.