Jobbörse
Finde Jobs in deiner Nähe – ob vor Ort, hybrid oder remote.- Ähnliche Jobs zu: Spark with Scala (Data Engineer)
Spark with Scala (Data Engineer)
Ca OneIrving
Role Spark with Scala (Data Engineer)Location Irving, TX onsiteMust have skillsScalaApache SparkSQLPythonDesirable skillsAWSUNIX shell scriptingResponsibilitiesAt least 5+ years of experience and stro
Senior Data Engineer — Spark, Python & Scala
LTMIrvingLTM in Irving, Texas is seeking a Senior Data Engineer with 3 to 5 years of experience to design and optimize big scalable data processing solutions. The ideal candidate will have expertise in Python,
Senior Spark & Scala Data Engineer - Irving, TX
Ca OneIrvingCa One is looking for a Data Engineer experienced in Spark and Scala to develop and maintain large-scale data processing pipelines. The ideal candidate should have over 5 years of experience in Scala
Senior Data Engineer - Spark/Flink/Scala
Omega Solutions IncUnited StatesScala EngineerWe are looking for Scala Engineers with experience with batch and/or streaming jobs. We utilize Spark for batch jobs and Flink for real-time streaming jobs. Experience with Hadoop, Hive,
Senior Spark & Scala Data Engineer - Onsite Irving, TX
Ca OneIrvingCa One is seeking a Data Engineer skilled in Spark and Scala to join their team in Irving, TX. The ideal candidate will have at least 5 years of experience and a strong command of Scala, Apache Spark,
Software Engineer - Analytics Engine (Scala, Spark)
Roberts RecruitingUnited StatesSoftware EngineerWe're seeking a software engineer to design and develop our Predictive Analytics Engine. Successful candidates will live and breathe server-side development and be very interested in
Senior Data Engineer: Spark & Fabric, Cloud-Scale Data
Praxair Deutschland GmbHNorth TonawandaPraxair Deutschland GmbH is seeking a Senior Data Engineer to enhance its Americas IT software and architecture team. This role involves designing robust data pipelines and optimizing cloud-scale data
Data Engineer: Azure & Spark Pipelines, Data Quality
Tata Consultancy Services LimitedIrvingTata Consultancy Services Limited is seeking a qualified candidate in Irving, TX, to build and optimize relational databases and data pipelines using Azure and Spark. The role involves collaboration w
Data Engineer - TB-Scale Real-Time Spark Pipelines
MagniteNew YorkMagnite is seeking a Data Engineer to join their Innovative Services Group in New York. In this role, you will build and optimize data pipelines using technologies such as Apache Spark and Python, pro
Data Engineer: Spark, Databricks & Lakehouse
VeriiproNew YorkVeriipro is seeking a skilled data engineer in New York, NY, to design and optimize scalable ETL/ELT pipelines using Databricks and Apache Spark. You will collaborate with cross-functional teams to cr
Senior Data Engineer: Spark, Databricks & Lakehouse Architect
CitiIrvingCiti is looking for an Applications Development Senior Programmer Analyst based in Irving, Texas. This role involves developing and maintaining ETL/ELT pipelines using PySpark and Spark SQL, contribut
Senior Data Engineer - Spark, Databricks & Lakehouse
Samba TV, Inc.San FranciscoSamba TV, Inc. is looking for an experienced Data Engineer to build scalable data product architecture and optimize cloud-based data infrastructure. The ideal candidate has over 5 years of experience
Hybrid Cloud Data Engineer Databricks & Spark
byebyeofficeFranklin Parkbyebyeoffice is seeking a skilled Data Engineer to join their Franklin Park, IL team, focusing on building and modernizing cloud-based data platforms using Databricks and Apache Spark. The ideal candi
Senior Hadoop/MapR & Spark Data Engineer
Broughton GroupPhoenixBroughton Group is seeking a skilled individual to join their team in Phoenix, Arizona. The ideal candidate will have over 5 years of experience in software engineering, with strong expertise in big d
Data Engineer: AWS, Spark, Python & DevOps (Hybrid/Remote)
Acezd Consultancy Services Pvt LtdIrvingAcezd Consultancy Services Pvt Ltd is seeking a Data Engineer with expertise in AWS, Spark, and Python. You will play a crucial role in data manipulation and automation, utilizing advanced programming
Remote Data Engineer: AWS/Databricks, Spark & Python
AGM SolutionsLittle ItalyAGM Solutions cerca un Data Engineer per un progetto full remote. Il candidato ideale avrà una laurea in discipline tecnico-scientifiche e almeno 2 anni di esperienza nel ruolo, con competenze in AWS
Hybrid Data Engineer: Spark, Kafka & AWS Pipelines
Purchasing PowerHanna CityPurchasing Power is seeking a Data Engineer to develop our enterprise data platform in a hybrid work model based in Atlanta. This role involves building and maintaining data pipelines, ensuring data q
Lead Big Data Engineer (Hybrid Spark/AWS)
Financial Industry Regulatory Authority , Inc.BismarckThe Financial Industry Regulatory Authority, Inc. is seeking a Lead Software Engineer to drive the development of essential software products. This role entails managing complex projects, mentoring te
Real-Time Data Engineer - Spark, Kafka, AWS
AncestryLehiAncestry is looking for a talented individual to join their data platform team. The role involves scaling and validating the data platform to accommodate growth and developing a real-time automated sy
Senior Data Engineer - Enterprise Data Frameworks (Java Spark Focus)
Citizens Financial Group, Inc.United StatesSenior Java Data EngineerThe Enterprise Data Frameworks team is seeking a Senior Java focused software engineer who builds and maintains large scale data processing systems using Java, Apache Spark, a
Senior Hadoop Data Engineer | Spark, Kafka & Big Data Pipelines
Tech MirrorsScottsdaleTech Mirrors is looking for a Hadoop Data Engineer to design and maintain scalable data processing applications in Scottsdale, AZ. Ideal candidates will have 8-12 years of experience in Java and stron
Data Engineer II: Spark, Databricks, Real-Time Pipelines
Disney Cruise Line - The Walt Disney CompanyNew YorkDisney Cruise Line - The Walt Disney Company is seeking a Data Engineer to join the Product Performance Team within their Data Organization. The role involves designing and testing core algorithms tha
Data Engineer II: Real-Time Pipelines on Spark/Databricks
The Walt Disney CompanyNew YorkThe Walt Disney Company is seeking a passionate Data Engineer II in New York, NY to join the Product Performance Team within Disney ESPN & Entertainment Technology. You'll design, build, and test algo
Senior Java Big Data Engineer AWS, Spark & Kafka
6AM CityBrooklyn6AM City, LLC is seeking a Java Big Data Engineer for a hybrid role in Columbus, OH. The position requires strong experience in Java, Scala, and Python, along with expertise in AWS and streaming data
Lead Data Engineer: Drive Scalable Data Architecture
LAM Lennar Associates Mgmt LLCIrvingLAM Lennar Associates Mgmt LLC is looking for a Lead Data Engineer in Irving, Texas. This role involves overseeing the data engineering team and managing projects to ensure the scalability and quality
Spark with Scala (Data Engineer)
- Irving, Texas, United States
- Irving, Texas, United States
Über
Location Irving, TX onsite
Must have skills
Scala
Apache Spark
SQL
Python
Desirable skills
AWS
UNIX shell scripting
Responsibilities
At least 5+ years of experience and strong knowledge in Scala programming language.
Able to write clean, maintainable and efficient Scala code following best practices.
Good knowledge on the fundamental Data Structures and their usage.
At least 5+ years of experience in designing and developing large scale, distributed data processing pipelines using Apache Spark and related technologies.
Having expertise in Spark Core, Spark SQL and Spark Streaming.
Experience with Python, Hadoop, HDFS, Hive and other BigData technologies. Familiarity with Data warehousing and ETL concepts and techniques.
Working knowledge in AWS (Glue EMR) etc. is good to have.
Having expertise in Database concepts and SQL/NoSQL operations.
UNIX shell scripting will be an added advantage in scheduling/running application jobs.
At least 5 years of experience in Project development life cycle activities and maintenance/support projects.
Work in an Agile environment and participation in scrum daily standups, sprint planning reviews and retrospectives.
Understand project requirements and translate them into technical solutions which meet the project quality standards.
Ability to work in a team in diverse/multiple stakeholder environment and collaborate with upstream/downstream functional teams to identify, troubleshoot and resolve data issues.
Strong problem solving and good analytical skills.
Excellent verbal and written communication skills.
Experience and desire to work in a Global delivery environment.
Stay up to date with new technologies and industry trends in Development.
#J-18808-Ljbffr
Sprachkenntnisse
- English
Dieses Stellenangebot stammt von einer Partnerplattform von TieTalent. Klick auf „Jetzt Bewerben”, um deine Bewerbung direkt auf deren Website einzureichen.