Offres d'emploi
Trouvez des postes près de chez vous, sur site, hybrides ou à distance.- Emplois similaires à : Senior Data Engineer: Spark & Fabric, Cloud-Scale Data
Senior Spark Data Engineer: Scale TB Data in the Cloud
Appit LLCSan FranciscoAPPIT Software Solutionsis hiring aSenior Data Engineer (Apache Spark)inSan Francisco, USA . Lead the design of large-scale distributed data processing systems using Apache Spark and cloud platforms a
Cloud Data Engineer Azure, Fabric, Data Lake (Hybrid)
Pabst Brewing CompanySan AntonioPabst Brewing Company in San Antonio is seeking a Data Engineer to join their Data Systems team. This role focuses on developing scalable data solutions that support business decisions and analytics.
Senior Backend Engineer, Cloud-Scale Data Platform
United States Digital Space LLCVirginiaUnited States Digital Space LLC, located in McLean, Virginia, is seeking a Software Engineer to join their Public Sector team. You will be responsible for backend engineering that supports one of the
Senior Cybersecurity Data Engineer - Lead Data Fabric
ShoptalkColumbusShoptalk is seeking a Senior Cybersecurity Data Engineer in Columbus, Ohio. You'll manage and optimize data pipelines and architectures, working with stakeholders to resolve data-related challenges. Y
Senior Data Engineer - Fabric & AI Platform
K&L Gates LLPBostonK&L Gates is seeking a Senior Data Engineer to join their team in Boston, MA. This role involves designing scalable data platforms using Microsoft Fabric, mentoring staff, and ensuring data governance
Data Engineer - TB-Scale Real-Time Spark Pipelines
MagniteNew YorkMagnite is seeking a Data Engineer to join their Innovative Services Group in New York. In this role, you will build and optimize data pipelines using technologies such as Apache Spark and Python, pro
Senior Data Engineer - Fabric & AI Platform
K&L Gates LLPCharlestonK&L Gates is seeking a Senior Data Engineer in Charleston, SC to design scalable Microsoft Fabric data platforms. You'll lead engineering standards, optimize data pipelines, and collaborate with techn
Senior Data Engineer - Microsoft Fabric & Lakehouse
2020 CompaniesSouthlake2020 Companies, Inc. is hiring a Sr. Data Engineer in Southlake, TX to build and optimize client-facing analytics platforms. The role requires expertise in Microsoft Fabric, Delta Lake, and SQL to ens
Senior Data Engineer - ML & Fabric Architect
JE Dunn ConstructionKansas CityJE Dunn Construction is seeking a Senior Data Engineer in Kansas City, MO. This role involves designing and implementing scalable data architectures using Microsoft Fabric and facilitating predictive
Senior AWS Cloud Architect - Serverless, Data & Scale
Koitecc SolutionsPlanoKoitecc Solutions is looking for a Software Engineer III to join their team in Plano, Texas. The role involves designing and deploying AWS-based technology solutions, contributing to an agile team ded
Senior Data Engineer Microsoft Fabric Focus (Remote)
Velvetech LLCFloridaVelvetech is an American global software development company headquartered in Miami, FL, and with an office in Chicago, IL. Velvetech has its developers strategically distributed in 10+ global technic
Senior Data Engineer / Analytic Engineer (Microsoft Fabric) | Velvetech
Velvetech LLCFloridaPosition overview As a Senior Data Engineer / Analytic Engineer (Microsoft Fabric), you will lead the design, implementation, and optimization of data engineering pipelines and ETL processes. You will
Senior Data Engineer / Analytic Engineer (Microsoft Fabric) | Velvetech
VelvetechFloridaPosition overview As a Senior Data Engineer / Analytic Engineer (Microsoft Fabric), you will lead the design, implementation, and optimization of data engineering pipelines and ETL processes. You will
Senior Data Engineer Azure Fabric & AI Pipelines Lead
K&L Gates LLPKansas CityK&L Gates is seeking a Senior Data Engineer in Kansas City. This role focuses on designing scalable Microsoft Fabric data platforms and establishing engineering standards while mentoring staff. Ideal
Cloud-Scale Big Data Engineer ETL & Analytics Pro
ByteCubedArlingtonByteCubed, located in Arlington, Virginia, is seeking a Big Data Engineer to develop reusable SaaS components for data ingestion into a cloud environment. You will collaborate with a dynamic team focu
Hybrid Cloud Data Engineer Databricks & Spark
byebyeofficeFranklin Parkbyebyeoffice is seeking a skilled Data Engineer to join their Franklin Park, IL team, focusing on building and modernizing cloud-based data platforms using Databricks and Apache Spark. The ideal candi
Senior Data Engineer – Microsoft Fabric & ML Pipelines (Hybrid)
ESR HealthcarePhoenixESR Healthcare is seeking a Senior Data Engineer in the Phoenix area to focus on building and optimizing scalable data pipelines within Microsoft Fabric. This mid-level to senior position involves col
Senior Big Data Engineer - Spark/Scala & Data Pipelines
I did my part and supported the Regular ToiletWalthamI did my part and supported the Regular Toilet is seeking a Senior Software Engineer in Waltham, Massachusetts. The role involves building and optimizing big data pipelines, designing data architectur
Lead Java Spark Data Engineer - Cloud & FinTech
Ports NorthColumbusPorts North is seeking a Lead Java/Spark Data Engineer in Columbus, OH. This role involves providing guidance to a team of software engineers, managing stakeholder relationships, and executing softwar
Senior Data Engineer Datastore & Scale Leader
eBay Inc.RaleigheBay Inc. is looking for a technical leader in Data Engineering to support its TCGplayer Technology organization. You will be responsible for defining datastore infrastructure, improving data flow des
Senior Data Engineer - Remote, Scale Data Pipelines
giftHEALTH IncColumbusGifthealth Inc is seeking a Sr. Data Engineer to lead the design of critical data pipelines and mentor engineering team members. This position requires 6+ years of data engineering experience, profici
Senior Data Engineer - Remote, Scale Data Pipelines
Gifthealth, IncColumbusGifthealth, Inc is looking for a Sr. Data Engineer to lead the design and architecture of critical data pipelines, ensuring scalability and reliability. This role requires 6+ years of experience with
Senior AI Data Engineer: Scale Data Marts & Analytics
CINew YorkA CI está em busca de um Senior AI Data Engineer para transformar dados brutos em produtos confiáveis, utilizando inteligência artificial. O papel inclui desenvolver transformações com DBT e garantir
Senior Data Engineer Scale Pipelines & BI
WellSkyOverland ParkWellsky is seeking a Staff Data Engineer to design, build, and maintain scalable data pipelines and visualizations in Overland Park, Kansas. The ideal candidate will lead data architecture and collabo
Senior Data Engineer - Scale Data Pipelines & AI Solutions
SynechronNew YorkSynechron is looking for a Senior Data Engineer for its New York office. This role involves designing, developing, and maintaining scalable data solutions in the financial sector, ensuring data qualit
Senior Spark Data Engineer: Scale TB Data in the Cloud
- San Francisco, California, United States
- San Francisco, California, United States
À propos
is hiring a
Senior Data Engineer (Apache Spark)
in
San Francisco, USA . Lead the design of large-scale distributed data processing systems using Apache Spark and cloud platforms at APPIT Software in San Francisco. Responsibilities
Architect and optimize large-scale Spark jobs processing terabytes of data daily Design data lake and lakehouse architectures on AWS S3 or Azure Data Lake Storage Mentor junior data engineers on distributed computing best practices and Spark internals Build and maintain real-time and batch data pipelines with robust fault-tolerance Partner with ML engineers to deliver feature stores and training data sets at scale Drive performance tuning including partitioning, caching, and shuffle optimization strategies Requirements
6+ years of data engineering experience with at least 3 years focused on Apache Spark Deep understanding of distributed computing, MapReduce paradigms, and cluster resource management Expert-level Python and/or Scala programming for Spark application development Experience with cloud data services (AWS EMR, Glue, Redshift, or Azure Synapse) Strong knowledge of data lake architectures, Delta Lake, or Apache Iceberg table formats Proven ability to optimize Spark jobs for cost efficiency and processing speed Nice to Have
Experience with Databricks Unified Analytics Platform Knowledge of streaming with Spark Structured Streaming or Flink Contributions to open-source data projects About APPIT Software Solutions
APPIT Software Solutions is a leading technology company building AI-powered enterprise products. Join 150+ professionals working on cutting-edge solutions in AI/ML, cloud computing, and digital transformation. We offer competitive salaries, flexible work arrangements, and opportunities for career growth across our global offices.
#J-18808-Ljbffr
Compétences linguistiques
- English
Cette offre provient d’une plateforme partenaire de TieTalent. Cliquez sur « Postuler maintenant » pour soumettre votre candidature directement sur leur site.