XX
Data EngineerProphecy TechnologiesUnited States
XX

Data Engineer

Prophecy Technologies
  • US
    United States
  • US
    United States

Über

Job Summary
We are seeking a
Senior Data Engineer
with strong core engineering experience in building and supporting scalable, production-grade data platforms on
Azure . The role requires deep hands-on expertise in
Apache Spark (Databricks) ,
Python (PySpark) , and modern data integration technologies. The candidate will work on enterprise-scale data pipelines, streaming solutions, and cloud-native architectures with a focus on performance, reliability, and automation.
Location
Mount Laurel, NJ
Experience
8-10 Years
Key Responsibilities Design, develop, and maintain scalable data pipelines using
Apache Spark (Databricks)
and
PySpark Build and support production-grade data ingestion and processing solutions using
Kafka (Confluent) Integrate and manage data across
Snowflake, SQL Server, Azure SQL, and Azure Synapse Design and implement solutions using
Azure Cosmos DB
(mandatory hands-on) Develop and orchestrate data workflows using
Azure Data Factory (ADF) Leverage Azure-native services such as
Azure Databricks, Azure Blob Storage, and Azure DevOps Implement and maintain
CI/CD pipelines
for data workflows and containerized deployments where applicable Ensure performance tuning, monitoring, and reliability of data platforms in production Collaborate with cross-functional engineering and analytics teams to deliver high-quality data solutions Required Skills & Experience
8+ years of core
Data Engineering
experience Strong hands-on experience with
Apache Spark (Databricks) Strong hands-on experience with
Python and PySpark Production experience with
Kafka (Confluent) Hands-on experience with
Snowflake Experience with
SQL Server, Azure SQL, and Azure Synapse Mandatory experience with Azure Cosmos DB Practical knowledge of the
Azure ecosystem , including: Azure Databricks Azure Data Factory Azure DevOps Azure Blob Storage Experience with
CI/CD automation
for data pipelines and containerized image deployments Competencies
Digital: Python Digital: Apache Spark Digital: PySpark Digital: Kafka Digital: Snowflake Digital: Azure Data Factory Preferred Skills
Experience with containerization (Docker) and orchestration concepts Exposure to streaming and real-time data architectures Experience working in Agile delivery environments Strong analytical, problem-solving, and communication skills
  • United States

Sprachkenntnisse

  • English
Hinweis für Nutzer

Dieses Stellenangebot stammt von einer Partnerplattform von TieTalent. Klick auf „Jetzt Bewerben”, um deine Bewerbung direkt auf deren Website einzureichen.