Senior Data Engineer (Azure/Databricks)Ascent Software • New York, New York, United States
Cette offre d'emploi n'est plus disponible
Senior Data Engineer (Azure/Databricks)
Ascent Software
- New York, New York, United States
- New York, New York, United States
À propos
Ascent is now part of Acuity Analytics, marking an exciting new chapter with strong global reach, an impressive client base, and ambitious growth plans. Together, we deliver cutting‑edge data and digital transformation solutions to high‑growth and regulated organisations—combining talent, technology, and deep domain expertise to drive real business impact.
About the Role We’re looking for a Senior Data Engineer to join a team supporting global claims reporting for a leading reinsurance organisation.
You’ll work across Azure and Databricks, building reliable data pipelines and scalable solutions that power reporting and analytics across the business.
What You’ll Be Doing
Build and manage Databricks Workflows to orchestrate large‑scale data pipelines
Design and deliver ETL/ELT pipelines using best practices
Work with Delta Lake and Lakehouse architecture to structure data
Create and manage data assets using Unity Catalog
Develop data transformations using Python (PySpark) and SQL
Build and deploy PyFunc models into production pipelines
Use Azure services like Key Vault, Logic Apps, Service Bus, and APIM to support secure and scalable solutions
Set up and improve CI/CD pipelines with Azure DevOps
Work with stakeholders to turn business needs into practical, scalable data solutions
What We’re Looking For
Strong experience with Azure Databricks (PySpark / Spark SQL)
Solid Python and SQL skills
Experience building data pipelines and data models
Good understanding of Delta Lake / Lakehouse architecture
Experience working with Azure DevOps and CI/CD
Comfortable working with large, complex datasets
Able to work with different teams and stakeholders
Nice to Have
Experience in insurance, reinsurance, or claims reporting
Knowledge of NoSQL (e.g. Cosmos DB)
Familiarity with event‑driven or microservices architecture
Experience with monitoring tools like Datadog or Application Insights
Exposure to Microsoft Cognitive Services
How We Work
Agile, collaborative environment
Focus on ownership and quality
Supportive team that shares knowledge and ideas
Work that has real impact across the business
Why Join Us People are at the heart of our business. By investing in people, we achieve exceptional results for our clients and create new opportunities for our teams to thrive.
#J-18808-Ljbffr
Compétences linguistiques
- English
Avis aux utilisateurs
Cette offre a été publiée par l’un de nos partenaires. Vous pouvez consulter l’offre originale ici.