Principal Data Engineer (Azure, Databricks, Big Data) | TELECOMMUTESamprasoft • United States
Principal Data Engineer (Azure, Databricks, Big Data) | TELECOMMUTE
Samprasoft
- United States
- United States
À propos
100% telecommute. Potential for very limited travel. Work hours: 8-4 PST Interview Process: 2 rounds. 1st being of a technical nature and the second will be geared towards work practice and general work experience and scenario based questions. Project: The project is the Heartbeat Pharmacy analytics cloud application, we are working on expanding out the application to be fully production ready and to bring in more data, real-time analytics and alerting. Team: The team consists of 2 developers, and a sql engineer, currently. Responsibilities: Create and maintain data jobs in Azure cloud environment, CI/CD pipelines for azure development and deployment, Databricks delta tables, live tables, and general databricks infrastructure. Build data pipelines for production pharmacy data to cloud according to business need. Develop CI/CD pipelines and maintain for application development and production readiness. Build medallion layered datasets in databricks and maintain for use in operation applications. Ideal Background: Cloud engineering with Azure experience, experience with datafactory, databricks, and overall cloud infrastructure and security. Required: At least 5 years of data engineering in Azure cloud. Experience building and maintaining pipelines in datafactory. Experience building CI/CD strategy utilizing Jenkins, GIT, Terraform. 5 years of experience working with big data warehouse solutions in the cloud. Hadoop/Hive, Synapse, Databricks. 3 Years experience specifically with Databricks.
Compétences linguistiques
- English
Avis aux utilisateurs
Cette offre provient d’une plateforme partenaire de TieTalent. Cliquez sur « Postuler maintenant » pour soumettre votre candidature directement sur leur site.