Cette offre d'emploi n'est plus disponible
Senior Data Engineer - GCP
Purple Drive
- +1
- +3
- United States
- +1
- +3
- United States
À propos
The ability to co-ordinate with multiple offsite client teams to gather requirements in initial phase and also provide hands-on technical support during offshore hours is required.
• Liaison with client teams from multiple geographies to clarify requirements and get stakeholder buy-in.
• Setup appropriate Data Model for requirements and design data pipelines for implementation.
• Provide necessary documentation to support development teams.
• Design and implement data pipelines in GCP for ingesting and transforming data from SAP and AS400 systems to BigQuery using GCP native resources and DBT.
• Optimize ETLELT workflows for performance and scalability.
• Implement data quality checks, schema validation, and error handling.
• Support batch and near-real-time data flows for operational and analytics use cases.
• Strong experience with GCP (BigQuery, Dataflow, Cloud Composer, Cloud Run (native) and Cloud Storage (GCS).
• Proficiency in SQL and data analysis.
• Experience with PubSub.
• Familiarity with data governance and security best practices.
• Ability to work with large datasets and optimize for performance.
• Familiarity with CICD (Github and Terraform preferred). Knowledge of JSON, XML.
• Data Modelling concepts and Data Pipeline design
Compétences idéales
- Data Analysis
- Google Cloud Platform
- SQL
Expérience professionnelle
- Data Engineer
Compétences linguistiques
- English
Avis aux utilisateurs
Cette offre a été publiée par l’un de nos partenaires. Vous pouvez consulter l’offre originale ici.