GCP Data Engineer
Rivago Infotech Inc
- New York, New York, United States
- New York, New York, United States
Über
You will collaborate closely with cross‑functional teams including Enterprise Architecture, Platform Engineering, Data Activation, and Solution Architects to enable robust data ingestion (batch and streaming) and transformation pipelines across multiple data sources.
Key Responsibilities
Design, develop, and maintain scalable data pipelines on GCP for batch and real‑time processing.
Implement data ingestion frameworks (push/pull) using services like Dataflow, DataStream, Pub/Sub, and Cloud Run.
Build and optimize data transformation pipelines using BigQuery, Dataform, and Spark‑based frameworks.
Act as the technical lead/owner ensuring alignment with EA‑approved data architecture.
Drive best practices in data engineering , including CI/CD, testing, monitoring, and cost optimization.
Collaborate with cross‑functional teams to deliver end‑to‑end data solutions .
Ensure data quality, reliability, governance, and performance across pipelines.
Technical Qualifications Experience
6+ years of experience in data engineering, with strong focus on Google Cloud Platform (GCP).
GCP Professional Data Engineer certification - must have
Core GCP Expertise Strong hands‑on experience with:
Medallion architecture (Centralized Hub/Spoke model)
BigQuery (data warehousing & optimization)
Dataform (SQL‑based transformations)
Dataflow (batch & streaming pipelines)
Cloud Composer (Airflow) (orchestration)
Pub/Sub
Programming & Querying Advanced proficiency in:
Python
SQL (complex transformations, performance tuning)
Deep understanding of
Data modeling techniques
Medallion architecture (Bronze/Silver/Gold layers)
Preferred Skills
Experience with real‑time streaming architectures
Familiarity with CI/CD pipelines (Terraform, Cloud Build, GitOps)
Strong understanding of data governance, security, and compliance
Experience working in large enterprise or utility/regulated environments
Soft Skills
Strong ownership and accountability
Ability to work across distributed teams and vendors
Excellent communication with technical and non‑technical stakeholders
#J-18808-Ljbffr
Sprachkenntnisse
- English
Hinweis für Nutzer
Dieses Stellenangebot stammt von einer Partnerplattform von TieTalent. Klick auf „Jetzt Bewerben”, um deine Bewerbung direkt auf deren Website einzureichen.