Back to Jobs
XX
Data Engineer (Google Cloud) BigQuery, Kafka, Python, ETL/ELT WarszawaDiverse CG Sp. z o.o. Sp.k.Poland, Ohio, United States
XX

Data Engineer (Google Cloud) BigQuery, Kafka, Python, ETL/ELT Warszawa

Diverse CG Sp. z o.o. Sp.k.
  • US
    Poland, Ohio, United States
  • US
    Poland, Ohio, United States

About

As a recruitment company, DCG understands that every business is powered by experienced professionals. Our management style and partnership approach enable us to meet your needs and provide continuous support. Due to our ongoing growth and the large number of recruitment projects we undertake for our partners, we are currently looking for:
Responsibilities
Building Data Lake and DWH class solutions as well as data feeding processes both online and offline
Designing and implementing IT solutions in the area of data feeding
Analyzing data and preparing logical and physical models
Tuning SQL queries on relational and warehouse databases in on-prem and GCP environments
Creating offline and online flows in on-prem and GCP tools
Creating data loading solutions in Python and Rust languages for structured and unstructured data
Preparing thematic datamarts on relational and columnar databases
Developing concepts and implementing solutions based on business requirements and needs
Resolving incidents and participating in problem solving
Supporting tests and deployments of changes in the scope of data feeding processes
Supporting the maintenance of deployed software
Working in accordance with the DevSecOps model
Requirements
Knowledge of aspects related to building ETL/ELT feeding pipelines
Experience in building and designing Data Lake and DWH solutions
Knowledge of technologies used within event-driven architecture such as Kafka, Pub/Sub
Knowledge of aspects related to building BigData solutions utilizing GenAI capabilities
Knowledge of Google BigQuery
Knowledge of Kubernetes (preferably Google Kubernetes Engine and OpenShift)
Knowledge of Oracle and PostgreSQL relational databases (design, construction and tuning of databases)
Fluent knowledge of Python and/or Rust
Good knowledge of Apache AirFlow
Nice to have
Knowledge in the area of: data mesh concepts, vector and graph databases
Knowledge of Apache Spark - preferably GCP Data Proc; Apache Beam - preferably GCP DataFlow; AutomateNow; Informatica Power Center
Offer
Private medical care
Co‑financing for the sports card
Training & learning opportunities
Constant support of dedicated consultant
Personal Consulting Agency (License No. 4642)
#J-18808-Ljbffr
  • Poland, Ohio, United States

Languages

  • English
Notice for Users

This job comes from a TieTalent partner platform. Click "Apply Now" to submit your application directly on their site.