GCP Data Engineer

IntraEdge

Austin, Texas, United States

Austin, Texas, United States

Jetzt Bewerben

Über

Overview GCP Data Engineer to serve fraud data mart customers. The Data Engineer will closely work with cross‑functional teams to ensure data integrity, reliability, and scalability. Key Responsibilities Design, build, and maintain scalable data pipelines using GCP tools such as BigQuery, Cloud Storage, Dataflow, Cloud Composer, and Pub/Sub. Write high‑performance, production‑grade Python and SQL, optimizing queries to support ETL processes. Implement complex data models in BigQuery, utilizing partitioning, clustering, and materialized views for optimal performance. Collaborate with cross‑functional teams, including business customers and SMEs, to understand data requirements and deliver effective solutions. Implement best practices for data quality, data governance, and data security. Monitor and troubleshoot data pipeline issues, ensuring high availability and performance. Contribute to data architecture decisions and provide recommendations for improving the data pipeline. Stay up‑to‑date with emerging trends and technologies in cloud‑based data engineering and cyber security. Communicate effectively: gather relevant data, actively listen, dialogue freely, and verbalize ideas. Work in an agile environment to deliver incremental value, manage and prioritize tasks. Proactively investigate and resolve data issues, owning them to resolve in a timely manner. Interop and document processes and procedures for producing metrics. Qualifications & Experience 8+ years of hands‑on experience with data management, gathering data from multiple sources, and consolidating into a centralized location. Strong expertise in Google BigQuery, Google Cloud Storage, Dataflow, Pub/Sub, Cloud Composer, and related GCP services. Proficiency in Python and SQL for data processing and automation. Experience with ETL processes and data pipeline design. Experience designing, building, and maintaining scalable data pipelines on GCP. Understanding of data modeling, partitioning, clustering, and materialized views in BigQuery. Comfortable with continuous integration/continuous delivery of data pipelines. Exceptional communication skills, including the ability to gather relevant data, actively listen, and verbalize ideas effectively. Ability to work in an Agile work environment to manage and prioritize tasks.
#J-18808-Ljbffr

Austin, Texas, United States

Sprachkenntnisse

English

Hinweis für Nutzer

Dieses Stellenangebot stammt von einer Partnerplattform von TieTalent. Klick auf „Jetzt Bewerben”, um deine Bewerbung direkt auf deren Website einzureichen.

Jetzt Bewerben