Dieses Stellenangebot ist nicht mehr verfügbar
Über
Job Title : GCP Data Engineer
Location :
Lone Tree, Co (remote until Covid is resolved)
Duration : 12 Months Contract
Max Rate $60 on
C2C Any Visa
Job Description :
Must Have :
Build a and operationalize pipelines to include data acquisition, staging, integration of new data sources, cataloging, Layout and architect a strategic data vision for SAMS Cleansing, batch and stream processing, transformation, and consumption Work with our cloud engineering team to setup and provision a team-sandbox with approved managed GCP data services to build the data pipeline and provided sample data sets. Provide architecture to integrate metadata management, integrate with on-prem Data quality engine. Provide automated source / destination data comparison architecture Design and develop a data preparation and quality control mechanism Implement data classification of incoming data and access controls based on data domains Architect and implement data exploration platform for data architects and data scientists on staged data sets. Build and refine job automation and orchestration for pipeline to handle exception handling, rerun jobs, fault tolerance, retrospective, logging, alerts, notifications etc., Develop transformation process for handling batch and streaming data Build compatible target data state to include compatible schema design, catalog, data modeling acceptable for consumption via APIs, Client and analytics Provide data usage pattern for analytics, API and other consumption patterns from target data store. Build target state data publishing and visualization and integration Implement Identity and Access Management (IAM) roles across the data pipeline. Also define and execute different delegate roles as needed. Implement IAM and dataset-level-access-controls in target data store Build an CICD automation pipeline facilitating automated deployment and automated testing Deliver end to end comprehensive documentation along with code samples
Best Regards
Syed Imran
Sr Technical Recruiter
224-296-3522 | syed@navtechusa.com
NAVTECH INC
Disclaimer:
We respect your Online Privacy. This e-mail message, including any attachments, is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. If you are not interested in receiving our emails then please reply with a
"REMOVE"
in the subject line and mention all the email addresses to be removed with any email addresses, which might be diverting the emails to you. We are sorry for the inconvenience.
Sprachkenntnisse
- English
Hinweis für Nutzer
Dieses Stellenangebot wurde von einem unserer Partner veröffentlicht. Sie können das Originalangebot einsehen hier.