Google Cloud Platform Data EngineerAstro Studios, Inc. • Bristol, England, United Kingdom
Cette offre d'emploi n'est plus disponible
Google Cloud Platform Data Engineer
Astro Studios, Inc.
- Bristol, England, United Kingdom
- Bristol, England, United Kingdom
À propos
To be successful in this role, you will need to have: Experience delivering and deploying production-ready data processing solutions using BigQuery, Pub/Sub, Dataflow and Dataproc Experience developing end-to-end solutions using batch and streaming frameworks such as Apache Spark and Apache Beam. Expert understanding of when to use a range of data storage technologies including relational/non-relational, document, row-based/columnar data stores, data warehousing and data lakes. Expert understanding of data pipeline patterns and approaches such as event-driven architectures, ETL/ELT, stream processing and data visualisation. Experience working with business owners to translate business requirements into technical specifications and solution designs that satisfies the data requirements of the business. Experience working with metadata management products such as Cloud Data Catalog and Collibra and Data Governance tools like Dataplex Experience in developing solutions on GCP using cloud-native principles and patterns. Experience building data quality alerting and data quarantine solutions to ensure downstream datasets can be trusted. Experience implementing CI/CD pipelines using techniques including as git code control/branching, automated tests and automated deployments. Comfortable working in an Agile team using Scrum or Kanban methodologies. In addition to the above, we would be thrilled if you also had: Experience of working on migrations of enterprise scale data platforms including Hadoop and traditional data warehouses An understanding of machine learning model development lifecycle, feature engineering, training and testing Good understanding or hands-on experience of Kafka Experience as a DBA or developer on RDBMS such as PostgreSQL, MySQL, Oracle or SQL Server Experience designing data applications to meet non-functional requirements such as performance and availability You are pragmatic and already understand that writing code is only part of what a data engineer does. You can clearly communicate with both clients and peers, describing technical issues and solutions in both written and meeting/workshop contexts. You are able to clearly explain technical concepts to non technical audiences at all levels of an organisation. You are able to influence and persuade senior and specialist client stakeholders, potentially across multiple organisational boundaries without direct authority. You are a confident problem solver and troubleshooter. You are confident and generous in sharing your specialist knowledge, ideas and solutions. You are constantly learning and able to make others better by consciously teaching and unconsciously inspiring. Additional information
Benefits package at PA: Private medical insurance Interest free season ticket loan 25 days annual leave with the opportunity to buy 5 additional days Company pension scheme Annual performance-based bonus Life and Income protection insurance Tax efficient benefits (cycle to work, give as you earn, childcare benefits) Voluntary benefits (Dental, critical illness, spouse/partner life assurance) PA is committed to building an inclusive and supportive culture where diversity thrives, and all of our people can excel. We believe that greater diversity stimulates innovation, enabling us to fulfil our purpose of ‘Bringing Ingenuity to Life’, supporting the growth of our people, and delivering more enduring results for our clients.
#J-18808-Ljbffr
Compétences linguistiques
- English
Avis aux utilisateurs
Cette offre a été publiée par l’un de nos partenaires. Vous pouvez consulter l’offre originale ici.