This job offer is no longer available
About
We are seeking a skilled Data Engineer with a background in AWS and GCP to join our team for a 9-month contract. The ideal candidate will have experience in the banking sector and possess a strong technical background in data engineering, cloud storage, and data processing technologies. Must have previous client experience working for this customer in the past 5 years. Required Skills & Qualifications
Strong programming experience in Python Proven experience designing and implementing data lake architectures (e.g., Bronze/Silver/Gold or layered models) Strong knowledge of Cloud Storage (GCS) design, including bucket layout, naming conventions, lifecycle policies, and access controls Hands-on experience with columnar data formats (Parquet, Avro, ORC) and compression techniques Expertise in partitioning strategies, backfills, and large-scale data organization Ability to design curated data models optimized for analytics and BI consumption Hands-on experience with AWS Expertise in Kubernetes and Kubeflow (or similar orchestration/workflow tools) Experience with Spark, Pandas, NumPy for data processing Familiarity with CI/CD tools (Jenkins or similar) Experience in debugging, performance tuning, and vulnerability remediation Must have previous client experience working for this customer in the past 5 years Preferred Skills & Qualifications
Previous experience in the banking industry Experience with additional cloud platforms Advanced data analytics and machine learning experience Day-to-Day Responsibilities
Design and implement scalable data lake solutions on GCP and AWS Optimize and maintain data storage solutions for performance and cost Collaborate with data analysts and BI teams to deliver curated data models Company Benefits & Culture
Collaborative and innovative work environment Opportunities for professional development and growth Comprehensive health and wellness benefits
Languages
- English
Notice for Users
This job was posted by one of our partners. You can view the original job source here.