Cette offre d'emploi n'est plus disponible
GCP Data Engineer
CrackaJack Digital Solutions LLC
- United States
- United States
À propos
Houston, TX Long Term Contract Key Responsibilities:
Design, develop, and manage robust, scalable, and efficient data pipelines on GCP. Build and maintain data workflows using Apache Airflow for orchestration. Work with Google BigQuery for large-scale analytics and data storage. Leverage Google Cloud Dataflow (Apache Beam) for real-time and batch data processing. Ingest, transform, and analyze massive datasets (millions+ of records). Collaborate with data scientists, analysts, and other engineering teams to deliver reliable data solutions. Optimize data performance and troubleshoot data pipeline issues in production. Ensure data quality, integrity, and security across all data platforms. Required Skills & Qualifications:
4+ years of hands-on experience with Google Cloud Platform (GCP) services. Strong experience with BigQuery, Dataflow, and Airflow. Proficiency in Python or Java for data processing and pipeline development. Deep understanding of big data processing principles and distributed systems. Hands-on experience working with millions of rows/records in large-scale environments. Experience with data lake and data warehouse architectures. Strong problem-solving skills and ability to debug complex systems. Automating specific system operations to enhance efficiency and speed Testing designs to find and fix mistakes and make system improvements Evaluating and identifying the best cloud solutions in collaboration with engineering and development teams Developing, establishing and implementing modular cloud-based applications Locating, evaluating and fixing infrastructure risks and deployment problems Periodically evaluating computer systems and offering suggestions for performance enhancements Offering support and guidance to meet customer requirements
Compétences linguistiques
- English
Avis aux utilisateurs
Cette offre a été publiée par l’un de nos partenaires. Vous pouvez consulter l’offre originale ici.