Data Engineer
Mankind America LLC
- Bloomington, Illinois, United States
- Bloomington, Illinois, United States
À propos
Develop, maintain, and optimize scalable data pipelines on the Google Cloud Platform (GCP) using tools such as Pub/Sub, DataFlow, and DataProc.
Build real-time and batch processing pipelines for streaming data ingestion and processing.
Implement end-to-end data solutions to support business needs and analytics requirements.
Write efficient Python and PySpark scripts for data processing and transformation.
Implement ETL (Extract, Transform, Load) processes to ensure the smooth flow of data between systems and storage solutions.
Work with Kafka for real-time streaming data ingestion and processing.
Design and implement data warehouse solutions on GCP, ensuring that they scale and support business needs.
Build and maintain data lakes and distributed data platforms to handle large volumes of structured and unstructured data.
Define database schema, table relationships, and indexing to ensure data integrity and efficient query performance.
Work under supervision. Travel and/or relocation to various unanticipated client sites throughout the USA is required.
Qualifications
Education: Master’s degree in Computer Science / IT / IS / Engineering (any) or closely related field with six (6) months of experience in the job offered or as an IT Consultant/Analyst/Programmer/Developer/Engineer or closely related field.
Experience: Six (6) months of experience with ETL, Python and SQL is required. Travel and/or relocation to unanticipated client sites throughout USA is required.
#J-18808-Ljbffr
Compétences linguistiques
- English
Avis aux utilisateurs
Cette offre provient d’une plateforme partenaire de TieTalent. Cliquez sur « Postuler maintenant » pour soumettre votre candidature directement sur leur site.