Data Engineer
Mankind America LLC
- Bloomington, Illinois, United States
- Bloomington, Illinois, United States
About
Develop, maintain, and optimize scalable data pipelines on the Google Cloud Platform (GCP) using tools such as Pub/Sub, DataFlow, and DataProc.
Build real-time and batch processing pipelines for streaming data ingestion and processing.
Implement end-to-end data solutions to support business needs and analytics requirements.
Write efficient Python and PySpark scripts for data processing and transformation.
Implement ETL (Extract, Transform, Load) processes to ensure the smooth flow of data between systems and storage solutions.
Work with Kafka for real-time streaming data ingestion and processing.
Design and implement data warehouse solutions on GCP, ensuring that they scale and support business needs.
Build and maintain data lakes and distributed data platforms to handle large volumes of structured and unstructured data.
Define database schema, table relationships, and indexing to ensure data integrity and efficient query performance.
Work under supervision. Travel and/or relocation to various unanticipated client sites throughout the USA is required.
Qualifications
Education: Master’s degree in Computer Science / IT / IS / Engineering (any) or closely related field with six (6) months of experience in the job offered or as an IT Consultant/Analyst/Programmer/Developer/Engineer or closely related field.
Experience: Six (6) months of experience with ETL, Python and SQL is required. Travel and/or relocation to unanticipated client sites throughout USA is required.
#J-18808-Ljbffr
Languages
- English
Notice for Users
This job comes from a TieTalent partner platform. Click "Apply Now" to submit your application directly on their site.