Data engineer
Mankind America
- Bloomington, Illinois, United States
- Bloomington, Illinois, United States
About
POSITION: Data Engineer • Full-time job, 40 hours per week • Pay/Salary: $152,734.00 year.
NUMBER OF OPENINGS: 2 • LOCATION: MANKIND AMERICA LLC, 808 S Eldorado Rd, Suite 105 F, Bloomington, IL 61704
JOB DUTIES
Develop, maintain, and optimize scalable data pipelines on the Google Cloud Platform (GCP) using tools such as Pub/Sub, DataFlow, and DataProc.
Build real-time and batch processing pipelines for streaming data ingestion and processing.
Implement end-to-end data solutions to support business needs and analytics requirements.
Write efficient Python and PySpark scripts for data processing and transformation.
Implement ETL (Extract, Transform, Load) processes to ensure the smooth flow of data between systems and storage solutions.
Work with Kafka for real-time streaming data ingestion and processing.
Design and implement data warehouse solutions on GCP, ensuring that they scale and support business needs.
Build and maintain data lakes and distributed data platforms to handle large volumes of structured and unstructured data.
Define database schema, table relationships, and indexing to ensure data integrity and efficient query performance.
Work under supervision.
Travel and/or Relocation to various unanticipated client sites throughout USA is required.
EDUCATION Master’s degree in Computer Science /IT/IS/ Engineering (Any) or closely related field with Six (6) months of experience in the job offered or as an IT Consultant or Analyst or Programmer or Developer or Engineer or closely related field.
EXPERIENCE Experience of Six(6) Months working with ETL, Python and SQL is required. Travel and/or Relocation to Unanticipated Client Sites Throughout USA is required.
#J-18808-Ljbffr
Languages
- English
Notice for Users
This job comes from a TieTalent partner platform. Click "Apply Now" to submit your application directly on their site.