Data Engineer

Role: Data Engineer

Duration: 12 Months

Location: Sunnyvale CA

Job description:

Years of experience: 6 years of SW development on data modeling, scalable data pipeline to process image & video data, and full-stack development using Python, SQL. 5 years of development on data processing pipeline on cloud platform. Demonstrated software development skills using Python. 3 years of development on multimodal machine learning development for data curation and annotation, including deploying machine learning training and inference for large data processing on cloud platform, ML prompt engineering, ML feature learning, and/or video and 3d data understanding, etc.

Education: Bachelor's or Master's degree or above in a relevant field of Computer science and SW

Responsibility

• Data Pipeline Engineering: Building efficient and scalable data pipelines to process multimodal data on cloud platform and local clusters
• Data Modeling and Database Design: Identifying entities, data, and their relationships within the application, considering the constraints of the stack (e.g. SQL, vector, and unstructured data). This is needed to support applications, query, analytics, and reporting.
• ML model deployment and application development for data curation and annotation based on state of the art multimodal models.