Machine Learning Validation & Data Operations ManagerUniversity of Chicago • United States
This job offer is no longer available
Machine Learning Validation & Data Operations Manager
University of Chicago
- United States
- United States
About
The TMW Center for Early Learning + Public Health (TMW Center) develops, tests, and implements evidence-based interventions designed to promote very young children's cognitive and social-emotional development, with emerging technologies that enhancerather than replacethe pivotal role that caregivers play in building healthy young brains. The TMW Center is looking for an ML Validation & Data Operations Manager to lead and monitor operations for continuous algorithm improvement and validation. This will involve guiding the development of data management systems and establishing data assessment strategies to enable efficient and scalable validation processes. The ML Validation & Data Operations Manager will also contribute to defining the vision for current and longer-term algorithm developments. They will collaborate closely with our data science, research, and data management teams to coordinate workstreams, ensure a smooth integration of the developed systems and protocols within broader operations, and align with research developments. This position will report to the CTO, with guidance from the Scientific Director. Responsibilities: Lead data labeling effort to build ground-truth corpus for existing and future algorithms, including identifying data requirements and protocols. Determine validation criteria and metrics across models and settings/partnerships/use cases. Collaborate with data management teams, and application development teams to identify and capture the data necessary to perform validation. Recruit, train, and lead a team of data labelers. Ensure alignment between the validation roadmap and Center's priorities. Establish timelines and strategies for the validation of different algorithms. Work with ML and engineering teams to develop and manage pipelines for continuous algorithm validation and optimization. Promote advances in, and creative ML solutions for validation and data management enhancement (e.g., automation of protocols and training pipelines). Build quality assurance processes to continuously assess reliability of data. Maintain comprehensive records of data sources, methodologies, and results. Establish best practice-based processes related to reproducibility, documentation, and version control. Investigate, analyze and resolve day-to-day technical problems using standard procedures. Works with stakeholders to gather and analyze requirements for developmental programs. Receives a moderate level of guidance to design applications to meet University and business requirements. Performs code testing on components and works to ensure that appropriate implementation standards are met. Evaluates design alternatives for development cost and solutions using various methods. Supports and maintains existing applications. Works with web developers and responds to requests from users. Performs other related work as needed. Minimum Qualifications: Education: Minimum requirements include a college or university degree in related field. Work Experience: Minimum requirements include knowledge and skills developed through 2-5 years of work experience in a related job discipline. Preferred Qualifications: Advanced Degree in economics, data science, data analytics, computer science, software engineering or related fields strongly preferred. Knowledge and skills developed through 5 years of work experience in a related job discipline, strongly preferred. 2 years of experience managing people, strongly preferred. Preferred Competencies: Prior experience setting up data labeling and validation processes. Demonstrated understanding of data science management, Machine Learning and Data operations. Experience building out ML operations teams and processes. Experience with statistical modeling and programming. Demonstrated ability to work independently with little supervision. Excellent strategic planning and execution skills. Strong problem-solving skills. Ability to balance short-term, long-term, and big picture objectives. Working Conditions: Office Environment. Application Documents: Resume (required) Cover Letter (preferred) When applying, the documents MUST be uploaded via the My Experience page, in the section titled Application Documents of the application.
Languages
- English
Notice for Users
This job was posted by one of our partners. You can view the original job source here.