XX
Senior Machine Learning Infrastructure Engineer - Inference PlatformGeneral MotorsUnited States

Dieses Stellenangebot ist nicht mehr verfügbar

XX

Senior Machine Learning Infrastructure Engineer - Inference Platform

General Motors
  • US
    United States
  • US
    United States

Über

Job Description About the Team The ML Inference Platform is a key component of the AV ML Infrastructure organization. Our dedicated team develops a cloud-agnostic, reliable, and cost-efficient platform that drives GM's AI initiatives. We proudly support teams working on autonomous vehicles (L3/L4/L5) and different groups creating AI-driven products for GM and its customers. Our focus is on optimizing high-priority, ML-centric use cases to enable rapid feature development. We support the serving of cutting‑edge (SOTA) machine learning models for real‑time, online, and bulk inference, ensuring top‑notch performance, availability, concurrency, and scalability. Our commitment is to maximize GPU utilization across diverse platforms, including B200, H100, A100, and more, while prioritizing both reliability and cost‑efficiency.
About the Role We are in search of a Senior ML Infrastructure Engineer to help us build and scale robust platforms for ML Inference workflows. In this impactful role, you will collaborate closely with ML engineers and researchers to facilitate efficient model serving and inference in production across multiple workflows such as data mining, labeling, model distillation, evaluations, and simulations. This position presents a significant opportunity to shape the future of AI infrastructure at GM, playing a pivotal part in defining the architecture, roadmap, and user experience of our robust ML inference service that caters to real‑time, batch, and experimental inference needs. The ideal candidate will have experience in designing distributed systems for ML, possess strong problem‑solving skills, and have a user‑centered product mindset focused on platform usability and reliability.
What You'll Be Doing
Designing and implementing core backend software components of the platform.
Collaborating with ML engineers and researchers to identify critical workflows, translate them into platform requirements, and deliver incremental value.
Leading technical decision‑making regarding model serving strategies, orchestration, caching, model versioning, and auto‑scaling mechanisms for optimized accelerator usage.
Driving the development of monitoring, observability, and metrics to ensure the reliability, performance, and resource optimization of inference services.
Researching and integrating the latest model serving frameworks, hardware accelerators, and distributed computing techniques proactively.
Leading technical initiatives across GM's ML ecosystem.
Raising the engineering standards through technical leadership by establishing best practices.
Contributing to open‑source projects and representing GM in relevant communities.
Minimum Requirements
5+ years of experience in the industry, focusing on machine learning systems or high‑performance backend services.
Expertise in programming languages such as Python, C++, or other relevant languages.
Proven experience in ML inference and model serving frameworks (e.g., Triton, RayServe, vLLM).
Excellent communication skills and a proven track record of driving cross‑functional initiatives.
Ability to excel in a dynamic, multi‑tasking environment with shifting priorities.
Preferred Qualifications
Deep expertise in building zero-to-one ML infrastructure platforms.
Experience in designing interfaces, APIs, and clients for ML workflows.
Familiarity with Ray framework and/or vLLM.
Experience with distributed systems and large‑scale data processing.
Knowledge of telemetry and feedback loops to inform product enhancements.
Understanding of hardware acceleration (GPUs) and optimizations for inference workloads.
Compensation
Salary Range: $155,420 to $395,900.
Bonus Potential: Incentive pay programs based on company and individual performance.
Benefits: GM provides a variety of health and well‑being programs, including medical, dental, vision, Health Savings Account, Flexible Spending Accounts, retirement savings plan, sickness and accident benefits, life insurance, paid vacation & holidays, tuition assistance programs, employee assistance programs, GM vehicle discounts, and more.
Relocation This role may offer relocation assistance.
This position is primarily remote, but associates living within a 50‑mile radius of Mountain View are expected to report to the office a minimum of three times a week.
About GM Our vision encompasses a world of Zero Crashes, Zero Emissions, and Zero Congestion. We embrace the responsibility to lead the change necessary for a better, safer, and more equitable world.
Why Join Us We believe in making daily choices to drive meaningful change through our actions and our culture. Every employee should feel a sense of belonging within one General Motors team.
Non-Discrimination and Equal Employment Opportunities (U.S.) General Motors is committed to a workplace free from unlawful discrimination, fostering a genuine sense of inclusion. We firmly believe that an inclusive workplace nurtures an environment for all employees to thrive and innovate.
#J-18808-Ljbffr
  • United States

Sprachkenntnisse

  • English
Hinweis für Nutzer

Dieses Stellenangebot wurde von einem unserer Partner veröffentlicht. Sie können das Originalangebot einsehen hier.