Distinguished Engineer

We are currently seeking a senior-level Engineer with distinguished expertise to join the Dynamo engineering team. As a Distinguished Engineer, you will be a key technical leader, helping drive technology and product direction, provide deep technical expertise and guidance to the team and NVIDIA at large, and have a material impact on the next generation of inference on NVIDIA hardware.

At NVIDIA, we believe that inference will be driving increasing amount of compute, and as the hardware becomes more capable, it is crucial to make it easy for users to get the best performance as easily as possible. NVIDIA Dynamo helps users achieve state-of-the-art performance, using advanced techniques such as disaggregated serving, KV-aware routing, and others. As inference extends across modalities such as image, video and audio, the need for Dynamo only increases.

What you will be doing:

• Contribute to the Dynamo family of open source projects.

• Serve as a technical expert in AI inferencing, helping to push the frontier of what's possible.

• Represent Dynamo and NVIDIA with customers, partners and the AI community.

• Lead critical initiatives around resiliency, performance and scalability for Dynamo and AI inference.

• Build and drive Dynamo to continue being a production-ready, data center-scale AI inferencing platform.

• Collaborate with diverse partner teams at NVIDIA across storage, networking, hardware and performance.

• Keep abreast of the latest advancements in AI/ML infrastructure technologies, frameworks, and effective strategies, and promote their implementation within the company.

What we need to see:

• BS, MS, PhD, or equivalent experience in Computer Science, Computer Engineering, Artificial Intelligence or a related field.

• 18+ years of Proven experience in systems software engineering

• Expertise in the AI inference space, such as operating production inference systems at scale, working on inference engines, or similar.

• Experience serving as a senior technical leader in an organization, with the ability to lead through influence.

• Proficiency in programming languages such as Rust, Python, and Go, as well as familiarity with cloud computing platforms (e.g., AWS, GCP, Azure).

• Excellent problem-solving skills, showing proficiency in analyzing complex systems, identifying bottlenecks, and implementing scalable solutions.

• Excellent communication and collaboration skills, demonstrating effectiveness in working with diverse teams and individuals.

Ways to stand out from the crowd:

• Experience in production-grade infrastructure, knowing how to take into