Senior Software Architect - Deep Learning and HPC CommunicationsNVIDIA • United States

This job offer is no longer available

Senior Software Architect - Deep Learning and HPC Communications

NVIDIA

United States

United States

About

divh2Senior Software Architect/h2pNVIDIA is leading groundbreaking developments in Artificial Intelligence, High Performance Computing and Visualization. The GPU -- our invention -- serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables groundbreaking creativity and discovery, and powers inventions that were once considered science fiction, including artificial intelligence to autonomous cars./ppCome work for the team that brought to you NCCL, NVSHMEM GPUDirect. Our GPU communication libraries are crucial for scaling Deep Learning and HPC applications! Were seeking a Senior Software Architect to help co-design next-gen data center platforms and scalable communications software. DL and HPC applications have a huge compute demands and already run at scales of up to tens of thousands of GPUs. GPUs are connected with high-speed interconnects (e.g. NVLink, PCIe) within a node and with high-speed networking (e.g. InfiniBand, Ethernet) across nodes. Efficient and fast communication between GPUs directly impacts end-to-end application performance. This impact continues to grow with the increasing scale of next generation systems. This is an outstanding opportunity to advance the state-of-the-art, break performance barriers, and deliver platforms the world has never seen before. Are you ready to build the new and innovative technologies that will help realize NVIDIAs vision?/ph3What You Will Be Doing/h3ulliInvestigate opportunities to improve communication performance by identifying bottlenecks in todays systems./liliDesign and implement new communication technologies to accelerate AI and HPC workloads./liliExplore innovative solutions in HW and SW for our next generation platforms as part of co-design efforts involving GPU, Networking, and SW architects./liliBuild proofs-of-concept, conduct experiments, and perform quantitive modeling to evaluate and drive new innovations./liliUse simulation to explore performance of large GPU clusters (think scales of 100s of 1000s of GPUs)/li/ulh3What We Need To See/h3ulliM.S./Ph.D. degree in CS/CE or equivalent experience./lili5+ years of relevant experience./liliExcellent C/C++ programming and debugging skills./liliExperience with parallel programming models (MPI, SHMEM) and at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC)./liliDeep understanding of operating systems, computer and system architecture./liliSolid in fundamentals of network architecture, topology, algorithms, and communication scaling relevant to AI and HPC workloads./liliStrong experience with Linux./liliAbility and flexibility to work and communicate effectively in a multi-national, multi-time-zone corporate environment./li/ulh3Ways To Stand Out From The Crowd/h3ulliExpertise in related technology and passion for what you do. Experience with CUDA programming and NVIDIA GPUs. Knowledge of high-performance networks like InfiniBand, RoCE, NVLink, etc./liliExperience with Deep Learning Frameworks such PyTorch, TensorFlow, etc. Knowledge of deep learning parallelisms and mapping to the communication subsystem. Experience with HPC applications./liliStrong collaborative and interpersonal skills and a proven track record of effectively guiding and influencing within a dynamic and multi-functional environment./li/ulpNVIDIA is at the forefront of breakthroughs in Artificial Intelligence, High-Performance Computing, and Visualization. Our teams are composed of driven, innovative professionals dedicated to pushing the boundaries of technology. We offer highly competitive salaries, an extensive benefits package, and a work environment that promotes diversity, inclusion, and flexibility. As an equal opportunity employer, we are committed to fostering a supportive and empowering workplace for all./p/div

United States

Languages

English

Notice for Users

This job was posted by one of our partners. You can view the original job source here.

Find similar jobs