NVIDIA is leading groundbreaking developments in Artificial Intelligence, High Performance Computing and Visualization. The GPU -- our invention -- serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables groundbreaking creativity and discovery, and powers inventions that were once considered science fiction, including artificial intelligence to autonomous cars.We are the GPU Communications Libraries and Networking team at NVIDIA. We build communication libraries like NCCL, NVSHMEM, and UCX that are crucial for scaling Deep Learning and HPC. We're seeking a Senior Software Architect to help co-design next-gen data center platforms and scalable communications software.DL and HPC applications have a huge compute demands and already run at scales of up to tens of thousands of GPUs. NVLink, PCIe) within a node and with high-speed networking (e.g. Efficient and fast communication between GPUs directly impacts end-to-end application performance. This is an outstanding opportunity to advance the state-of-the-art, break performance barriers, and deliver platforms the world has never seen before. Are you ready to build the new and innovative technologies that will help realize NVIDIA's vision?Investigate opportunities to improve communication performance by identifying bottlenecks in today's systems.Design and implement new communication technologies to accelerate AI and HPC workloads.Explore innovative solutions in HW and SW for our next generation platforms as part of co-design efforts involving GPU, Networking, and SW architects.Use simulation to explore performance of large GPU clusters (think scales of 100s of 1000s of GPUs)What we need to see:M.Excellent C/C++ programming and debugging skills.Experience with parallel programming models (MPI, SHMEM) and at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC).Deep understanding of operating systems, computer and system architecture.Solid in fundamentals of network architecture, topology, algorithms, and communication scaling relevant to AI and HPC workloads.Strong experience with Linux.Knowledge of high-performance networks like InfiniBand, RoCE, NVLink, etc.Experience with Deep Learning Frameworks such PyTorch, TensorFlow, etc. Knowledge of deep learning parallelisms and mapping to the communication subsystem. Experience with HPC applications.NVIDIA accepts applications on an ongoing basis. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.US, CA, Remote; US, MA, RemoteType: Full time Nvidia
