Nvidia

Actively Hiring

Senior Software Architect

Santa Clara, United States

Full time

Role Overview

We're seeking a Senior Software Architect to help co-design next-gen data center platforms and scalable communications software for Deep Learning and HPC.

About Nvidia

NVIDIA is leading groundbreaking developments in Artificial Intelligence, High Performance Computing and Visualization. The GPU -- our invention -- serves as the visual cortex of modern computers and is at the heart of our products and services.

Key Responsibilities

Investigate opportunities to improve communication performance by identifying bottlenecks in today's systems.
Design and implement new communication technologies to accelerate AI and HPC workloads.
Explore innovative solutions in HW and SW for our next generation platforms as part of co-design efforts involving GPU, Networking, and SW architects.
Build proofs-of-concept, conduct experiments, and perform quantitive modeling to evaluate and drive new innovations.
Use simulation to explore performance of large GPU clusters

Requirements & Eligibility

M.S./Ph.D. degree in CS/CE or equivalent experience.
5+ years of relevant experience.
Excellent C/C++ programming and debugging skills.
Experience with parallel programming models (MPI, SHMEM) and at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC).
Deep understanding of operating systems, computer and system architecture.
Solid in fundamentals of network architecture, topology, algorithms, and communication scaling relevant to AI and HPC workloads.
Strong experience with Linux.

Required Skills & Tech

C++CMPISHMEMNCCLNVSHMEMOpenSHMEMUCXUCCLinuxCUDAInfiniBandRoCENVLinkPyTorchTensorFlow