Senior HPC and AI Network Software Architect

About the role

NVIDIA is seeking a Senior HPC and AI Network Software Architect to design and evolve scalable software systems for distributed AI training and inference, focusing on performance, resiliency, and efficiency at cluster scale.

Key responsibilities

• Build and evolve architecture of scalable software for distributed AI workloads, optimizing throughput, latency, and memory usage.
• Develop next‑generation communication and runtime capabilities in libraries such as NCCL, UCX, and UCC.
• Partner with AI framework teams (TensorFlow, PyTorch, JAX) and internal platform teams to integrate and improve performance.
• Collaborate on hardware and system‑level features across GPUs, DPUs, and interconnects to accelerate data movement.
• Drive innovation across runtime systems, communication libraries, and AI‑specific protocol layers.

Required profile

• Ph.D. or equivalent industry experience in computer science, computer engineering, or related field.
• 5+ years in systems programming, parallel/distributed computing, high‑performance networking, or large‑scale data movement.
• Strong collaboration skills in a multinational, interdisciplinary environment.

Required skills

• C++ and Python programming.
• CUDA or other GPU programming models.
• Experience with AI frameworks such as PyTorch, TensorFlow, or JAX.
• Hands‑on experience with communication libraries like NCCL, UCX, or UCC.