Senior Performance Engineer

About the role

NVIDIA is looking for a Senior Performance Engineer to develop and evolve systems for performance analysis, telemetry, and optimization of large‑scale GPU and CPU clusters used in AI and high‑performance computing.

Key responsibilities

• Profile, benchmark, and analyze AI and HPC workloads on GPU and CPU clusters.
• Explore performance characteristics of high‑performance networking and collective communications (e.g., NCCL, RDMA, MPI, RoCE).
• Identify bottlenecks across networking, compute, memory, and system architecture.
• Develop and enhance performance analysis, benchmarking, and diagnostic tools.
• Define test plans and set expectations for new technologies and platforms.
• Collaborate with hardware, firmware, networking, systems, and software teams to provide actionable insights.

Required profile

• B.Sc. or M.Sc. in Computer Science, Computer Engineering, Software Engineering, or equivalent experience.
• 5+ years of experience in performance analysis, systems engineering, or HPC/AI infrastructure.
• Strong analytical, problem‑solving, and communication skills.
• Ability to work effectively in cross‑functional, fast‑paced R&D teams.

Required skills

• Performance analysis and benchmarking methodologies.
• High‑performance networking (RDMA, MPI, NCCL, congestion control).
• System performance metrics (latency, throughput, resource utilization).
• Python; Bash and C/C++ a plus.
• Linux environment proficiency.
• Knowledge of CUDA, NCCL internals, and GPU architectures.
• Experience with NVIDIA GPUs, CUDA, PyTorch or TensorFlow.
• Familiarity with cloud platforms.