Senior Software Engineer – Agentic Search Runtime

About the role

Nebius is building an agent‑native search platform for AI systems. The Senior Software Engineer will own the runtime services that serve search queries at real‑time latency, handling thousands of requests per second.

Key responsibilities

• Design, implement and operate core runtime services for high‑throughput search query serving.
• Build and optimise request flows—including query processing, retrieval orchestration and response assembly—under strict latency budgets.
• Optimise CPU, memory and data‑access patterns in performance‑critical paths.
• Ensure reliability, observability and predictability across production services.
• Define and implement observability primitives such as structured logs, metrics, traces and latency breakdowns.
• Collaborate with indexing and ML teams to integrate retrieval and ranking components while keeping ML logic decoupled.
• Support experimentation through controlled rollouts and rigorous benchmarking.

Required profile

• 5+ years of experience building production backend systems.
• Strong hands‑on expertise in C++ or Rust for high‑load services.
• Proven track record of operating low‑latency, user‑facing systems handling thousands of RPS.
• Deep understanding of systems‑level performance (CPU, memory, networking, data access).
• Experience deploying, debugging and rolling back code in production environments.
• Ability to collaborate across engineering, ML and product teams.

Required skills

• C++
• Rust
• DBMS internals (open‑source or SaaS)
• Cloud infrastructure
• High‑load web applications / large‑scale APIs
• Low‑level performance tuning and hardware‑level optimisation

What we offer

• Competitive compensation
• Career growth and learning opportunities
• Flexibility and ownership in a collaborative, innovative culture
• Opportunity to work on impactful AI projects
• International environment with talented teams