Senior Software Engineer – Agentic Search Index

About the role

We are looking for a Senior Software Engineer to work on the indexing and data processing layer of a novel search engine tailored for agentic AI consumption. The role focuses on building systems that ingest, process, and organise massive volumes of data into efficient, queryable structures.

Key responsibilities

• Design, implement, and operate large‑scale indexing systems and data pipelines that form the core of our search infrastructure.
• Develop and optimise indexing strategies that balance performance, freshness, and resource efficiency.
• Work on storage formats, compaction strategies, and update mechanisms to keep data accessible and current.
• Ensure reliability and predictability of pipelines under high‑throughput conditions (tens of GB/s).
• Define and implement observability primitives, including structured logs, metrics, and data‑quality signals.

Required profile

• 5+ years of experience building production backend or data‑infrastructure systems.
• Strong Go experience (C++/Rust a plus) and familiarity with large‑scale data processing.
• Experience with distributed systems, fault tolerance, consistency, and scalability.
• Hands‑on experience running production systems and handling operational incidents.

Required skills

• Go
• C++ or Rust
• Large‑scale data processing (10+ GiB/sec, petabyte‑scale)
• Distributed systems design
• Indexing pipelines and storage formats
• Observability (structured logs, metrics)
• Frameworks such as Spark, Flink, MapReduce, Beam (optional)

What we offer

• Competitive compensation
• Career growth and learning opportunities
• Flexibility and ownership
• Collaborative and innovative culture
• Opportunity to work on impactful AI projects
• International environment with talented teams