Backend Engineer, AI Systems

About the role

CompanyA1 is creating a proactive AI assistant that helps users manage conversations, errands, and workflows. As a Backend Engineer, AI, you will own the inference and orchestration layer that powers every AI interaction, ensuring low latency, high reliability, and cost‑effective operation.

Key responsibilities

• Build and operate production backend systems that serve AI‑powered features to mobile and desktop clients.
• Design inference pipelines and orchestration layers for multi‑step workflows, tool calls, and retries.
• Manage the full lifecycle of AI requests, including routing, caching, batching, streaming, and state management.
• Optimize latency, throughput, and cost across model inference and downstream services.
• Implement observability (logging, tracing, debugging) for AI outputs and failures.
• Collaborate with machine‑learning and product teams to turn model capabilities into stable APIs.

Required profile

• Strong fundamentals in backend engineering for production environments.
• Experience running high‑throughput, low‑latency services.
• Familiarity with AI inference patterns such as large language models, embeddings, and multimodal data.
• Comfortable debugging distributed systems under load.
• Bias toward shipping and learning from production behavior.

Required skills

• Python
• Node.js
• PyTorch
• OpenAI / Anthropic / open‑source LLMs
• SQL & NoSQL databases
• Kubernetes
• Docker

What we offer

• Opportunity to shape core AI infrastructure for a consumer‑facing product.
• High‑talent, hands‑on team with rapid decision‑making.
• Exposure to cutting‑edge AI models and large‑scale systems.