Staff AI Platform Engineer - Inference & Agentic Systems

Inference & Model Serving.

Build and operate multi-model serving across modalities (text, voice, code, vision) on shared infrastructure.

Own the model lifecycle: download, deploy, serve, monitor, update, swap.

Drive inference optimization: latency, throughput, cost - including quantization, batching, caching, and routing strategies.

Strong understanding of LLM-based agent architectures: tool use, multi-step workflows, multi-agent coordination, and their failure modes.

Experience building highly reliable distributed systems.

Experience evaluating LLM systems in production: building evals, detecting regressions, and debugging non-deterministic failures.

Proficiency in TypeScript or Python, and willingness to work in both: the agent platform is TypeScript on Bun with Temporal workflows on Kubernetes and…