Skip to Content

Job Overview

We are building a real-time conversational AI voice platform. You will own the platform's reliability, performance and operational architecture, and set direction across teams.

Key points

  1. Define and drive SLIs/SLOs for availability, perceived latency (end-of-speech to first audio), and call quality.

  2. Instrument end-to-end tracing across every pipeline stage, and lead architectural work to cut latency.

  3. Design autoscaling and capacity plans for stateful, real-time connections (WebSocket, WebRTC, SIP/RTP).

  4. Lead load, soak and breakpoint testing, and turn results into capacity models.

  5. Build resilience for LLM, STT and TTS dependencies: failover, fallbacks, rate-limit handling and graceful degradation.

  6. Own Kubernetes architecture, infrastructure-as-code and CI/CD with safe progressive delivery.

  7. Work personas (flexible, remote, or required in office) are categories that are assigned to ServiceNow employees depending on the nature of their work and…

  8. To determine eligibility for a work persona, ServiceNow may confirm the distance between your primary residence and the closest ServiceNow office using a third-party…

Skills

LLMsKubernetesPythonJavaAWSAzureGoogle CloudCI/CD

Experience: Senior-level · Job type: Full-time

Similar jobs

More open roles like this one