Skip to Content

Software Engineer - Model API Platform

Job Overview

We are hiring a Software Engineer to own major parts of this platform end to end, working closely with the Staff Engineer who leads its architecture.

Key points

  1. Own one or more major parts of the platform, such as the WebSocket streaming layer, a speech recognition pipeline…

  2. Turn loosely defined goals into RFCs, milestones and shipped results, and write down the decisions and trade-offs.

  3. Be accountable after launch: on-call, incident response, root-cause analysis and follow-through on fixes.

  4. Make the call when a decision is needed, and own the outcome.

  5. At least one service you owned end to end under real load, including what broke and what you changed.

  6. Strong distributed-systems fundamentals: concurrency, networking, queues, caching, consistency and failure modes.

  7. Experience with low-latency or high-throughput services, and comfort reasoning about p95 and p99 latency.

  8. Solid fundamentals with a relational database and a cache, such as PostgreSQL and Redis: schema design, query performance and caching strategy.

Skills

PythonLLMsSQLFastAPIGoKubernetesCI/CDMLOps

Experience: 4–6 years · Job type: Full-time

Similar jobs

More open roles like this one