Skip to Content

Model Operations Lead, AI Gateway

Job Overview

This role is eligible to participate in Cloudflare’s equity plan.

Key points

  1. Ensure the catalog reflects reality, and proactively identify when a model or provider is underperforming before customers notice.

  2. Auto-Routing & Optimization: Deliver auto-routing that measurably beats a fixed model choice on cost or quality for users.

  3. Build and maintain trusted rankings and recommendations grounded in solid methodology.

  4. Partner & Stakeholder Management: Set clear expectations for providers, while keeping Engineering, Product, Partnerships, and other stakeholders aligned.

  5. Preferred: experience hiring, managing, and growing engineers or operators, giving direct feedback, delegating real ownership, and expanding scope without becoming a bottleneck.

  6. Preferred: technical & Shipping Capabilities: Proven track record of taking technical launches or integrations from ambiguity to production across teams and partners. Hands-on ability…

  7. Preferred: deep familiarity with new models, labs, and inference providers. Hands-on understanding of streaming, tool calling, structured outputs, rate limits, token pricing…

  8. Preferred: data-driven product instincts to advocate for adding, modifying, or retiring catalog items. SRE approach to defining, measuring, and alerting on service health…

Skills

Stakeholder ManagementInterviewingRoadmappingPythonTypeScriptMachine Learning

Experience: Senior-level

Similar jobs

More open roles like this one