Skip to Content
GenAIAI/ML On-site

Staff Technical Product Manager – AI/LLM expertise + AI Evaluation Science

Job Overview

We are looking for a highly technical, strategic, and outcome-oriented Staff Technical Product Manager to establish and scale AI Evaluation as a core engineering capability across the DT organization.

Key points

  1. The Eval Technical Product Manager will lead this transformation by making trusted Evals the evidence layer for AI.

  2. Platform Eval Strategy & Adoption.

  3. Partner closely with Servicenow AI platform and product teams to understand, implement, validate, and drive adoption of out-of-the-box Evals…

  4. Identify gaps where OOTB Evals don't adequately measure enterprise AI quality.

  5. Define and drive custom metrics, rubrics, datasets and evaluation strategies.

  6. Develop reusable Evals for domain-specific behaviors and business outcomes.

  7. Work personas (flexible, remote, or required in office) are categories that are assigned to ServiceNow employees depending on the nature of their work and…

  8. To determine eligibility for a work persona, ServiceNow may confirm the distance between your primary residence and the closest ServiceNow office using a third-party…

Skills

LLMsCI/CDRoadmappingProblem Solving

Experience: Senior-level · Job type: Full-time

Similar jobs

More open roles like this one