Skip to Content
AI/ML On-site

Senior Software Engineer, AI Operations, GPS

Job Overview

As a Senior Software Engineer, AI Ops at Scale AI, you will own the long-term technical health, performance, and stability of AI solutions deployed across our strategic public sector partners. You will bridge software engineering, MLOps, and client governance, managing tiered SLAs, tracking model drift, and executing maintenance protocols that protect both system integrity and operational margins.

Key points

  1. Act as the technical gatekeeper during the formal transition from Delivery to Maintenance. Conduct deep-dive reviews to ensure baseline code, prompts…

  2. Tiered SLA & Incident Management: Own technical response and resolution targets across multi-tiered service models (from Business-Hours Essential to 24/7 Mission-Critical). Lead Incident Governance…

  3. Monitor production model performance, latency, and data drift. Manage prompt configuration repositories to maintain behavioral consistency and perform regression testing when LLM providers update…

  4. Request Classification & Technical Scope: Operationalize the boundary between Routine Maintenance (In-Scope) and System Evolution (Out-of-Scope). Assess incoming client requests and run comparative benchmarking…

  5. Advanced proficiency in Python, SQL, REST/gRPC APIs, and cloud architecture (AWS, Azure, or GCP). Hands-on experience with MLOps tooling, vector databases…

  6. Practical understanding of prompt version control, model benchmarking against evaluation datasets, RAG pipeline mechanics, and data drift detection.

  7. A drive to build systematic, automated fixes rather than applying temporary patches. Strong grasp of CI/CD for machine learning pipelines.

  8. Client Acumen & Boundary Control: Strong technical communication skills with the ability to manage client expectations, defend operational boundaries (Maintenance vs. Evolution)…

Skills

MLOpsLLMsRAGPythonSQLREST APIsAWSAzure

Experience: Senior-level · 5+ years

Similar jobs

More open roles like this one