Research Engineer, Infrastructure
Remote · Remote
Compensation is based on the geographic location in which the role is located and is subject to change based on work location.
Design & Architect Data Infrastructure — Design and oversee deployment of data architecture and pipelines to capture, manage…
Build & Automate Data Transformation — Develop technical tools using ML and data-engineering techniques to cleanse, organize, and transform data…
Define Agentic Evaluation Metrics & Ground Truth — Partner with product and AI teams to define evaluation metrics for agentic workflows (task completeness…
Build Agentic Evaluation Pipelines — Design and implement automated evaluation infrastructure that measures AI agent performance using Now LLM Service models and execution logs…
Proven track record deploying, monitoring, and maintaining large-scale data systems in production; experience troubleshooting data quality issues, latency, and system reliability.
Ability to design scalable, secure data architectures; experience with cloud platforms (GCP, AWS), APIs, event-driven systems, and data governance patterns.
Familiarity with AI/ML evaluation frameworks, LLM-based systems, or agentic workflows; ability to instrument and evaluate complex AI systems; understanding of model performance tracking.
Comfortable driving technical conversations across multiple teams; takes end-to-end ownership; works autonomously; mentors peers on data engineering standards and best practices.
Experience: Senior-level · 9+ years · Job type: Full-time
More open roles like this one
Remote · Remote
Staff Research Engineer/Scientist · ServiceNow
Don't have an account? Already have an account?