Field Engineer, AI Labs

Connect frontier model APIs and inference endpoints (OpenAI, Anthropic, AWS Bedrock, vLLM, private client gateways) into evaluation harnesses.

Execute large-scale benchmark runs across proprietary Turing datasets (reasoning, coding, multimodal, agentic environments, and GDP Val).

Analyze eval results, isolate failure cases, detect model behavioral drift, and identify the exact data distributions needed to address capability gaps.

Strong hands-on Python proficiency: working with REST/gRPC model APIs, inference endpoints (OpenAI, Anthropic, Bedrock, vLLM), pandas, and SQL.

Practical experience with model evaluation, benchmark design, or LLM-as-a-judge pipelines. You know how benchmarks are structured, scored, and debugged.

High agency and a scrappy, startup mindset: you have owned projects end-to-end, delivered under tight deadlines…

Exceptional written and verbal communication: ability to walk research scientists through technical evaluation metrics and command confidence on commercial calls.

Comfort working with command-line tools, internal tooling, and data manipulation workflows.