The team has a dual mandate: maximizing compute efficiency to reliably serve our explosive customer growth, while enabling breakthrough research by giving our scientists the high-performance inference infrastructure they need to develop next-generation models. Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position
Develop resilient, flexible systems that adapt in real time to real world events.
Develop intelligent request routing, load balancing, and traffic management systems across thousands of accelerators.
Maximize compute efficiency across the fleet by autoscaling and orchestrating production, research, and experimental workloads.
Build and operate production-grade deployment pipelines for releasing new models to users.
Significant software engineering experience, particularly with distributed systems.
Results-oriented, with a bias towards flexibility and impact.
Willingness to pick up slack, even if it goes outside your job description.
Desire to learn more about machine learning systems and infrastructure.
Experience: Senior-level
More open roles like this one
Bengaluru, KA, IndiaIndia & South Asia
Remote · San Francisco, CANorth America
Staff + Senior Software Engineer, Inference · Anthropic
Don't have an account? Already have an account?