Engineering Manager – AI Engineering

Lead, mentor, and grow a team of AI engineers — setting technical direction, raising the engineering bar…

Architect and scale Meesho's AI platform: cross-region model inference, multi-GPU fleet allocation and management, distributed training, and feature-engineering infrastructure.

Drive inference optimization across the full stack — GPU kernel tuning, quantization (including outlier/tail-distribution handling)…

Optimize open-weight models at both the model and inference-engine level — distillation, quantization, speculative decoding, KV-cache and serving-engine tuning.

Bachelor's or Master's in Computer Science or a related field.

Strong hands-on experience with the modern LLM inference stack — TensorRT-LLM, vLLM, SGLang — and with production, low-latency model serving at scale.

GPU kernel tuning, quantization, speculative decoding, KV-cache and memory/IO optimization. CUDA / GPU programming experience is a strong plus.

Experience with distributed training and the frameworks behind it — PyTorch FSDP, DeepSpeed, Megatron, or Ray.