Skip to Content

Senior Machine Learning Engineer - Foundation Model

Job Overview

We are looking for a full-time Machine Learning Engineer / Research Scientist to drive the modeling and algorithmic development of XPENG’s next-generation Vision-Language-Action (VLA) Foundation Model — the core brain that powers our end-to-end autonomous…

Key points

  1. Design and implement large-scale multi-modal architectures (e.g., vision–language–action transformers) for end-to-end autonomous driving.

  2. Develop pretraining and fine-tuning strategies leveraging massive labeled and unlabeled fleet data (images, video, LiDAR, CAN bus, maps, human driving behaviors, etc.).

  3. Research and integrate cross-modal alignment (e.g., visual grounding, temporal reasoning, policy distillation, imitation and reinforcement learning) to improve model interpretability and action quality.

  4. Collaborate with infrastructure engineers to scale training across thousands of GPUs using distributed training frameworks (FSDP, DDP, etc.).

  5. Strong proficiency in PyTorch and modern transformer-based model design.

  6. Experience in large-scale pretraining or multi-modal modeling (vision, language, or planning).

  7. Deep understanding of representation learning, temporal modeling, and self-supervised or reinforcement learning techniques.

  8. Familiarity with distributed training (DDP, FSDP) and large-batch optimization.

Skills

Machine LearningDeep LearningLLMsPyTorch

Experience: Senior-level · 3+ years

Similar jobs

More open roles like this one