Senior Research Engineer - Autonomous Vehicles

Job description

Job responsibilities

• Develop large-scale supervised learning and reinforcement learning training frameworks to support multi-modal foundation models for AVs capable of running on thousands of GPUs;
• Optimize GPU and cluster utilization for efficient model training and fine-tuning on massive datasets;
• Implement scalable data loaders and preprocessors tailored for multimodal datasets, including videos, text, and sensor data;
• Build and optimize simulation infrastructure (based on GPU-accelerated simulators) to support the training of driving policies for AVs at scale;
• Collaborate with researchers to integrate cutting-edge model architectures into scalable training pipelines.
• Develop sim-to-real transfer pipelines and work closely with the AV product team to deploy to real-world cars;
• Propose scalable solutions that combine LLMs with policy learning.
• Apply reinforcement learning to finetune multimodal LLMs.