- Robot type
- Autonomous Vehicle
- Location
- Foster CityCaliforniaUSA
- Job type
- Artificial Intelligence
- Posted
- Mar 31, 2026
- Salary
- $199,000–$305,000 a year
Full-time
Senior / Staff Machine Learning Engineer - Scene Intelligence
Job description
The Perception team at Zoox creates the "eyes and ears" of our self-driving robots. Navigating safely and efficiently in complex environments requires detecting, classifying, tracking, and understanding various attributes of surrounding objects—all in real-time and with exceptional accuracy.
Job responsibilities
- Design and train Vision-Language-Action (VLA) solutions for robotaxis
- Lead end-to-end data strategy, including mining, auto-labeling, and dataset construction to power our ML flywheel
- Lead the full post-training stack for VLMs and VLAs, including C ontinual Pre-training (CPT) on domain-specific driving data, Supervised Fine-Tuning (SFT) for instruction following.
- Utilize our large-scale data pipelines and ML infrastructure to research, prototype, and deploy solutions that improve driving behavior
- Partner with cross-functional teams to integrate perception signals
Job requirements
- MS or PhD in Computer Science or related field
- Background in deep learning solutions for VLM and VLA models
- Track record in post-training large-scale models, CPT, SFT, RL
- Hands-on experience with production ML pipelines, including dataset creation, training frameworks, and metrics
- Expertise in Python libraries (PyTorch, NumPy, Pandas, VLLM)
- Deep knowledge of cutting-edge computer vision techniques
- Publications in top-tier conferences (CVPR, ICCV, RSS, ICRA)
- Experience with integrating large language models to various tasks.
Similar jobs
Zoox · Artificial Intelligence
Senior Manager, Perception Data
Foster City, California
Zoox · Artificial Intelligence
Lead AI Engineer – Enterprise, Data & AI
Foster City, California
Zoox · Artificial Intelligence
Data Scientist - Perception Verification and Validation
Boston, Massachusetts
Zoox · Artificial Intelligence
Senior Trim & Lighting Engineer
Foster City, California
