Skip to content

Jobs

Zoox

Robot type
Autonomous Vehicle
Location
Foster CityCaliforniaUSA
Job type
Artificial Intelligence
Posted
Mar 31, 2026
Salary
$199,000–$305,000 a year
Full-time

Senior / Staff Machine Learning Engineer - Scene Intelligence

Job description

The Perception team at Zoox creates the "eyes and ears" of our self-driving robots. Navigating safely and efficiently in complex environments requires detecting, classifying, tracking, and understanding various attributes of surrounding objects—all in real-time and with exceptional accuracy.

Job responsibilities

  • Design and train Vision-Language-Action (VLA) solutions for robotaxis
  • Lead end-to-end data strategy, including mining, auto-labeling, and dataset construction to power our ML flywheel
  • Lead the full post-training stack for VLMs and VLAs, including C ontinual Pre-training (CPT) on domain-specific driving data, Supervised Fine-Tuning (SFT) for instruction following.
  • Utilize our large-scale data pipelines and ML infrastructure to research, prototype, and deploy solutions that improve driving behavior
  • Partner with cross-functional teams to integrate perception signals

Job requirements

  • MS or PhD in Computer Science or related field
  • Background in deep learning solutions for VLM and VLA models
  • Track record in post-training large-scale models, CPT, SFT, RL
  • Hands-on experience with production ML pipelines, including dataset creation, training frameworks, and metrics
  • Expertise in Python libraries (PyTorch, NumPy, Pandas, VLLM)
  • Deep knowledge of cutting-edge computer vision techniques
  • Publications in top-tier conferences (CVPR, ICCV, RSS, ICRA)
  • Experience with integrating large language models to various tasks.

Similar jobs