Senior / Staff Machine Learning Engineer - Perception Attributes

Job description

Job responsibilities

• Lead the development of sophisticated behavioral models for vehicles, pedestrians, and cyclists as a key member of the Attributes team within Zoox's Perception department.
• Create and maintain perception attribute models that generate essential signals, enabling our autonomous vehicles to understand and predict the behavior of various road users.
• You will collaborate closely with Prediction and Planning teams to optimize your models' outputs, directly influencing how our autonomous vehicles make real-time driving decisions.
• Work with data labeling and ontology teams on data labeling and ontology definitions of the road users in different attributes and generate auto-labeling or data mining strategies for different attributes.
• You will help shape the future of autonomous mobility by bridging the critical gap between raw perception data and autonomous decision-making.

Job requirements

• MS/PhD in computer science or related fields with a minimum of 7 years of relevant experience
• Experience with training and deploying Deep Learning models
• Experience with knowledge distillations from large foundation models
• Experience with production Machine Learning pipelines: dataset creation, training frameworks, metrics pipelines
• Fluency programming in Python and extensive experience with algorithm design
• Strong mathematics skills
• Familiarity of VLMs/VLAs/ViTs
• Experience with large model distillation in a production environment