Research Scientist: Pretraining

Job description

Job responsibilities

• Designing and executing large-scale pretraining runs for robot foundation models (transformer- and diffusion-based architectures)
• Defining model architectures, objectives, and training curricula across multimodal robotic data (vision, action, state, language)
• Developing scalable data mixtures and sampling strategies across petabyte-scale datasets
• Guiding data collection operations towards new directions, as well as sourcing new datasets
• Running ablations to understand scaling laws, data quality effects, and architecture tradeoffs
• Collaborating closely with ML Infra and Systems to push cluster utilization, throughput, and reliability
• Turning raw robotic interaction data into generalizable model capabilities
• Have worked on large-scale ML systems with senior/staff (L6+) experience.