Staff Research Scientist, Perception

Job description

Job responsibilities

• Research & Develop state-of-the-art Multimodal LLMs and World models to perform 3D Perception using sensor information from Camera, LiDAR and Radar.
• Integrate emerging research from the broader AI community into Waymo’s Encoders and Sensor understanding models
• Partner with engineering and research teams across Waymo to share recipes, techniques, and best practices to accelerate our collective know-how.
• Develop and maintain scalable data pipelines for Training & Eval to process data from multiple sources.
• Design and implement evaluation frameworks for perception models.
• Study and analyze different behaviors of this model, such as scaling efficacy, downstream quality implications, model architecture design ablations, etc.
• Design and implement Perception Modeling solutions to understand LiDAR/Camera/Radar information from autonomous vehicle sensors.
• Conducting cutting-edge research and potentially communicating research findings to the wider academic community via technical reports and/or publications.

Job requirements

• PhD or Masters in Computer Science, Machine Learning, Robotics, or a similar technical field, with 4+ years of industry or post-doc research experience in Reinforcement Learning or Foundation Models.
• Demonstration of original contributions to the field through high-impact publications (ArXiv, peer-reviewed conferences like NeurIPS/ICLR/CVPR), technical blog posts, or significant open-source contributions.
• Proficiency in implementing model training flows in a scalable, distributed and performant manner such as Data parallel, FSDP and other sharding approaches.
• A willingness to work with complexity of globally distributed inference infrastructure.