Research Scientist - World-Action Foundation Model, Robotics

Job description

Job responsibilities

• Conduct research on pretraining world-action foundation model with various world modalities including vision and physics associated with ego actions, serving the purpose for both robot action and simulation world…
• Diving into relevant topics such as vision-physics modality association, feed-forward Gaussian splatting, world foundation model, human data incorporation, language modality, and spatial reasoning, deformable object…
• related topics including 3D/world-action foundation model, multi-modal pretraining, feed-forward Gaussian splatting, world foundation model with applications to autonomous driving, and fundamental topics on 3D vision…
• Work closely with other Research Scientists and interns on research publications for submission to top-tier conferences
• Collaborate with Research Engineers and engineering teams to test and deploy algorithms to our autonomy and simulation products

Job requirements

• Strong research record in the fields of 3D vision, reconstruction and generation for robotics and autonomous systems, with publications in top-tier conferences or journals in the fields of computer vision, machine…
• MSc or PhD in machine learning and computer vision with autonomy and robotics applications or closely-related fields
• Passion for next-generation, scalable autonomy and robotics for real-world systems
• Strong research skills and the ability to work both independently and collaboratively on projects
• Technical experience in: Python, Pytorch, computer vision, robotics systems, and distributed machine learning model training
• 3D foundation model and pretraining
• Multi-modal foundation model
• Feed-forward Gaussian splatting and reconstruction