Systems Engineer, World Model Evaluation - Autonomous Vehicles

Job description

Job responsibilities

• Work with us to translate driving-feature needs and safety analysis into world-model requirements, performance targets and error budgets.
• Investigate real-world failure modes and develop metrics, scenarios and tests that expose gaps across operating conditions.
• Build and validate evaluators that connect world-model errors to vehicle behavior.
• Partner with our data and ground-truth teams to define evaluation datasets and labeling guidelines, addressing ambiguous cases, label quality, coverage, provenance and independence from training data.
• Develop reproducible analysis and automated triage using on-road data, replay and closed-loop simulation to distinguish product failures from evaluation and data issues.
• Help us turn results into decisions through evaluation tools and dashboards that guide improvements and demonstrate release readiness.