- Robot type
- Autonomous Vehicle
- Location
- Foster CityCaliforniaUSA
- Job type
- Software
- Posted
- Oct 22, 2026
- Salary
- $339,000–$455,000 a year
Senior Staff/Principal Software Engineer - GPU System Software, Onboard Execution
Job description
That makes GPU execution one of the most consequential engineering problems in the company. Each new model generation wants more compute. Each new vehicle generation needs to cost less, use less power, and stay safe. Closing that gap is not a kernel-tuning exercise. It takes an end-to-end technical vision for how the whole onboard AI workload is scheduled, shared, isolated, and sized across GPUs, and the authority to drive that vision across ML, autonomy, middleware, and hardware organizations.
You will join Zoox's Software Performance organization, which owns end-to-end performance of the onboard software stack: profiling and observability, GPU compute, and compute platform.
Job responsibilities
- Architect onboard GPU execution. Define how perception, prediction, and planning workloads share onboard GPUs, including scheduling, multi-tenancy, isolation, and deterministic latency under contention.
- Drive compute reduction. Own the multi-year roadmap to cut onboard compute per vehicle by setting latency and utilization budgets and landing the biggest levers across models, runtimes, middleware, and hardware in real…
- Shape hardware and platform direction. Guide next-generation compute decisions (GPU and SoC selection, topology, memory budgets) with workload models and performance projections that justify them, then lead performance…
- Lead inference performance at scale. Set direction for the inference stack (TensorRT, CUDA, custom kernels, quantization) and partner with ML teams so models are designed for the hardware they ship on.
- Provide technical leadership. Lead and mentor senior engineers, align directors and VPs through design docs, and make the hard calls when performance, safety, and schedule conflict.
Job requirements
- BS in computer science, computer engineering, or related field and 10+ years in systems or performance engineering, including leading GPU or accelerator architecture across teams, or building and leading a performance…
- Deep CUDA platform (programming model, runtime, and driver) and NVIDIA GPU microarchitecture expertise (Ampere through Blackwell, Orin, Thor).
- Proven record setting technical direction and delivering large, measurable end-to-end gains in latency, utilization, or cost.
- Working knowledge of ML inference optimization (TensorRT, XLA, Triton, quantization, fusion) and expert C++ on Linux.
- Ability to align ML, systems, hardware, and leadership on a shared technical plan.
- Real-time or embedded GPU experience: autonomy, robotics, AR/VR, games, or HPC. Production GPU multi-tenancy (MPS, MIG, priority streams).
Similar jobs
Zoox · Software
Test Infrastructure Engineer
Foster City, California
Zoox · Software
Staff Systems Engineer, Simulation Systems Verification and Validation Lead
Foster City, California
Zoox · Software
Senior Software Engineer, C++ Vehicle Experience
Foster City, California
Zoox · Software
Contract Student Worker - Autonomy and Geofence Expansion (20 hrs/wk)
Foster City, California
Robot deals
All deals →
Get dealDeal · Everblog
10% off
ShopShop · CircuitMess
DIY robot kits
Robot and gadget kits you build yourself.
ShopShop · GRABO
Cordless vacuum lifter
GRABO Pro Brushless: the original cordless vacuum lifter for pavers, stone, glass and panels.
Like what we do? Buying through these links supports Bots n' Beans. We earn a commission at no extra cost to you. Thank you!
