Software Engineer, AI Inference

We are looking for a Software Engineer to work at the forefront of deploying our cutting-edge AI models, enhancing the performance and capabilities of our embodied systems. You will be responsible for optimizing AI inference processes from lightweight to billion-parameter models, ensuring our robots operate with unmatched efficiency and intelligence in real-world environments. You will work at the intersection of systems and machine learning, directly contributing to making our AI models more powerful and adaptive by ensuring consistent performance in light of variable and perhaps unforeseen compute and hardware constraints. Responsibilities: Develop and optimize runtime AI inference pipelines for real-world robotic deployment. Build infrastructure, frameworks, and tooling to enable reliable integration of models into robotic systems and informative analysis of production models to drive the direction of architecture choice and deployment system design. Formulate specialized optimization solutions for various inference paradigms and scenarios (autoregressive models, denoising models, hierarchical models, state machines, multi-agent systems, cloud-based inference). Adapt optimization solutions to various compute, hardware, and networking constraints. Preferred Qualifications: BS, MS or higher degree in Computer Science, Robotics, Engineering or a related field, or equivalent practical experience.