Senior Software Engineer (Inference)

Join our fast-paced engineering team as a Senior Software Engineer (Inference). You'll be responsible for turning cutting-edge AI research into customer-facing products, scaling our inference infrastructure, and collaborating with researchers and applied teams. Enjoy a competitive salary, equity, premium benefits, unlimited PTO, team offsites, and a flexible schedule.

• Design and ship customer-facing APIs that expose new model capabilities, owning them from prototype through launch and ongoing iteration.
• Scale inference infrastructure to support our 1M+ API users and ensure reliability and performance.
• Partner with researchers to productionize new techniques, turning a notebook or proof of concept into a robust product.

• Strong backend engineering experience, including building and supporting machine learning infrastructure and/or customer-facing APIs in production
• Comfort operating with ambiguity. Research timelines and product timelines don't always line up, and you're energized rather than frustrated by that
• Strong collaboration skills. You'll be working daily with researchers, applied engineers, and sometimes customers, people with very different contexts and priorities, and the role only works if you enjoy that
• Genuine curiosity about AI/ML. You don't need to be a researcher, but you should want to understand what the models are doing well enough to make good engineering decisions around them