AI Platform Engineer

Join our team as an AI Platform Engineer, where you will design and maintain the foundational infrastructure for our generative AI applications. You will build our internal AI provisioning platform, implement LLM observability, enforce model governance, and collaborate with AI Software Engineers. Enjoy remote working opportunities, an international and diverse community, and a range of benefits including a personal education budget and free German language classes.

• Design and maintain the foundational infrastructure that enables AI Software Engineers to build and scale generative AI applications.
• Build the internal AI provisioning platform, focusing on seamless model access, observability, and strict governance.
• Ensure AI integrations are secure, performant, and cost-effective, providing the robust backbone required for agentic and LLM-driven workflows.
• Experience with, or a strong willingness to learn, LLM gateways, observability platforms, and telemetry (e.g., LiteLLM, Langfuse, Datadog)
• Strong problem-solving skills, a sense of humor, and the ability to thrive in an ego-free environment as an embedded platform expert within a cross-functional Data Science and AI team
• Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related field
• Solid understanding of API cost management, rate limiting, security best practices, and data privacy for AI models
• Strong experience and confidence working with cloud infrastructure (AWS preferred) and Infrastructure as Code (Terraform)
• Proficiency in at least one programming language (e.g., Python, Go) and experience with CI/CD pipelines and containerization (e.g., Docker)
• Several years of professional experience in Platform Engineering, DevOps, SRE, or backend software development