Senior AI Engineer

Join Synera, a cutting-edge AI company, as a Senior AI Engineer. In this role, you will own the evaluation framework for multiple real agentic products used by major companies like BMW, Airbus, and NASA. You will work closely with the Agentic Ants team, building and extending agentic systems, and contributing to an evaluation framework that ensures the trustworthiness of the agents being shipped. You will also have the opportunity to shape the next AI-native generation of Synera and improve existing software.

• Contribuer à un cadre d'évaluation qui régit chaque changement dans les systèmes agentiques, y compris les ensembles de données d'or, les pipelines LLM-en-juge et les suites de régression.
• Améliorer le logiciel existant et façonner la prochaine génération de Synera en collaborant avec d'autres équipes pour approfondir les données d'insights clients.
• Travailler en étroite collaboration avec les ingénieurs en IA et en logiciel pour étendre le système agentique et écrire les évaluations qui conditionnent le changement avant qu'il ne soit expédié.

• You communicate clearly and push back when you disagree
• You write production-grade Python (using FastAPI and PostgreSQL)
• Even if you don't meet these criteria perfectly but believe you have lots to bring to the role, we encourage you to apply. We know it's tough, but please keep in mind that you don't have to match all the listed requirements exactly to be considered for this role
• You handle reliability when it shows up in your work, implementing retries, error handling, or graceful degradation
• You’ve worked with at least two of the following AI platforms: Anthropic, OpenAI, Azure Froundry, Bedrock, or Vertex AI
• You resonate with Synera's Core Values - they're central to how we work, and we'll explore them together in your first interview
• P.S. Synera is a place where everyone can grow. So, however you identify and whatever background you bring with you, please apply if this is a role that would make you excited to come to work every day, and be prepared to share with us how your perspective will bring something unique and valuable to our Agentic Ants team
• You’re familiar with Langfuse, LangSmith, or similar tracing tools
• You’ve designed and shipped agent graphs in production with LangGraph or equivalent, including supervisor / sub-agent patterns, tool design, prompt iteration
• You’ve built or meaningfully contributed to an LLM evaluation pipeline: LLM-as-judge design, calibration against human labels, dataset versioning, and the statistical reasoning behind it (CIs, sample sizes, false positives)