Software Engineer (AI Evaluation)

Join Board Intelligence, a company that places AI at the core of its operations. As a Software Engineer in the AI team, you will design and build the AI evaluation suite, work closely with prompt engineers and subject matter experts, and contribute to building AI-powered products. You will have the opportunity to work independently, set your own direction, and be at the forefront of AI quality.

• Design and build the AI evaluation suite, including systems for measuring and improving AI output quality.
• Collaborate with prompt engineers and subject matter experts to turn their knowledge into tests, metrics, and tooling.
• Automate evaluation processes and results as part of the software development lifecycle (SDLC) to ensure product teams can ship with confidence.

• Experience collaborating with non-engineers and turning their expertise into working software
• Fluent written and spoken English
• Experience building AI powered products or tooling
• Upper mid-level to senior professional software engineering experience
• We are looking for a strong all-round engineer who is comfortable working independently, enjoys ambiguity and wants to work at the forefront of AI quality
• Comfort working independently and in ambiguity, setting your own direction
• Full-stack experience across front end and back end
• A strong focus on quality, testing and attention to detail
• Experience using AI coding tools in your day-to-day work
• Experience at a startup or in a small team where you built things end to end
• Experience building internal tools, testing frameworks or data pipelines
• Experience with Python and TypeScript
• Experience with building evaluation suites for AI products