Software Engineer (Evaluation)

Join our team as a Software Engineer (Evaluation) where you will design and implement algorithms and evaluation metrics to drive core AI decision-making. You will build scalable data pipelines and toolchains for large-scale data ingestion, batch processing, and evaluation. Additionally, you will design system-level evaluation metrics, testing frameworks, and simulation environments across business components. You will also design and implement high-performance backend services and distributed architectures, establish and maintain comprehensive system monitoring, and build and optimize downstream engineering workflows for Large Language Models (LLMs).

• Design and implement algorithms and evaluation metrics to drive core AI decision-making.
• Build scalable data pipelines and toolchains for large-scale data ingestion, batch processing, and evaluation.
• Establish and maintain comprehensive system monitoring, fine-grained observability metrics, and automated alerting frameworks to ensure low latency and reliable production operations.

• Strong programming skills in C/C++, Python, and software design
• Possessing solid engineering discipline, or demonstrating strong interest and potential in building large-scale systems, with the ability to maximize performance while keeping complexity and cost to a minimum
• BS/MS or Ph.D in Computer Science or a related field
• Strong foundation in mathematics and theoretical computer science, such as linear algebra, calculus, graph theory, computational geometry, combinatorial optimization algorithms, stochastic processes, and complexity analysis