Search Quality Analyst (Member of Technical Staff)

Join Perplexity as a Search Quality Analyst, where you'll work at the intersection of data analysis and engineering. You'll design metrics, build data pipelines, and improve the quality of our search and answer systems. Your responsibilities will include diagnosing quality issues in our search pipeline, designing metrics from scratch, building datasets for model training, and improving search snippet quality and page selection algorithms. You should have 4+ years of experience as a data analyst or in a related role, proficiency with SQL and Python, and strong coding skills.

• Contribuer à la construction et à l'amélioration des technologies de recherche de base de l'entreprise.
• Diagnostiquer les problèmes de qualité dans le pipeline de recherche et concevoir des métriques pour suivre et mesurer la qualité de la recherche.
• Construire des ensembles de données pour l'entraînement des modèles, y compris les pipelines de labellisation LLM-as-a-judge.
• 4+ years of experience as a data analyst or in a related role
• Proficiency with SQL and Python
• Building labeling pipelines using LLM-as-a-judge
• Strong coding skills — expected to write production-grade code at a mid-level backend engineer level
• Designing metrics from scratch (not just analyzing existing A/B experiments)
• Designing evals with known ground truth (e.g. SimpleQA, BrowseComp) or driving meaningful improvements on such evals
• Training ML models that shipped to production with measurable metric improvements
• Demonstrated hands-on experience with at least one of the following:
• Knowledge of statistics and A/B experiment design
• Experience with Apache Spark or Databricks
• Experience working on search-related products