技术员工（搜索质量分析师）
Member of Technical Staff (Search Quality Analyst)
Perplexity 正在寻找一位有经验的分析师，帮助我们构建和改进核心搜索技术。你将在数据分析和工程的交汇点工作——设计指标、构建数据管道，并提升我们搜索和回答系统的质量。
该职位在贝尔格莱德、伦敦或柏林为混合办公模式。
职责
- 发现并诊断搜索流程中的质量问题
- 从零开始设计指标，以跟踪和衡量搜索质量
- 构建用于模型训练的数据集，包括 LLM-as-a-judge 标注流程
- 改进搜索摘要质量和页面选择算法以用于索引
- 设计并分析 A/B 实验以验证改进效果
要求
- 4 年以上数据分析师或相关岗位的工作经验
- 强大的编码能力——能够编写达到中高级后端工程师水平的生产级代码
- 精通 SQL 和 Python
- 至少具备以下某一方面的实际操作经验：
- 从零开始设计指标（不仅仅是分析现有的 A/B 实验）
- 使用 LLM-as-a-judge 构建标注流程
- 训练已部署到生产环境的 ML 模型，并带来可衡量的指标提升
- 设计具有已知真实答案的评估（如 SimpleQA、BrowseComp）或在这些评估上推动有意义的改进
优先考虑
- 在搜索相关产品上的工作经验
- 统计学知识和 A/B 实验设计经验
- 使用 Apache Spark 或 Databricks 的经验
查看英文原文
Perplexity is looking for an experienced analyst to help us build and improve our core search technologies. You'll work at the intersection of data analysis and engineering - designing metrics, building data pipelines, and improving the quality of our search and answer systems.
This role is hybrid in Belgrade, London or Berlin.
Responsibilities
- Find and diagnose quality issues in our search pipeline
- Design metrics from scratch to track and measure search quality
- Build datasets for model training, including LLM-as-a-judge labeling pipelines
- Improve search snippet quality and page selection algorithms for indexing
- Design and analyze A/B experiments to validate improvements
Qualifications
- 4+ years of experience as a data analyst or in a related role
- Strong coding skills — expected to write production-grade code at a mid-level backend engineer level
- Proficiency with SQL and Python
- Demonstrated hands-on experience with at least one of the following:
- Designing metrics from scratch (not just analyzing existing A/B experiments)
- Building labeling pipelines using LLM-as-a-judge
- Training ML models that shipped to production with measurable metric improvements
- Designing evals with known ground truth (e.g. SimpleQA, BrowseComp) or driving meaningful improvements on such evals
Preferred Qualifications
- Experience working on search-related products
- Knowledge of statistics and A/B experiment design
- Experience with Apache Spark or Databricks