Search Quality Analyst

Perplexity is looking for an experienced data analyst to accelerate the development of advanced search technologies. You will identify robust and sensitive signals from user behavior to help us gather insights from A/B experiment data more efficiently.ResponsibilitiesDevelop data-driven insights from user behavior to inform our product roadmap and accelerate adoptionFormulate hypotheses and validate them by designing, running, and analyzing A/B testsDetermine appropriate metrics and visualizations for tracking, and implement them in dashboardsDesign new pipelines that will help to deliver better ranking quality. From discovering new signals, producing metrics and construct data labeling pipelines with human and LLM feedback.Qualifications4+ years of experience working as a data analyst or in a related roleExperience working on search-related products, with emphasis on designing online metrics and analyzing A/B experimentsStrong Python skills (expected to write production-grade code)Proficiency with SQLExperience with Business Intelligence (BI) toolsDeep knowledge of statisticsPreferred QualificationsProficiency with Apache SparkExperience with DatabricksExperience with development of LLM-as-a-judge systems