Data Scientist — Agent Evaluations & Quality

What this role involves

Clera is hiring a Data Scientist focused on Agent Evaluations & Quality to measure and improve the quality of autonomous agents. The role involves building evaluation pipelines, designing metrics, analyzing failures, and creating feedback loops. This is a full-time, on-site position in Palo Alto, CA, requiring 5+ years of experience and offering no visa sponsorship.

Skills this posting asks for

• python
• sql
• machine learning
• data science
• statistics
• experimental design
• llm
• evaluation frameworks
• metrics
• grading systems
• data pipelines
• dashboards
• llm-as-a-judge
• model-based graders
• tool use
• retrieval systems
• multi-step execution
• failure taxonomy
• root cause analysis
• a/b testing
• significance testing
• annotation
• labeling guidelines
• quality control

Requirements

• 5 years of experience
• Level: senior
• Remote policy: onsite
• Visa sponsorship: no

From the employer’s posting

ABOUT THE ROLE We're an early-stage AI company building autonomous agents that handle real work — email, calendar, browser, business software, and more. We're hiring a Data Scientist focused on Agent Evaluations & Quality to measure, understand, and continuously improve the quality of our agent ca…