Machine Learning Engineer, Model Evaluations (Speech LLM) - San Francisco

What this role involves

Plaud is hiring a Machine Learning Engineer for Model Evaluations focused on Speech LLM. The role involves building evaluation infrastructure, defining metrics for speech quality, partnering with researchers, and creating dashboards to track model health. The position is onsite in San Francisco.

Skills this posting asks for

• python
• distributed systems
• data pipelines
• evaluation harnesses
• speech metrics
• wer
• cer
• pesq
• automated mos
• llm-as-a-judge
• human evaluation
• rlhf
• dpo
• observability
• statistics
• experimental design
• weights & biases
• mlflow
• adversarial datasets

Requirements

• Level: mid
• Remote policy: onsite

From the employer’s posting

ABOUT PLAUD INC. Plaud is building the world's most trusted AI work companion for professionals to elevate productivity and performance through note-taking solutions, loved by over 1,500,000 users worldwide since 2023. With a mission to amplify human intelligence, Plaud is building the next-genera…