Software Engineer- Benchmarking
Office Hours · San Francisco, NYC, or Fully Remote
- Posted
- 6 days ago
- Last confirmed live
- Today
What this role involves
Office Hours is seeking a Software Engineer to build and run the platform behind AI model evaluations. The role involves preparing benchmark datasets, building evaluation pipelines and environments, and developing tools for analysis and publication. The position requires 4+ years of experience with strong Python and Docker skills, and can be based in San Francisco, NYC, or remote.
Skills this posting asks for
- python
- docker
- llm
- data pipelines
- containerization
- benchmarking
- evaluation
- fine-tuning
- html
- data cleaning
Requirements
- 4 years of experience
- Level: mid
- Remote policy: remote
From the employer’s posting
SOFTWARE ENGINEER, BENCHMARKING (SF, NYC, OR REMOTE) ABOUT US Office Hours is an on-demand expert network that connects leading organizations with trusted experts across various knowledge domains. Experts earn income by sharing their knowledge through advisory work, projects, and AI model traini…
Read the full description on Office Hours’s careers pageApply without filling the form
Approve this role and the application is completed for you, including a résumé tailored to it. You get a confirmation when it lands, and a credit is only spent when a submission is confirmed.
Other roles at Office Hours
- Software Engineer, Full StackRemote
- Senior Software Engineer, Search & DiscoverySan Francisco, NYC, or Fully Remote
- Senior IOS Engineer San Francisco, NYC, or Fully Remote
- Platform Engineer Remote