[ engineering ]
Member of Technical Staff (evals)
Jarmin- Location
- San Francisco, California, Us
- Work mode
- On-site
- Type
- full time
- Listed
Applications go directly to Jarmin. Ramai takes no fee for placement and no money for ranking.
[ About this role ]
Member of Technical Staff on Evals at Jarmin, responsible for measuring AI Employee performance. This role involves owning evaluation systems, feedback loops for models and agents, and autonomous failure analysis, defining metrics for good, degraded, and failed runs.
Skills and focus areas
- evaluation systems
- measurement systems
- experimentation
- ranking
- search quality
- software engineering
- production systems
- llm systems
- data instincts
- autonomous failure analysis
- regression alerts
Summary written by Ramai from the original posting. Full details and requirements are on Jarmin’s careers page.
[ More at Jarmin ]
24/7 Machine Learning Engineer employees
See all 7 open roles at Jarmin →[ Similar roles at other startups ]
Browse all open engineering roles →[ Not quite right? ]
Tell the assistant what you’re after — stage, location, stack, visa sponsorship — and it searches every open role for you. A few questions are free, no account needed.