[ engineering ]
Member of Technical Staff, Evals
Profound- Location
- Not specified
- Work mode
- On-site
- Type
- full time
- Listed
Applications go directly to Profound. Ramai takes no fee for placement and no money for ranking.
[ About this role ]
Member of Technical Staff, Evals at Profound. This role owns the AI evaluation system, building datasets, scorers, LLM judges, and programmatic verifiers. The engineer will write evals for various product pipelines, define quality metrics for AI Marketer runs, and analyze answer engine behavior to ensure trustworthy customer-facing numbers.
Skills and focus areas
- llm evaluation
- data analysis
- programmatic verification
- regression testing
- dashboarding
- sampling
- statistics
- debugging
- labeling workflows
- annotation
Summary written by Ramai from the original posting. Full details and requirements are on Profound’s careers page.
[ More at Profound ]
See all 83 open roles at Profound →[ Similar roles at other startups ]
- Senior Software Engineer - Ios - ParisSorare
- Senior Engineering ManagerImprint
- Staff Machine Learning Engineer (platform)Neara
- Senior Engineering Manager, Cloud InfrastructureValon
[ Not quite right? ]
Tell the assistant what you’re after — stage, location, stack, visa sponsorship — and it searches every open role for you. A few questions are free, no account needed.