[ engineering ]
Ai Qa Trainer - Llm Evaluation - Freelance Project
Agency- Location
- Remote
- Work mode
- Remote
- Type
- contractor
- Listed
Applications go directly to Agency. Ramai takes no fee for placement and no money for ranking.
[ About this role ]
AI QA Trainer for LLM evaluation. This role involves rigorous testing of large language models to ensure their reasoning and reliability. Responsibilities include detecting hallucinations, verifying factual consistency, assessing prompt robustness, and auditing for bias and fairness.
Skills and focus areas
- llm evaluation
- llm safety
- prompt robustness
- data quality assurance
- multilingual testing
- domain-specific testing
- grounding verification
- compliance checks
- hallucination detection
- factual consistency
- prompt injection resistance
- jailbreak resistance
Summary written by Ramai from the original posting. Full details and requirements are on Agency’s careers page.
[ More at Agency ]
Solving Complex Security and Compliance
See all 833 open roles at Agency →[ Similar roles at other startups ]
- Software Engineer - SystemsDoe
- Site Reliability Engineer, Sr. Site Reliability EngineerProve
- Senior Software Engineer, ComputationAurora Solar
- Chief Technology OfficerArtsy
- Staff Technical Program Manager - MobileMX Technologies
- Software Engineer - Full-stackCardless
[ Not quite right? ]
Tell the assistant what you’re after — stage, location, stack, visa sponsorship — and it searches every open role for you. A few questions are free, no account needed.