[ engineering ]

Ai Qa Trainer - Llm Evaluation - Freelance Project

Agency
Location
Remote
Work mode
Remote
Type
contractor
Listed

Applications go directly to Agency. Ramai takes no fee for placement and no money for ranking.

[ About this role ]

AI QA Trainer for LLM evaluation. This role involves rigorous testing of large language models to ensure their reasoning and reliability. Responsibilities include detecting hallucinations, verifying factual consistency, assessing prompt robustness, and auditing for bias and fairness.

Skills and focus areas

  • llm evaluation
  • llm safety
  • prompt robustness
  • data quality assurance
  • multilingual testing
  • domain-specific testing
  • grounding verification
  • compliance checks
  • hallucination detection
  • factual consistency
  • prompt injection resistance
  • jailbreak resistance

Summary written by Ramai from the original posting. Full details and requirements are on Agency’s careers page.

[ More at Agency ]

Solving Complex Security and Compliance

See all 833 open roles at Agency →

[ Similar roles at other startups ]

Browse all open engineering roles →

[ Not quite right? ]

Tell the assistant what you’re after — stage, location, stack, visa sponsorship — and it searches every open role for you. A few questions are free, no account needed.