[ engineering ]

Staff / Senior Staff Machine Learning Engineer, Inference - Uk

Inworld.ai
Location
Remote
Work mode
Remote
Type
full time
Listed

Applications go directly to Inworld.ai. Ramai takes no fee for placement and no money for ranking.

[ About this role ]

Staff/Principal Machine Learning Engineer at Inworld.ai focused on serving. This role involves deep understanding of inference optimization, modern serving frameworks, and model acceleration techniques like quantization, distillation, and continuous batching. Requires proficiency in high-performance systems and languages such as C++, CUDA, Rust, or highly optimized Python.

Skills and focus areas

  • inference optimization
  • serving frameworks
  • model acceleration
  • quantization
  • distillation
  • caching strategies
  • continuous batching
  • paged attention
  • speculative decoding
  • high-performance systems
  • c++
  • cuda

Summary written by Ramai from the original posting. Full details and requirements are on Inworld.ai’s careers page.

[ More at Inworld.ai ]

See all 18 open roles at Inworld.ai →

[ Similar roles at other startups ]

Browse all open engineering roles →

[ Not quite right? ]

Tell the assistant what you’re after — stage, location, stack, visa sponsorship — and it searches every open role for you. A few questions are free, no account needed.