[ engineering ]
Senior / Lead Machine Learning Engineer, Inference - Germany
Inworld.ai- Location
- Remote
- Work mode
- Remote
- Type
- full time
- Listed
Applications go directly to Inworld.ai. Ramai takes no fee for placement and no money for ranking.
[ About this role ]
Senior/Lead Machine Learning Engineer focused on serving at Inworld.ai. This role involves optimizing inference for real-time AI applications, working with LLM serving frameworks, and accelerating model performance through techniques like quantization and speculative decoding.
Skills and focus areas
- inference optimization
- serving frameworks
- model acceleration
- quantization
- distillation
- caching strategies
- continuous batching
- paged attention
- speculative decoding
- high-performance systems
- c++
- cuda
Summary written by Ramai from the original posting. Full details and requirements are on Inworld.ai’s careers page.
[ More at Inworld.ai ]
See all 18 open roles at Inworld.ai →[ Similar roles at other startups ]
- Tech LeadSalaryBox
- Senior Software EngineerOneSchema
- Software EngineerQuill
- Founding EngineerAspect
- Founding Gtm Engineer · Ex-founders Only (remote)Dot
- Senior Site Reliability Engineer (systems Engineer Iii)Ophelia
[ Not quite right? ]
Tell the assistant what you’re after — stage, location, stack, visa sponsorship — and it searches every open role for you. A few questions are free, no account needed.