[ engineering ]
Staff / Senior Staff Machine Learning Engineer, Inference - Usa
Inworld.ai- Location
- Remote
- Work mode
- Remote
- Type
- full time
- Listed
Applications go directly to Inworld.ai. Ramai takes no fee for placement and no money for ranking.
[ About this role ]
Staff/Principal Machine Learning Engineer at Inworld.ai focused on serving. This role involves optimizing inference for real-time AI applications, working with LLM serving frameworks, and accelerating models through techniques like quantization and continuous batching.
Skills and focus areas
- inference optimization
- serving frameworks
- model acceleration
- quantization
- distillation
- caching strategies
- continuous batching
- paged attention
- speculative decoding
- high-performance systems
- c++
- cuda
Summary written by Ramai from the original posting. Full details and requirements are on Inworld.ai’s careers page.
[ More at Inworld.ai ]
See all 18 open roles at Inworld.ai →[ Similar roles at other startups ]
- Senior Software EngineerVariance
- Fullstack Software EngineerSirdab
- Member of Technical Staff, Typescript Engineer (principal)Inkeep
- Founding Full Stack Engineer - Llm, Applied Ai (no Prior Llm Experience Required)Berry
- Engineers That Enjoy Hard Things (like Compilers)Boundary
- Forward Deployed EngineerVooma
[ Not quite right? ]
Tell the assistant what you’re after — stage, location, stack, visa sponsorship — and it searches every open role for you. A few questions are free, no account needed.