[ engineering ]

Ml Model Serving Engineer

Sesame
Location
Not specified
Work mode
On-site
Type
full time
Listed
Apply on Sesame’s siteFind roles like this with the assistant

Applications go directly to Sesame. Ramai takes no fee for placement and no money for ranking.

[ About this role ]

ML Model Serving Engineer at Sesame focused on optimizing the serving layer for LLM, speech, and vision models. Responsibilities include partnering with ML infrastructure teams to build a fast, cost-effective, and reliable serving layer, and modifying LLM serving frameworks like VLLM and SGLang.

Skills and focus areas

  • differentiable array computing
  • pytorch
  • machine learning model optimization
  • high throughput serving
  • low latency inference
  • systems programming
  • high-performance server systems
  • performance engineering
  • bottleneck analysis
  • profiling low-level systems code
  • model serving optimization

Summary written by Ramai from the original posting. Full details and requirements are on Sesame’s careers page.

[ More at Sesame ]

See all 23 open roles at Sesame →

[ Similar roles at other startups ]

Browse all open engineering roles →

[ Not quite right? ]

Tell the assistant what you’re after — stage, location, stack, visa sponsorship — and it searches every open role for you. A few questions are free, no account needed.

Search with the assistantBrowse similar roles