Member of Technical Staff - Inference
Hyperbolic- Location
- Not specified
- Work mode
- On-site
- Type
- full time
- Listed
Applications go directly to Hyperbolic. Ramai takes no fee for placement and no money for ranking.
[ About this role ]
This is a Staff Inference Engineer role at Hyperbolic. The engineer will build and own inference capabilities on top of Forge, their unified control plane, enabling customers to consume model tokens without managing GPUs. Responsibilities include deploying and serving models across distributed clusters on heterogeneous hardware, evaluating inference frameworks, and setting up monitoring, gateways, and endpoints.
Skills and focus areas
- inference
- kubernetes
- production cluster operation
- inference performance concepts
- ttft
- disaggregated inference
- speculative decoding
- kv cache orchestration
- autoscaling
- customer inference debugging
- distributed systems
Summary written by Ramai from the original posting. Full details and requirements are on Hyperbolic’s careers page.
[ More at Hyperbolic ]
See all 18 open roles at Hyperbolic →[ Similar roles at other startups ]
- Mechanical Hardware EngineerSeeing Systems
- Forward Deployed EngineerGreenlite
- Founding Product EngineerVOYGR
- Software Engineer (toronto)Strada
- Member of Technical Staff (models)Jarmin
- Product Engineer (full-stack)Karumi
[ Not quite right? ]
Tell the assistant what you’re after — stage, location, stack, visa sponsorship — and it searches every open role for you. A few questions are free, no account needed.