[ engineering ]
Software Engineer, Training/inference (c++)
xAI- Location
- Seattle, WA
- Work mode
- Remote
- Type
- full time
- Listed
Applications go directly to xAI. Ramai takes no fee for placement and no money for ranking.
[ About this role ]
Software Engineer - Training/inference (c++) at Cabana in Palo Alto, California. This role involves designing and optimizing large-scale model serving systems, including distributed infrastructure and low-level optimizations for high-performance inference.
Skills and focus areas
- distributed systems
- model serving
- load balancing
- auto-scaling
- batch scheduling
- kv cache
- gpu kernels
- quantization
- speculative decoding
- tail latency
- concurrency
- communication skills
Summary written by Ramai from the original posting. Full details and requirements are on xAI’s careers page.
[ More at xAI ]
See all 117 open roles at xAI →[ Similar roles at other startups ]
Browse all open engineering roles →[ Not quite right? ]
Tell the assistant what you’re after — stage, location, stack, visa sponsorship — and it searches every open role for you. A few questions are free, no account needed.