[ engineering ]
Staff Software Engineer - Genai Inference
Databricks- Location
- San Francisco, California
- Work mode
- Remote
- Type
- full time
- Listed
Applications go directly to Databricks. Ramai takes no fee for placement and no money for ranking.
[ About this role ]
Staff Software Engineer for GenAI Inference at Databricks. This role leads the architecture, development, and optimization of the inference engine powering the Databricks Foundation Model API, focusing on high throughput, low latency, and robust scaling for large-scale LLMs.
Skills and focus areas
- genai inference
- large language models (llms)
- inference engine architecture
- model serving
- performance optimization
- latency reduction
- throughput optimization
- memory efficiency
- gpu utilization
- accelerator utilization
- instrumentation
- profiling
Summary written by Ramai from the original posting. Full details and requirements are on Databricks’s careers page.
[ More at Databricks ]
See all 901 open roles at Databricks →[ Similar roles at other startups ]
Browse all open engineering roles →[ Not quite right? ]
Tell the assistant what you’re after — stage, location, stack, visa sponsorship — and it searches every open role for you. A few questions are free, no account needed.