[ engineering ]

Software Engineer, Cloud

Ollama
Location
Not specified
Work mode
On-site
Type
full time
Listed

Applications go directly to Ollama. Ramai takes no fee for placement and no money for ranking.

[ About this role ]

Software Engineer, Cloud at Ollama will build and scale the company's cloud inference platform. Responsibilities include designing routing and capacity layers, owning multi-tenant infrastructure, and building reliability and cost controls for a distributed systems environment.

Skills and focus areas

  • high-throughput distributed systems
  • low-latency distributed systems
  • inference serving
  • traffic routing
  • real-time data pipelines
  • large-scale apis
  • cost/performance tradeoffs
  • production service ownership
  • kubernetes
  • gpu scheduling
  • inference infrastructure
  • reliability

Summary written by Ramai from the original posting. Full details and requirements are on Ollama’s careers page.

[ More at Ollama ]

Get up and running with large language models.

See all 7 open roles at Ollama →

[ Similar roles at other startups ]

Browse all open engineering roles →

[ Not quite right? ]

Tell the assistant what you’re after — stage, location, stack, visa sponsorship — and it searches every open role for you. A few questions are free, no account needed.