[ engineering ]

Software Engineer, Runtime

Ollama
Location
Not specified
Work mode
On-site
Type
full time
Listed

Applications go directly to Ollama. Ramai takes no fee for placement and no money for ranking.

[ About this role ]

Software Engineer, Runtime at Ollama. This role focuses on the core local runtime that enables developers to run open models on their own machines. Responsibilities include optimizing model performance, managing memory, driving GPU acceleration across various hardware, and integrating new model architectures and formats.

Skills and focus areas

  • runtime development
  • gpu acceleration
  • model loading
  • memory management
  • quantization
  • inference engines
  • macos
  • linux
  • windows
  • open source development
  • community engagement

Summary written by Ramai from the original posting. Full details and requirements are on Ollama’s careers page.

[ More at Ollama ]

Get up and running with large language models.

See all 7 open roles at Ollama →

[ Similar roles at other startups ]

Browse all open engineering roles →

[ Not quite right? ]

Tell the assistant what you’re after — stage, location, stack, visa sponsorship — and it searches every open role for you. A few questions are free, no account needed.