[ engineering ]

Staff + Senior Software Engineer, Inference

Anthropic
Location
Ontario, Can
Work mode
Remote
Type
full time
Listed

Applications go directly to Anthropic. Ramai takes no fee for placement and no money for ranking.

[ About this role ]

Staff + Senior Software Engineer, Inference at Anthropic. This role involves designing, building, and maintaining distributed systems for serving Claude to millions of users. Responsibilities include developing resilient systems, intelligent request routing, load balancing, and maximizing compute efficiency across diverse AI accelerators.

Skills and focus areas

  • distributed systems
  • inference
  • request routing
  • load balancing
  • traffic management
  • autoscaling
  • orchestration
  • deployment pipelines
  • performance sensitive systems
  • fleet management

Summary written by Ramai from the original posting. Full details and requirements are on Anthropic’s careers page.

[ More at Anthropic ]

See all 675 open roles at Anthropic →

[ Similar roles at other startups ]

Browse all open engineering roles →

[ Not quite right? ]

Tell the assistant what you’re after — stage, location, stack, visa sponsorship — and it searches every open role for you. A few questions are free, no account needed.