Software Engineer, Cloud

What this role involves

Ollama is seeking a Software Engineer to build its cloud inference platform, focusing on scalable distributed systems for serving open models. The role involves designing routing and capacity layers, owning multi-tenant infrastructure, and ensuring reliability and cost controls. Ideal candidates have experience with high-throughput, low-latency systems, Kubernetes, and GPU scheduling.

Skills this posting asks for

• kubernetes
• gpu scheduling
• inference infrastructure
• distributed systems
• high-throughput
• low-latency
• traffic routing
• real-time data pipelines
• large-scale apis
• reliability
• observability
• cost controls
• capacity planning
• billing
• metering

From the employer’s posting

Ollama is the most popular way for developers to access open models. What started as an open-source, local-first runtime is now the largest developer network in the open-model ecosystem: 8.9 million monthly active developers and over 67,000+ community-built integrations. We're backed by Y Combinato…