Software Engineer- BIS (Baseten Inference Stack)

What this role involves

Baseten is seeking a Software Engineer to join its Inference Stack team, building the distributed runtime for large-scale LLM inference. The role involves developing infrastructure and orchestration systems across the stack, from customer-facing features to low-level components, and requires strong distributed systems and backend engineering skills.

Skills this posting asks for

• kubernetes
• distributed systems
• backend infrastructure
• platform engineering
• dynamo
• vllm
• sglang
• tensorrt-llm
• inference frameworks
• distributed scheduling
• autoscaling
• service orchestration
• gpu
• testing
• release automation
• benchmarking
• networking
• developer experience

From the employer’s posting

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the front…