Senior Software Engineer I, Inference

What this role involves

CoreWeave is hiring a Senior Software Engineer I for its inference platform team. The role involves leading architecture, optimizing inference performance, and ensuring reliability at scale. Required experience includes distributed systems, Kubernetes, and inference frameworks such as vLLM or Triton.

Skills this posting asks for

• python
• go
• c++
• kubernetes
• ci/cd
• prometheus
• grafana
• opentelemetry
• inference internals
• batching
• caching
• mixed precision
• bf16
• fp8
• streaming token delivery
• vllm
• triton
• tensorrt-llm
• ray serve
• torchserve
• cuda
• nccl
• sharp
• rdma

Requirements

• 3 years of experience
• Level: senior

From the employer’s posting

CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of…