Software Engineer - GPU Fabric Observability

What this role involves

Build a first-class observability and root-cause analysis system for GPU fabrics at Baseten. The role involves collecting high-volume signals from network and compute components to diagnose failures in real time. The engineer will own the architecture and work at the boundary between networking and inference software.

Skills this posting asks for

• distributed systems
• networking
• rdma
• infiniband
• roce
• gpu
• gpu fabric
• telemetry
• kubernetes
• observability
• root cause analysis
• anomaly detection
• streaming
• correlation
• high-performance networks
• gpudirect
• prefill
• decode
• kv cache
• scheduler
• serving layer
• inference
• switch
• nic

Requirements

• Level: lead

From the employer’s posting

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the front…