Senior/Staff AI Engineer

What this role involves

This role focuses on building and optimizing LLM serving and inference systems for production environments, with an emphasis on performance across GPU and CPU pathways, KV cache, memory, storage, and throughput bottlenecks. The ideal candidate has deep hands-on experience in production AI systems, particularly at the systems layer, and is comfortable working on infrastructure where storage architecture and systems efficiency materially affect AI performance.

Skills this posting asks for

• llm serving
• inference systems
• gpu
• cpu
• kv cache
• memory
• storage
• rag
• retrieval
• distributed systems
• model serving
• caching
• distributed performance
• ai infrastructure
• high-performance systems
• storage platforms

Requirements

• Level: senior

From the employer’s posting

WHAT YOU’LL DO - Build and optimize LLM serving and inference systems for production environments - Improve performance across GPU and CPU pathways - Work on KV cache, memory, storage, and throughput bottlenecks - Design and scale systems that support RAG and retrieval-heavy AI workloads…