Staff/Principal DevOps Engineer, AI Inference

What this role involves

This role focuses on building and optimizing infrastructure for serving machine learning models at scale, including GPU clusters and cloud accelerators. The engineer will work on Kubernetes-based inference platforms, model serving frameworks, and observability systems. Collaboration with ML engineers and research scientists is key.

Skills this posting asks for

• kubernetes
• gpu
• aws
• terraform
• helm
• python
• vllm
• triton inference server
• tgi
• nvidia
• aws inferentia
• aws trainium
• docker
• cuda
• nccl
• rust
• go

Requirements

• Level: staff

From the employer’s posting

Your Impact at LILA The Staff/Principal DevOps Engineer - AI Inference will drive the design, implementation, and optimization of infrastructure purpose-built for serving machine learning models at scale. This role bridges platform engineering, site reliability, and ML in…