AI Infrastructure Engineer
Core
Design, build, and operate on-prem infrastructure that behaves like a cloud environment for internal teams, including AI/ML workloads.
Role type
Senior Infrastructure Engineer (On-Prem/Hardware)
Builds
On-prem datacenter infrastructure, containerized workloads, and AI infrastructure tooling.
Domain
Hardware infrastructure, On-prem datacenter operations, AI/ML infrastructure
Deliverable
infrastructure
Required skills
Infrastructure-as-Code, On-prem/datacenter operations, Networking fundamentals, Containerization and orchestration, Scripting and automation, Hardware troubleshooting
Preferred skills
GPU scheduling, Model serving infrastructure, Self-hosted AI tooling
Technologies
Terraform, Ansible, HashiCorp Vault, Keycloak, Prometheus, Grafana, Docker, Kubernetes
Responsibilities
Design and maintain networking infrastructure (VLANs, routing, firewalls), Deploy and manage containerized workloads, Provide general datacenter support (cabling, hardware swaps), Write scripts/tools to automate operational toil, Develop and deploy AI infrastructure workloads on-prem.
Seniority
Senior, hands-on IC
