Senior Software Engineer - AI Infrastructure
Core
Design and implement on-premise Compute as a Service (CaaS) and GPU as a Service (GPUaaS) platforms and a cloud-integrated marketplace for deploying applications onto bare metal Kubernetes clusters.
Role type
Senior Software Engineer (AI Infrastructure)
Builds
Scalable on-premise CaaS/GPUaaS infrastructure and application deployment marketplaces
Domain
Edge AI infrastructure, bare metal computing, cloud-native technologies
Deliverable
production ML models | infrastructure
Required skills
Kubernetes, Docker, containerd, hypervisors (KVM), GPU virtualization (Kubevirt, vGPU), Python, Go, Java, Terraform, Ansible, cloud platforms (AWS, Azure, GCP), marketplace design, bare metal infrastructure management
Preferred skills
High-performance computing (HPC), distributed storage systems, CI/CD pipelines, security best practices
Responsibilities
Architect and implement scalable CaaS/GPUaaS platforms on bare metal clusters; develop monitoring, logging, and alerting systems; optimize performance and resource utilization; design and build cloud-integrated marketplace backend services and APIs; integrate marketplace with existing cloud services; write clean, tested, and maintainable code
Seniority
Senior, hands-on IC