Time for GPU and Kubernetes, the idea is to provide an instance group with Kubernetes' nodes with GPU, also to save some money we can start the autoscaling group from 0 instances.
The environment
- AWS
- G4DN instances also tested on P2 instances
- Kubernetes 1.18 deployed via Kops
- Cluster Autoscaler 1.18
- GPU Operator