Kubernets: Introduce prod-ready volume management on AWS clusters

[YuryHrytsuk]

AWS EBS CSI

Preview Give feedback

1. Uniquely Tag EBS to filter them out
2. Configure reasonalbe default type, throughput, iops
3. Enable resizing
4. Add necessary Instance Role Profile

Miscellaneous

Preview Give feedback

1. Clean Up k8s manager after testing
2. Update portainer PV size
3. Remove S3 CSI from AWS Master
4. Clean up S3 Data
5. Think through and comment on Read Write Once limitation of AWS EBS CSI (check this SO thread)
6. Define storage class per deployment

[YuryHrytsuk]

Literature

• Container Storage Interface (CSI)
• Persistent volumes doc
• AWS EBS CSI Driver
• AWS EBS Storage via kubespray
• AWS EBS SCI. Configure parameters in PVC (e.g. throughput)
• AWS EBS SCI. Default parameters in StorageClass
• AWS EBS CSI Driver and ReadWriteMany PV access mode

Our issues in kubespray repo

• Extend Configuration of AWS EBS SCI StorageClass kubernetes-sigs/kubespray#11823

[YuryHrytsuk]

Multi-Replicated Statefulset and PVs

• https://stackoverflow.com/questions/72250853/what-happens-when-we-create-stateful-set-with-many-replicas-with-one-pvc-in-kube