I was thinking about migrating my services to self management k8s cluster, mostly for education purposes. I have some low traffic services running on one dedicated server on Scaleway now - there’s some nextcloud, portainer, hastebin (sort of pastebin) mysql database, personal wiki, couple of half-dead blogs, stuff like that. Nothing resources heavy, nothing that needs tight SLA. I plan to add a little of my own software anytime soon, but I don’t expect it to be very needy as well.
I’m planning on going with 3 nodes with min. 2 cores and 4 GB of RAM, and an additional service for storage. Does anyone here had experience with self hostes kubernetes? Do you have any advices? Do you think nodes like these are enough or I should upgrade (or downgrade)? Can you reccomend some providers that could offer this setup at low cost?
I used k3s and use the same node as master and runner. I started off with 3 nodes like you are planning, but soon discovered they for home use it just adds overhead in keeping up to date and backing up, and I had to find some way of doing persistent storage without standing up yet another VM as a NFS host, so downsized to a single node.
I’ve three rPi4 8Gb models running K3S with each node being both worker and control plane - works very well and I use keepalived and HAproxy to ensure the control plane remains available if any of the raspberry PIs need to reboot.
I’ve a Helios NAS running NFS for shared storage across all of the nodes.
It’s all reasonably low power but it has enough capacity to run a bunch of containers for media handling etcetera.