Okay let me lay out my thought process here...
Short story long... Been collecting parts for a long time, the Pi 5 8GB units were supposed to originally be a 2 node cluster, and 2 workstations, one mobile in my RV, and one at home.
Well the 16GB model came out, I had extra NVMEs, and simply added the PSUs and NVME hats at minimal cost...
The rack main parts and inserts for the Pi 5s are printing now. Hopefully my printers will behave themselves and not waste filament...
Let me clue you in to the hardware available and the intended software layout.
Raspberry Pi 5, all of them have Pimoroni NVME bases official coolers and official power supplies...
2 16GB, 1 with 4TB NVME configued with a 12v to 5v 5a buck converter running in my RV set up as a VERY low power but with a usable size screen 28" Samsung with a converter of its own... I am running PiOS 64 bit with all the normal productivity stuff, plus GIMP, KDENLive, and Tuner software for my WinTV USB... The other one same setup but with a 2TB NVME on house power and connected to dual 28" HP monitors.
The remaining 4 are fitted with 2TB NVMEs and will soon be stuffed in a 3D printed rack mount. These will be Kubernetes worker nodes.
The Pi 4Bs were the harder to get ones as they came during the unobtanium period of Raspberry Pi... They are both 4B 8GB with GeekPi active coolers, and power supplies with on / off rocker switches inline.
The first one, the one intended for head node duty, I am continuing to dig and finding what hardware is actually there. Looks like the Micro SD in that is a 1TB. Not 100% comfortable running off of a Micro SD for long periods so might end up throwing one of those Buffalo USB 3.0 / NVME sticks at it. Depends on costs... But for now, stick with the Micro SD. This host is presently an rsyslog server for no clients as the client OSes have been reloaded. I never did get my CasaOS / Plex server installed here...
The other Pi 4B is a CasaOS / Plex / SAMBA server. I only have one non Linux box presently, a Windows 11 Home laptop that I really want to upgrade to Professional so I can get the Active Directory client bits in there...
The idea is pretty simple but complex at the same time let me riddle it out.
The 4 Pi 5 8GB 2TB NVME devices will be wiped / reloaded with Raspberry Pi OS 64 bit lite, configured as Kubernetes Cluster Worker nodes. Just to be cute I guess since they will be worker nodes, I will call them for this example bee1 through bee4.local
The head node pi4 will get wiped / reloaded with Raspberry Pi OS 64 bit lite as the head node. These will be stuffed into the rack mount. Pi 4, then 4 pi 5s in a row, then... Since this will be the head node, let's call it beekeeper.local
I have about 1.5TB of data on the drives on the other Pi 4. Set up the cluster, archive the data over to the cluster insure 100% that I have it there and it is in good shape.
WIth the data safely tucked away on one or more of the worker nodes, wipe and reload the currently occupied Pi 4B and configure it as a NAS. Let's call this one nasty.local.
Hardware wise this pi will be on the far right of the rack, and will have the "Universal mounting trays" and second rack mount immediately underneath it to hold the USB 3.0 hub and external HDDs.
So we will have nasty.local serving up iSCSI storage, beekeeper.local acting as the head node for the kubernetes cluster, and bee1.local through bee4.local doing the heavy lifting, or as much heavy lifting as is needed.
These will all connect to my 24 port existing TrendNet unmanaged gig switch
All of the network, and power cables will be organized and supported via 3D printed cable combs.
Once the NAS is up and exposing storage / shares, move the data back over such that the worker nodes are just bare install OS devices at this point...
Set up the cluster docker / kubernetes, accessing the iSCSI shared storage LUNs so we have common shared cluster storage, and within the containers configure at least the following services.
Plex media server.
Grafana
Loki
snort (or other similar IDS)
samba
mariadb
I am using an Eero Pro router mesh setup. DHCP / DNS and ad blocking on it are in the good enough for home use territory so not going to bother with changing that all up...
Obviously this is going to take some time to finish up...
Short story long... Been collecting parts for a long time, the Pi 5 8GB units were supposed to originally be a 2 node cluster, and 2 workstations, one mobile in my RV, and one at home.
Well the 16GB model came out, I had extra NVMEs, and simply added the PSUs and NVME hats at minimal cost...
The rack main parts and inserts for the Pi 5s are printing now. Hopefully my printers will behave themselves and not waste filament...
Let me clue you in to the hardware available and the intended software layout.
Raspberry Pi 5, all of them have Pimoroni NVME bases official coolers and official power supplies...
2 16GB, 1 with 4TB NVME configued with a 12v to 5v 5a buck converter running in my RV set up as a VERY low power but with a usable size screen 28" Samsung with a converter of its own... I am running PiOS 64 bit with all the normal productivity stuff, plus GIMP, KDENLive, and Tuner software for my WinTV USB... The other one same setup but with a 2TB NVME on house power and connected to dual 28" HP monitors.
The remaining 4 are fitted with 2TB NVMEs and will soon be stuffed in a 3D printed rack mount. These will be Kubernetes worker nodes.
The Pi 4Bs were the harder to get ones as they came during the unobtanium period of Raspberry Pi... They are both 4B 8GB with GeekPi active coolers, and power supplies with on / off rocker switches inline.
The first one, the one intended for head node duty, I am continuing to dig and finding what hardware is actually there. Looks like the Micro SD in that is a 1TB. Not 100% comfortable running off of a Micro SD for long periods so might end up throwing one of those Buffalo USB 3.0 / NVME sticks at it. Depends on costs... But for now, stick with the Micro SD. This host is presently an rsyslog server for no clients as the client OSes have been reloaded. I never did get my CasaOS / Plex server installed here...
The other Pi 4B is a CasaOS / Plex / SAMBA server. I only have one non Linux box presently, a Windows 11 Home laptop that I really want to upgrade to Professional so I can get the Active Directory client bits in there...
The idea is pretty simple but complex at the same time let me riddle it out.
The 4 Pi 5 8GB 2TB NVME devices will be wiped / reloaded with Raspberry Pi OS 64 bit lite, configured as Kubernetes Cluster Worker nodes. Just to be cute I guess since they will be worker nodes, I will call them for this example bee1 through bee4.local
The head node pi4 will get wiped / reloaded with Raspberry Pi OS 64 bit lite as the head node. These will be stuffed into the rack mount. Pi 4, then 4 pi 5s in a row, then... Since this will be the head node, let's call it beekeeper.local
I have about 1.5TB of data on the drives on the other Pi 4. Set up the cluster, archive the data over to the cluster insure 100% that I have it there and it is in good shape.
WIth the data safely tucked away on one or more of the worker nodes, wipe and reload the currently occupied Pi 4B and configure it as a NAS. Let's call this one nasty.local.
Hardware wise this pi will be on the far right of the rack, and will have the "Universal mounting trays" and second rack mount immediately underneath it to hold the USB 3.0 hub and external HDDs.
So we will have nasty.local serving up iSCSI storage, beekeeper.local acting as the head node for the kubernetes cluster, and bee1.local through bee4.local doing the heavy lifting, or as much heavy lifting as is needed.
These will all connect to my 24 port existing TrendNet unmanaged gig switch
All of the network, and power cables will be organized and supported via 3D printed cable combs.
Once the NAS is up and exposing storage / shares, move the data back over such that the worker nodes are just bare install OS devices at this point...
Set up the cluster docker / kubernetes, accessing the iSCSI shared storage LUNs so we have common shared cluster storage, and within the containers configure at least the following services.
Plex media server.
Grafana
Loki
snort (or other similar IDS)
samba
mariadb
I am using an Eero Pro router mesh setup. DHCP / DNS and ad blocking on it are in the good enough for home use territory so not going to bother with changing that all up...
Obviously this is going to take some time to finish up...
Statistics: Posted by dbhosttexas — Mon Jan 27, 2025 3:49 am