Is the router wireless too? If so I would connect my phone to it and when you get an outage on a computer, check if your wifi is working. If it is, it’s something in the hardwired components. But if the Internet connection drops on wifi too, you know it’s somewhere in the router or past that to the external network. Have you power cycled your network equipment? Any chance you have a laptop handy? You can test right at the switch or at the router when your computers drop.This will help narrow down where to look further.
There is a section here on dual booting using systemd boot. Never used it, but it will hopefully work in your case, or at least point you the right way.https://ostechnix.com/dual-boot-windows-and-pop-os/