Yesterday, I accidentally removed an authenticator app from my phone. Fortunately, I have another copy of the app on a different device. It made me realize how easy it is to lock myself out of my accounts. Do you think it’s a good idea to create a Windows VM with an Android emulator on it and install copies of all my authenticator apps, this will not cause any security issues?
Instead of an android emulator, you could self-host a 2FA web app like https://github.com/Bubka/2FAuth
I think that would be the best option for what the OP is looking for. A web accessible version for OTP codes. Problem is then you have to protect that page somehow. That repo shows it can use Yubikeys for AuthN, which IMO is the best way to protect it.
I personally put my TOTP seeds in Vaultwarden. Then they sync over to whatever device I’m on. Just protect your Vault login however you need per device.