It doesn’t work like that. An OS is like a Vehicle frame. It can look very sporty and behave very stable and safe in motion. But the engine (hardware) and the fuel (drivers) are the key factors for the performance. If those are mediocre, don’t expect to win a race.

Your GPU is great, but unfortunately nvidia doesn’t put much effort into their linux driver. And their proprietary driver is the only viable option at the moment. Their support website confirms the constant issue reports linux users have with nvidia drivers. So expect issues in games and performance loss in comparison to nvidia’s windows driver.