If you want to enjoy your 2gbps over the wire then yes, you’ll need a switch with 2.5gbps ports and, equally important, the appropriate switching capacity.
I’m emphasising that second part because there are switches with 1gb ports but lower switching capacity, leading to a bottleneck that people don’t always expect.