Unfortunately X11 isn’t without issues as well. In my case Wayland runs smoother and is less error prone than X11.

According to the debian wiki support is not fully guaranteed. Might just be that you ran into any of those issues:

Wayland support is still not finished yet though. Notably, there are issues with the compositor taking down other applications with it when it crashes, changing the global theme sometimes causes a session crash, “Activities” are unimplemented, there are various papercuts with drag-and-drop functionality, and session restoration only works with XWayland windows. A full and more regularly-updated list of Plasma Wayland issues can be found here: https://community.kde.org/Plasma/Wayland_Showstoppers

Did you install any non-standard graphics drivers? If your system has an nVidia GPU bumblebee, nouveau and the closed-sourced driver all can cause this issue.

Can you confirm that it’s only the taskbar that freezes? Do any other DE components (e.g. app launcher (shortcut meta + f2 by default)) work or do they freeze/not respond as well?

You could check various logs for errors:

• syslog (/var/log/syslog or dmesg)
• unit files of Plasma components (journalctl -xeu $UNITNAME; e.g. journalctl -xeu sddm.service)

Which DE are you talking about? It sounds like KDE/Plasma but you didn’t specify.

You would need to specify the new port when using ssh (using the -p$PORT option). Just keep in mind that security through obscurity is not considered secure in itself. You could instead consider a service like fail2ban that automatically blocks connections from certain sources depending on your set parameters.