If you don’t mind moving away from the VNC protocol, the NX protocol (via NoMachine¹) is a fantastic alternative. Faster than VNC and can forward audio from the server to the client as well.

――――――

¹ — https://en.wikipedia.org/wiki/NX_technology