It punches through my NAT just fine without third party software.

It's not as simple to make it reliable as it is with Tailscale, but it works

It doesn't universally work without a helper script and a STUN server, though - you need a suitably "friendly" NAT that has reasonably predictable behaviour with respect to port mapping and/or just one side of each pair behind a NAT.