ChocolateGod parent
People may prefer running in environments that match their target production environment, so macOS is out of the question.
The Ubuntu that NVIDIA ship is not stock. They seem to be moving towards using stock Ubuntu but it’s not there yet.
Running some other distro on this device is likely to require quite some effort.
It's a hoop to jump through, but I'd recommend checking out Apple's container/containerization services which help accomplish just that.
You're likely still targeting Nvidia's stack for LLMs and Linux's containers on MacOS won't help you there.