You can dig in bedrock that has no groundwater.

Furthermore, naturally occurring uranium exists in groundwater and needs to be filtered out in places where levels exceed safe limits. So it's not like burying waste is creating a new problem: https://www.kqed.org/stateofhealth/120396/uranium-contaminat...