Because very few hot particles ever touched the craft. The gas is so incredibly thin that Voyager largely sailed straight through the space in between molecules.