There should be a way to leave a private channel but rejoin it at any time, so that it’s included in search results.

But then again that’s solving a problem that shouldn’t exist if there is no performance penalty from joining many channels. It doesn’t seem like there is, either. I haven’t had an issue just hiding everything under the “Stale” category.