You could make the opposite argument: the "right kind of stories" includes being unpredictable (https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que...), so up-weighting votes from users who are good at picking those would lead to a less predictable, more interesting front page. Conversely, the median vote tends to be for the same few hot topics, leading to a more samey (as well as more sensational) front page.

My bet is that it wouldn't change much either way, because the problems with voting seem to flow from the voting mechanism itself, not from which users are doing it. Internet upvoting is the ultimate reflexive reaction, which excludes reflection, and reflection—the slower cognitive process which considers something before reacting to it and is thus able to see something new—is the quality that picks up on uncorrelated bits and makes for good taste. (https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que...)

If that's true, then instead of trying to squeeze more signal out of upvotes we should add a new mechanism that encourages reflection over reflexivity. Flagging is closer to that than voting is, so something like an up-flag might be worth trying: i.e. "this deserves extra attention because of how good it is".