I think it works fine like it is. Things easily get on the frontpage so they can get some exposure, but they only stay there if enough people continue to vote for it. If someone flags it, it also disappears quicker.

The value is not about how fast it gets to the frontpage, but about how long time it lasts there.