In case anyone cares, I found that Google Calendar has the Time Insights feature which helps a lot with this https://support.google.com/calendar/answer/10738043?hl=en&vi.... Colored labels makes it very easy to see at a glance how much time you spend on things.

If you don't use Google Calendar I'm not sure what to suggest, except to create a different calendar for each label, and export the data into a csv and visualize it in Excel or something?