The extra security aspect seems important, but the browser shouldn't just drop the user's previous history (for that tab) just because it's isolating things. :/
Hopefully this is just a case of "early stage feature" and bugs like this will be fixed. :)
I quite like having that on by default.