I use uBlock Origin with Firefox on Linux, and it seems like that delay happens maybe on 30% of the YouTube videos for me, with no rhyme or reason to which ones. And reloading the same video multiple times show consistent behavior if it loads fast/slow, not sure what's going on.