Vecr parent
That's probably because the model works on tokens and not letters. Depending on what "it" means, the model can use various tokenization methods that you can run on your computer really easily so you can see what it sees.
Sure, but the tokenization should cause problems for the encoding and cipher tasks as well? In addition to that: The odd/even starting letter task should be solvable by only considering tokens since the first letter should fall on the beginning of the token.