There is something not right with expecting that artificial intelligence will have the same characteristics as human intelligence. (I am answering to the quote)
I think he's commenting more on the inconsistency of it, rather than the level of intelligence per se.
this. I keep repeating to people to stick to very specific questions with very specific limits and expectations but no... give me 20 pages of phd level text that finds cure for cancer
"There's something still not quite right with the current technology. I think the phrase that's becoming popular is 'jagged intelligence'. The fact that you can ask an LLM something and they can solve literally a PhD level problem, and then in the next sentence they can say something so clearly, obviously wrong that it's jarring. And I think this is probably a reflection of something fundamentally wrong with the current architectures as amazing as they are."
Llion Jones, co-inventor of transformers architecture