I've had a couple of times where Gemini straight up tells me "Absolutely not, ..." and the explains how my assumptions are wrong and eventually leads me to find the right answer.
It's surprisingly good at reading my entire code, reading my assumptions of the code, and explaining what I'm getting wrong and how to fix it.
tmdh
After Gemini gave an answer, i asked, "convert to latex". Then it asked, "To convert what to LaTeX?". Every other LLM would know what I wanted.
godelski
I've had GPT do the same thing but lead me to the wrong answer. Usually through some subtle mistake. So the answer looks right but hey, literally the difference between an expert and amateur is understanding subtlety
It's surprisingly good at reading my entire code, reading my assumptions of the code, and explaining what I'm getting wrong and how to fix it.