TazeTSchnitzel parent
I've seen LLMs claim that a text cuts off mid-sentence before in cases where it in fact doesn't, and I think this might be an artifact of them being presented with a truncated version by some unclear software process, perhaps to fit into a context window. In this case, however, it's unlikely that the LLM was presented the text directly, and rather it is recounting things it “knows”.
I was trying out an IDE plugin for local LLM integration, but it would just make totally insane edits instead of what I asked for.
It turned out that the LLM-runner's default setting for handling queries that were too long was to silently delete the middle of the query. So the LLM saw the beginning of my ask, and the tail end of the code context, and nothing else.