Yeah nice strawman, but theres been plenty of leaked chats with ChatGPT (just stuff that's been set to public accidentally) that are so obviously "private" in nature that its not funny.
Sorry but, humans have a right to privacy beyond your dislike of the services they use.
You clearly have an emotional connection to people that you feel are being harmed by AI, so I’m not going to gaslight you about that.
But I will tell you that real humans asking private, real questions of LLMs is also happening, and these two things aren’t related. Many people who don’t have the technical literacy to understand the implications are sending messages with extremely sensitive personal, medical, and financial information.
Straw-manning all of these users as tech-savvy, horny IP thieves is ridiculous. I could find your argument more persuasive if you actually considered the privacy needs of the people who had nothing to do with building or perpetuating the systems.
EDIT: to be clear I’m not sure what I think the solution should be, as I also understand the need for discovery.
Real human beings actual real work is allegedly being abused to commit fraud at a massive scale, robbing those artist of the ability to sustain themselves. Your false perception of intimacy while asking the computer Oracle to write you smut does not trump the fair and just discovery process.