Then why did Apple have a $20B a year search deal with Google?
The argument can be made that when people search Google they know they are using Google but when they use Siri they assume that their data is not going to Google. I think this is more likely to be solved contractually than having Gemini running on a datacenter full of M5 Ultra servers.
It's very simple: Apple absolutely refuses to send all their user data to Google.