asnyder parent
I see Lobe and Chatbox both have prompt caching toggles, are you referring to something else?
I've mistakenly given Chatbox a new feature, sorry :). In LobeChat, after you select a particular model, it enables a mini-settings menu next to the model that lets you set caching, deep thinking, and thinking token consumption.
Ah that must be new since the last time I tried lobechat
Where do you see that? I can't seem to find it in the web or desktop apps for lobechat.
EDIT: I also don't see it in Chatbox