I tried it once, and I couldn't run RAG without the GPU either (only using external APIs). Considering that they pull all the heavy deps even with the local compute flags disabled, I assume this is just a poorly supported case. Which is really unfortunate.