"Workflow" is the aspect we should try to eliminate, and a LLM+VM combo allows you to do that. Workflow means you provide tools to the LLM, and ask to make use of them to achieve the goal. This works well already, but it fails whenever an unusual problem appears that is not covered by your predefined set of tools. Another issue is that the workflow based approach is always linear even if it is a DAG, or even if you have some kind of loop.

The next step is to not provide any tools to the LLM, and ask it to invent them on-the-fly. Some problems need to be brute-forced.