Running Ollama with LLama3 and Phi3

[arhaang13]

Hello,

I wanted to open the issue when using taskweaver with Ollama, run on the local machine, none of the models provided within Ollama are functional.

The way I configured the taskweaver_config.json is:

When I try running Ollama with phi3, the output that I get is:

The same issue occurs when configuring taksweaver with Llama3 in the same way.

I hope to hear back!

Best,
Arhaan

[liqul]

The problem is not with Ollama, but the capability of the model served with Ollama. The model failed in following the instructions in the prompt to generate a response in the correct format. Phi3 is typically too small to generate a right response.