Increase connection Timeout

[shafiqalibhai]

Maybe add a variable in settings to change the default timeout setting.

[adamierymenko]

Seconded, since sometimes the initial load of the model into Ollama times out for big models and you have to re-submit your prompt. Once it's "warmed up" it's fine.

Maybe there's an alternative way for the program to see if Ollama is still running and just taking a long time to respond.

[haydonryan]

Totally agree on this. timeout needs to be increased.

[egaralmeida]

This is importart for folks with low end hardware. I agree, should be in the settings.

[adamierymenko]

It's important even for high end hardware if you're using a giant model. Sometimes the initial model load times out and you have to resubmit, after which it works.

[haydonryan]

100% i'm running a 16 core epyc as my LLM machine - it really chugs trying to load mixtral 8x22b even if loading of NVME into ram.