[Bug] [LLM]I want to change LLMs via openai-api in GUI not in .env

[Dingzhen778]

Search before asking

• I had searched in the issues and found no similar issues.

Operating system information

Linux

Python version information

3.10

DB-GPT version

main

Related scenes

• Chat Data
• Chat Excel
• Chat DB
• Chat Knowledge
• Model Management
• Dashboard
• Plugins

Installation Information

• Installation From Source

• Docker Installation

• Docker Compose Installation

• Cluster Installation

• AutoDL Image

• Other

Device information

GPU:A6000

Models information

LLM:fine-tuned Qwen-7B&Qwen-72B

What happened

I can just change LLM in .env via openai-api ,only one llm can show in GUI

What you expected to happen

I want to change llm in GUI not in .env,
I have 4-5 LLM to inference at the same time,I want to change llm in GUI
how should i edit .env?I had tried many ways, but only 1 LLM can use

How to reproduce

edit .env
LLM_MODEL=proxyllm
PROXYLLM_BACKEND=Qwen-72B-Chat(other LLMs)
PROXY_SERVER_URL=http://xxxx:xxxx/v1/chat/completions(and other LLMs)

Additional context

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!

[github-actions]

This issue has been marked as stale, because it has been over 30 days without any activity.