[Feature]: 如何连接LMstudio？

[wjxxyz]

Class | 类型

大语言模型

Feature Request | 功能请求

我使用的是qwen1.5 32b，使用LMstdio启动并暴露接口，如果我想连接他，我应该调整哪些参数

Example: reuse your existing OpenAI setup

from openai import OpenAI

Point to the local server

client = OpenAI(base_url="http://localhost:12345/v1", api_key="lm-studio")

completion = client.chat.completions.create(
model="Qwen/qwen1_5-14b-chat-q2_k",
messages=[
{"role": "system", "content": "Always answer in rhymes."},
{"role": "user", "content": "Introduce yourself."}
],
temperature=0.7,
)

print(completion.choices[0].message)