Skip to content

Releases: xusenlinzy/api-for-open-llm

latest

08 Jun 01:16
Compare
Choose a tag to compare
  • 升级vllm版本

  • 支持GLM4和QWEN2系列模型

latest

19 Jan 04:20
Compare
Choose a tag to compare

some fix

latest

27 Dec 06:50
Compare
Choose a tag to compare
api-for-open-llm-v1.0.3

Fix embedding truncation

api-for-open-llm-v1.0.2

01 Dec 02:41
Compare
Choose a tag to compare
  • Add support for llama-cpp-python

  • Add DeepSeek, Yi template

  • Refactor project

api-for-open-llm-v1.0.1

15 Nov 14:35
Compare
Choose a tag to compare

api-for-open-llm-v1.0.0

10 Nov 09:54
b74fdba
Compare
Choose a tag to compare

openai>=1.2.0

api-for-open-llm-v0.0.5

09 Nov 06:48
Compare
Choose a tag to compare

master分支

openai<=0.28.0

api-for-open-llm-v0.0.4

07 Sep 09:40
Compare
Choose a tag to compare
  • Update streamlit demo

  • Add support for repetition penalty

  • Add support for baichuan2 models

api-for-open-llm-v0.0.3

22 Aug 07:23
Compare
Choose a tag to compare
Update vllm arguments

api-for-open-llm-v0.0.2

15 Aug 07:40
Compare
Choose a tag to compare
  • 启动方式参数改为设置环境变量

  • 修改 api 代码结构