Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add support for bytedance's doubao #1438

Merged
merged 4 commits into from
Jun 8, 2024

Conversation

klb3713
Copy link
Contributor

@klb3713 klb3713 commented May 16, 2024

close #1436

我已确认该 PR 已自测通过,相关截图如下:
image

@zsinba
Copy link

zsinba commented May 18, 2024

闪退
image

@RexWzh
Copy link

RexWzh commented May 18, 2024

调用和 Azure 类似,是需要部署才能用对吗?

是的话,这段配置好像就没意义了,curl 命令里也没用到模型

var ModelList = []string{
	"Doubao-pro-128k",
	"Doubao-pro-32k",
	"Doubao-pro-4k",
	"Doubao-lite-128k",
	"Doubao-lite-32k",
	"Doubao-lite-4k",
	"Doubao-embedding",
}

另外, 你代码好像只改了 ChatCompletions 的 URI。

if meta.Mode == relaymode.ChatCompletions {
		return fmt.Sprintf("%s/api/v3/chat/completions", meta.BaseURL), nil
	}

@c121914yu
Copy link
Contributor

我建议给oneapi增加一个 /chat/complections 的路由,而不只有 /v1/chat/completions 的路由。
豆包的接口对齐了 openai,,完全可以直接通过代理转发解决~

@XiandanErizo
Copy link

mark一下 合并了我也更新下

@songquanpeng
Copy link
Owner

上周末完全没时间,我尽量最近处理

@Lands-1203
Copy link

请问这个docker发布了吗?
版本:v0.6.7-alpha.3没看见豆包的模型列表

@songquanpeng songquanpeng changed the title 增加豆包大模型支持 feat: add bytedance's doubao support Jun 8, 2024
@songquanpeng songquanpeng changed the title feat: add bytedance's doubao support feat: add support for bytedance's doubao Jun 8, 2024
@songquanpeng songquanpeng merged commit 98669d5 into songquanpeng:main Jun 8, 2024
@songquanpeng
Copy link
Owner

已合并,感谢各位

@songquanpeng
Copy link
Owner

v0.6.7-alpha.4

@Lands-1203
Copy link

@songquanpeng 似乎不行呢? 我是用postman正常发送,使用oneapi就不行,不管是使用代理的方式 还是直接的方式都不行
image

image
image

@Lands-1203
Copy link

一直提示react_devtools_backend_compact.js:12955 do request failed: Post "https://ark.cn-beijing.volces.com/api/v3/chat/completions": dial tcp 101.126.3.201:443: i/o timeout

@xiandan-erizo
Copy link

model ratio not found 这个应该怎么配置?

@MayvkognardCochp6uel9q1mjran

是你用法不对吧。
确认可以正常调用 。

image

配置还是比较简单的。

  1. 豆包的企业认证,获得创建节点的权限
  2. 添加到 one-api
  3. 做模型映射,不然模型名调用时比较麻烦
  4. 尝试调用

确认是 ok 的

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

支持豆包系列大模型API
9 participants