-
Notifications
You must be signed in to change notification settings - Fork 37
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
support remained RPM/TPM as part of returned info #506
Comments
|
wish sdk support this feature, provide global RPM/TPM remained info.
|
将"X-Ratelimit-Remaining-Requests" ,"X-Ratelimit-Remaining-Tokens",保存在 ChatCompletion, Completion 等结构体中, |
感谢反馈。
|
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Feature request
refer to https://cloud.baidu.com/doc/WENXINWORKSHOP/s/Llroa77io
new qianfan http response added two returned params "X-Ratelimit-Remaining-Requests" and "X-Ratelimit-Remaining-Tokens".
wish sdk support this feature, provide global RPM/TPM remained info.
furthermore current java implementation seems support set rpm limit by function "setRpmLimit".
I think it's useful
Furthermore is it possible for baidu to support user app level rpm/tpm setting, as a supplementation of user account level?
contribution or solutions
No response
The text was updated successfully, but these errors were encountered: