Token Limit

[PyT1m]

Would it be possible to implement a token limiter for each chatbot. In another thread there was the suggestion to implement bot statistics as an enhancement. Maybe you could combine it with the token limiter?

[n4ze3m]

Hey, are you suggesting a max token length for each bot, right?

[comeback01]

I think that for each rebot, we should be able to adjust:

token context
max token
Temperature
Top_P
Top_K
Penalty

This really changes the answers

[n4ze3m]

The existing version supports temperature; you can change it in the settings. I will add the reset of the configuration

[PyT1m]

For example fastbots offers plans like: 5000 Messages P/M | 15,000,000 characters/bot. So they have implemented a limit on tokens to spend per month somehow. That was my idea of a token-limitation.

[comeback01]

This must be done at provider level.

A key leaves rebot, with a limit.

The only one I've seen that offers this is https://openrouter.ai.

They even have free templates!

[PyT1m]

Ah okay, I see. And would it be possible to integrate openrouter.ai (openrouter.api) and the limits in dialoqbase?