[Feature]: Limit Input/Output Tokens, RP(M/D) Requests per (minute/day)

[imeDevelopers]

We need options to Limit the Input/Output Tokens, RP(M/D) Requests per (minute/day) ..

or notify the user once a specified number of Input/Output Tokens has reached.

also support Multi-Model, if one not works then use the another one to execute the tasks?!

why there's no such things!

it's very logically needed.

[imeDevelopers]

Also the cost limit feature ..

Once I reach $10 for example then notify me or pause the operations if I set such a limit ..

[mamoodi]

Hello. Some configurations are adjustable. You can see the config.toml template

You can also set limits on the LLM end as mentioned in the warning:
https://docs.all-hands.dev/modules/usage/llms

[github-actions]

This issue is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 7 days.

[github-actions]

This issue was closed because it has been stalled for over 30 days with no activity.