Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
max_tokens for llama 3.1 models must be less than or equal to 8000 but it is set to 8192. just change it to 8000 and the error is fixed.
- Loading branch information