[Bug] The values for completion_tokens and prompt_tokens appear to be reversed, differing from those returned in vllm. #4403
Description
Contact Information
MaxKB Version
v2.1.0 pro
Problem Description
Request VLLM, set max tokens to 1000:
Request maxkb, set max token to 1000:
Steps to Reproduce
Interfacing with VLLM, Q&A
The expected correct result
No response
Related log output
Additional Information
No response
Metadata
Metadata
Assignees
Labels
No labels