Skip to content

[Bug] The values for completion_tokens and prompt_tokens appear to be reversed, differing from those returned in vllm. #4403

@fit2cloud-mahaoyu

Description

@fit2cloud-mahaoyu

Contact Information

haoyu.ma@fit2cloud.com

MaxKB Version

v2.1.0 pro

Problem Description

Request VLLM, set max tokens to 1000:

Image

Request maxkb, set max token to 1000:

Image

Steps to Reproduce

Interfacing with VLLM, Q&A

The expected correct result

No response

Related log output

Additional Information

No response

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions