Skip to content

[Bug]: Bugs in the new logprobs_mode #26014

@YunruiZhang

Description

@YunruiZhang

🐛 Describe the bug

The new logprobs_mode has many bugs. When set to logprobs_mode = 'processed_logprobs', it returns the same values as logprobs_mode = 'raw_logprobs'. Additionally, when set to 'processed_logits' or 'raw_logits', it does not produce any meaningful output the logprobs are all -inf except for rank = 1, which gives 0. I am using MODEL_ID = "Qwen/Qwen3-30B-A3B-Thinking-2507-FP8"

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions