-
-
Notifications
You must be signed in to change notification settings - Fork 10.9k
Open
Labels
bugSomething isn't workingSomething isn't working
Description
🐛 Describe the bug
The new logprobs_mode has many bugs. When set to logprobs_mode = 'processed_logprobs', it returns the same values as logprobs_mode = 'raw_logprobs'. Additionally, when set to 'processed_logits' or 'raw_logits', it does not produce any meaningful output the logprobs are all -inf except for rank = 1, which gives 0. I am using MODEL_ID = "Qwen/Qwen3-30B-A3B-Thinking-2507-FP8"
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working