-
-
Notifications
You must be signed in to change notification settings - Fork 10.8k
Closed as not planned
Labels
bugSomething isn't workingSomething isn't workingstaleOver 90 days of inactivityOver 90 days of inactivity
Description
Your current environment
N/A
🐛 Describe the bug
After reenabling model tests from #3631, I found several e2e tests are broken in the matser. for the following reasons.
- allenai/OLMo-1B: TypeError: forward() got an unexpected keyword argument 'cache_position'
- mistralai/Mistral-7B-v0.1: correctness issue (generate doesn't generate any token) + RuntimeError: expected scalar type - - BFloat16 but found Half (only in CI)
- Deci/DeciLM-7b: correctness issue (output is different)
- tiiuae/falcon-7b: correctness issue (output is different)
-"Qwen/Qwen1.5-0.5B": Correctness issue - test_mistral.py
They are currently skipped/commented out in the master, and we should make sure to reenable it.
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't workingstaleOver 90 days of inactivityOver 90 days of inactivity