Skip to content
This repository was archived by the owner on Oct 11, 2024. It is now read-only.

Commit 9c7608c

Browse files
Yard1Robert Shaw
authored andcommitted
[Bugfix] Use RayActorError for older versions of Ray in RayTokenizerGroupPool (vllm-project#6039)
1 parent cf4e758 commit 9c7608c

File tree

1 file changed

+5
-1
lines changed

1 file changed

+5
-1
lines changed

vllm/transformers_utils/tokenizer_group/ray_tokenizer_group.py

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,11 @@
22
import os
33
from typing import List, Optional
44

5-
from ray.exceptions import ActorDiedError
5+
try:
6+
from ray.exceptions import ActorDiedError
7+
except ImportError:
8+
# For older versions of Ray
9+
from ray.exceptions import RayActorError as ActorDiedError
610
from ray.util.scheduling_strategies import NodeAffinitySchedulingStrategy
711
from transformers import PreTrainedTokenizer
812

0 commit comments

Comments
 (0)