Skip to content

Commit 4f0234f

Browse files
tiandiao123lcq336
andauthored
[doc]Update doc for colossal-inference (#4989)
* update doc * Update README.md --------- Co-authored-by: cuiqing.li <[email protected]>
1 parent abe071b commit 4f0234f

File tree

1 file changed

+4
-6
lines changed

1 file changed

+4
-6
lines changed

colossalai/inference/README.md

Lines changed: 4 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -59,16 +59,14 @@ dependencies
5959
pytorch= 1.13.1 (gpu)
6060
cuda>= 11.6
6161
transformers= 4.30.2
62-
triton==2.0.0.dev20221202
63-
# for install vllm, please use this branch to install https://github.com/tiandiao123/vllm/tree/setup_branch
64-
vllm
65-
# for install flash-attention, please use commit hash: 67ae6fd74b4bc99c36b2ce524cf139c35663793c
62+
triton
63+
# for install flash-attention
6664
flash-attention
6765

6866
# install lightllm since we depend on lightllm triton kernels
6967
git clone https://github.com/ModelTC/lightllm
70-
git checkout 28c1267cfca536b7b4f28e921e03de735b003039
7168
cd lightllm
69+
git checkout 28c1267cfca536b7b4f28e921e03de735b003039
7270
pip3 install -e .
7371

7472
# also, install xformers from source:
@@ -93,8 +91,8 @@ pip install -e .
9391
9492
# install lightllm
9593
git clone https://github.com/ModelTC/lightllm
96-
git checkout 28c1267cfca536b7b4f28e921e03de735b003039
9794
cd lightllm
95+
git checkout 28c1267cfca536b7b4f28e921e03de735b003039
9896
pip3 install -e .
9997
10098
# install xformers from source

0 commit comments

Comments
 (0)