File tree Expand file tree Collapse file tree 1 file changed +4
-6
lines changed Expand file tree Collapse file tree 1 file changed +4
-6
lines changed Original file line number Diff line number Diff line change @@ -59,16 +59,14 @@ dependencies
5959pytorch= 1.13.1 (gpu)
6060cuda> = 11.6
6161transformers= 4.30.2
62- triton==2.0.0.dev20221202
63- # for install vllm, please use this branch to install https://github.com/tiandiao123/vllm/tree/setup_branch
64- vllm
65- # for install flash-attention, please use commit hash: 67ae6fd74b4bc99c36b2ce524cf139c35663793c
62+ triton
63+ # for install flash-attention
6664flash-attention
6765
6866# install lightllm since we depend on lightllm triton kernels
6967git clone https://github.com/ModelTC/lightllm
70- git checkout 28c1267cfca536b7b4f28e921e03de735b003039
7168cd lightllm
69+ git checkout 28c1267cfca536b7b4f28e921e03de735b003039
7270pip3 install -e .
7371
7472# also, install xformers from source:
@@ -93,8 +91,8 @@ pip install -e .
9391
9492# install lightllm
9593git clone https://github.com/ModelTC/lightllm
96- git checkout 28c1267cfca536b7b4f28e921e03de735b003039
9794cd lightllm
95+ git checkout 28c1267cfca536b7b4f28e921e03de735b003039
9896pip3 install -e .
9997
10098# install xformers from source
You can’t perform that action at this time.
0 commit comments