Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion examples/language/grok-1/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,7 @@ Command example:
./run_inference_slow.sh <MODEL_NAME_OR_PATH>
```

`MODEL_NAME_OR_PATH` can be a model name from Hugging Face model hub or a local path to PyTorch-version model checkpoints. We provided weights on model hub, named `hpcaitech/grok-1`. And you could also download the weights in advance using `git`:
`MODEL_NAME_OR_PATH` can be a model name from Hugging Face model hub or a local path to PyTorch-version model checkpoints. We have provided pytorch-version checkpoint on [HuggingFace model hub](https://huggingface.co/hpcai-tech/grok-1), named `hpcai-tech/grok-1`. And you could also download the weights in advance using `git`:
```bash
git lfs install
git clone https://huggingface.co/hpcai-tech/grok-1
Expand Down
2 changes: 1 addition & 1 deletion examples/language/grok-1/run_inference_fast.sh
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
#!/usr/bin/env bash

PRETRAINED=${1:-"hpcaitech/grok-1"}
PRETRAINED=${1:-"hpcai-tech/grok-1"}

torchrun --standalone --nproc_per_node 8 inference_tp.py --pretrained "$PRETRAINED" \
--max_new_tokens 100 \
Expand Down
2 changes: 1 addition & 1 deletion examples/language/grok-1/run_inference_slow.sh
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
#!/usr/bin/env bash

PRETRAINED=${1:-"hpcaitech/grok-1"}
PRETRAINED=${1:-"hpcai-tech/grok-1"}

python3 inference.py --pretrained "$PRETRAINED" \
--max_new_tokens 100 \
Expand Down