Skip to content

Jordan #171

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 49 commits into
base: best
Choose a base branch
from
Open

Jordan #171

wants to merge 49 commits into from

Conversation

@jamesthesnake
Copy link
Owner

@jamesthesnake jamesthesnake commented Sep 22, 2023

📌 Checklist before creating the PR

  • I have created an issue for this PR for traceability
  • The title follows the standard format: [doc/gemini/tensor/...]: A concise description
  • I have added relevant tags if possible for us to better distinguish different PRs

🚨 Issue number

Link this PR to your issue with words like fixed to automatically close the linked issue upon merge

e.g. fixed #1234, closed #1234, resolved #1234

📝 What does this PR do?

Summarize your work here.
if you have any plots/diagrams/screenshots/tables, please attach them here.

💥 Checklist before requesting a review

  • I have linked my PR to an issue (instruction)
  • My issue clearly describes the problem/feature/proposal, with diagrams/charts/table/code if possible
  • I have performed a self-review of my code
  • I have added thorough tests.
  • I have added docstrings for all the functions/methods I implemented

⭐️ Do you enjoy contributing to Colossal-AI?

  • 🌝 Yes, I do.
  • 🌚 No, I don't.

Tell us more if you don't enjoy contributing to Colossal-AI.

jamesthesnake and others added 30 commits September 8, 2023 09:29
@jamesthesnake
Merge pull request #163 from jamesthesnake/best
e53e49c 
Best
@jamesthesnake
Merge pull request #164 from jamesthesnake/better
f38b555 
Better
@flybird11111
[shardformer] update shardformer readme (hpcaitech#4689)
8844691 
* [shardformer] update shardformer readme

* [shardformer] update shardformer readme

* [shardformer] update shardformer readme

* [shardformer] update shardformer readme

* [shardformer] update shardformer readme
[hotfix] fix typo in hybrid parallel io (hpcaitech#4697)
d8ceeac
@digger-yu @flybird11111
fix some typo with colossalai/device colossalai/tensor/ etc. (hpcaite…
9c2feb2 
…ch#4171)

Co-authored-by: flybird11111 <[email protected]>
[doc] add potential solution for OOM in llama2 example (hpcaitech#4699)
068372a
@flybird11111
[shardformer] fix GPT2DoubleHeadsModel (hpcaitech#4703)
c7d6975
@yuanheng-zhao
[hotfix] Fix import error: colossal.kernel without triton installed (h…
e2c0e7f 
…pcaitech#4722)

* [hotfix] remove triton kernels from kernel init

* revise bloom/llama kernel imports for infer
@flybird11111
[shardformer] to fix whisper test failed due to significant accuracy …
20190b4 
…differences. (hpcaitech#4710)

* [shardformer] fix whisper test failed

* [shardformer] fix whisper test failed

* [shardformer] fix whisper test failed

* [shardformer] fix whisper test failed
@binmakeswell
[doc] fix llama2 code link (hpcaitech#4726)
ce97790 
* [doc] fix llama2 code link

* [doc] fix llama2 code link

* [doc] fix llama2 code link
[doc] Add user document for Shardformer (hpcaitech#4702)
f911d5b 
* create shardformer doc files

* add docstring for seq-parallel

* update ShardConfig docstring

* add links to llama example

* add outdated massage

* finish introduction & supporting information

* finish 'how shardformer works'

* finish shardformer.md English doc

* fix doctest fail

* add Chinese document
@github-actions
[format] applied code formatting on changed files in pull request 4726 (
8c2dda7 
hpcaitech#4727)

Co-authored-by: github-actions <[email protected]>
[doc] add shardformer support matrix/update tensor parallel documents (…
50e5602 
…hpcaitech#4728)

* add compatibility matrix for shardformer doc

* update tp doc
@digger-yu @flybird11111
Optimized some syntax errors in the documentation and code under appl…
e4fc57c 
…ications/ (hpcaitech#4127)

Co-authored-by: flybird11111 <[email protected]>
@flybird11111
[shardformer] update pipeline parallel document (hpcaitech#4725)
4616263 
* [shardformer] update pipeline parallel document

* [shardformer] update pipeline parallel document

* [shardformer] update pipeline parallel document

* [shardformer] update pipeline parallel document

* [shardformer] update pipeline parallel document

* [shardformer] update pipeline parallel document

* [shardformer] update pipeline parallel document

* [shardformer] update pipeline parallel document
@ppt0011
[legacy] remove deterministic data loader test
cd4e61d
@FoolPlayer
[shardformer] update seq parallel document (hpcaitech#4730)
6a03c93 
* update doc of seq parallel

* fix typo
@FoolPlayer
[example] add gpt2 HybridParallelPlugin example (hpcaitech#4653)
608cffa 
* add gpt2 HybridParallelPlugin example

* update readme and testci

* update test ci

* fix test_ci bug

* update requirements

* add requirements

* update requirements

* add requirement

* rename file
@ppt0011
Merge pull request hpcaitech#4738 from ppt0011/main
73eb3e8 
[legacy] remove deterministic data loader test
[doc] polish shardformer doc (hpcaitech#4735)
451c346 
* arrange position of chapters

* fix typos in seq parallel doc
@oahzxl
[shardformer] add custom policy in hybrid parallel plugin (hpcaitech#…
ac27979 
…4718)

* add custom policy

* update assert
@flybird11111
[example] llama2 add fine-tune example (hpcaitech#4673)
4c4482f 
* [shardformer] update shardformer readme

[shardformer] update shardformer readme

[shardformer] update shardformer readme

* [shardformer] update llama2/opt finetune example and shardformer update to llama2

* [shardformer] update llama2/opt finetune example and shardformer update to llama2

* [shardformer] update llama2/opt finetune example and shardformer update to llama2

* [shardformer] change dataset

* [shardformer] change dataset

* [shardformer] fix CI

* [shardformer] fix

* [shardformer] fix

* [shardformer] fix

* [shardformer] fix

* [shardformer] fix

[example] update opt example

[example] resolve comments

fix

fix

* [example] llama2 add finetune example

* [example] llama2 add finetune example

* [example] llama2 add finetune example

* [example] llama2 add finetune example

* fix

* update llama2 example

* update llama2 example

* fix

* update llama2 example

* update llama2 example

* update llama2 example

* update llama2 example

* update llama2 example

* update llama2 example

* Update requirements.txt

* update llama2 example

* update llama2 example

* update llama2 example
[doc] explaination of loading large pretrained models (hpcaitech#4741)
d151dca
@oahzxl
[kernel] update triton init hpcaitech#4740 (hpcaitech#4740)
32e7f99
@ver217
[legacy] clean up legacy code (hpcaitech#4743)
b5f9e37 
* [legacy] remove outdated codes of pipeline (hpcaitech#4692)

* [legacy] remove cli of benchmark and update optim (hpcaitech#4690)

* [legacy] remove cli of benchmark and update optim

* [doc] fix cli doc test

* [legacy] fix engine clip grad norm

* [legacy] remove outdated colo tensor (hpcaitech#4694)

* [legacy] remove outdated colo tensor

* [test] fix test import

* [legacy] move outdated zero to legacy (hpcaitech#4696)

* [legacy] clean up utils (hpcaitech#4700)

* [legacy] clean up utils

* [example] update examples

* [legacy] clean up amp

* [legacy] fix amp module

* [legacy] clean up gpc (hpcaitech#4742)

* [legacy] clean up context

* [legacy] clean core, constants and global vars

* [legacy] refactor initialize

* [example] fix examples ci

* [example] fix examples ci

* [legacy] fix tests

* [example] fix gpt example

* [example] fix examples ci

* [devops] fix ci installation

* [example] fix examples ci
@github-actions
[format] applied code formatting on changed files in pull request 4743 (
3c6b831 
hpcaitech#4750)

Co-authored-by: github-actions <[email protected]>
@ver217
[misc] update pre-commit and run all files (hpcaitech#4752)
079bf3c 
* [misc] update pre-commit

* [misc] run pre-commit

* [misc] remove useless configuration files

* [misc] ignore cuda for clang-format
@ppt0011
[doc] explain suitable use case for each plugin
10513f2
@ppt0011
[doc] put individual plugin explanation in front
a04337b
@ppt0011
[doc] add model examples for each plugin
e10d9f0
ppt0011 and others added 19 commits September 20, 2023 09:24
@ppt0011
[doc] put native colossalai plugins first in description section
4d7537b
@ppt0011
Merge pull request hpcaitech#4757 from ppt0011/main
07c2e3d 
[doc] explain suitable use case for each plugin
@cwher @flybird11111
[chat]: update rm, add wandb and fix bugs (hpcaitech#4471)
7b9b864 
* feat: modify forward fn of critic and reward model

* feat: modify calc_action_log_probs

* to: add wandb in sft and rm trainer

* feat: update train_sft

* feat: update train_rm

* style: modify type annotation and add warning

* feat: pass tokenizer to ppo trainer

* to: modify trainer base and maker base

* feat: add wandb in ppo trainer

* feat: pass tokenizer to generate

* test: update generate fn tests

* test: update train tests

* fix: remove action_mask

* feat: remove unused code

* fix: fix wrong ignore_index

* fix: fix mock tokenizer

* chore: update requirements

* revert: modify make_experience

* fix: fix inference

* fix: add padding side

* style: modify _on_learn_batch_end

* test: use mock tokenizer

* fix: use bf16 to avoid overflow

* fix: fix workflow

* [chat] fix gemini strategy

* [chat] fix

* sync: update colossalai strategy

* fix: fix args and model dtype

* fix: fix checkpoint test

* fix: fix requirements

* fix: fix missing import and wrong arg

* fix: temporarily skip gemini test in stage 3

* style: apply pre-commit

* fix: temporarily skip gemini test in stage 1&2

---------

Co-authored-by: Mingyan Jiang <[email protected]>
[shardformer] fix master param sync for hybrid plugin/rewrite unwrapp…
c0a0337 
…ing logic (hpcaitech#4758)

* fix master param sync for hybrid plugin

* rewrite unwrap for ddp/fsdp

* rewrite unwrap for zero/gemini

* rewrite unwrap for hybrid plugin

* fix geemini unwrap

* fix bugs
[bug] fix get_default_parser in examples (hpcaitech#4764)
df66741
@ver217
[doc] clean up outdated docs (hpcaitech#4765)
66f3926 
* [doc] clean up outdated docs

* [doc] fix linking

* [doc] fix linking
[doc] add shardformer doc to sidebar (hpcaitech#4768)
493a5ef
@cwher
[chat]: add lora merge weights config (hpcaitech#4766)
901ab1e 
* feat: modify lora merge weights fn

* feat: add lora merge weights config
@ver217
[lazy] support torch 2.0 (hpcaitech#4763)
3e05c07 
* [lazy] support _like methods and clamp

* [lazy] pass transformers models

* [lazy] fix device move and requires grad

* [lazy] fix requires grad and refactor api

* [lazy] fix requires grad
@littsk
[bug] Fix the version check bug in colossalai run when generating the…
1e0e080 
… cmd. (hpcaitech#4713)

* Fix the version check bug in colossalai run when generating the cmd.

* polish code
@Xu-Kai
[feature] add gptq for inference (hpcaitech#4754)
946ab56 
* [gptq] add gptq kernel (hpcaitech#4416)

* add gptq

* refactor code

* fix tests

* replace auto-gptq

* rname inferance/quant

* refactor test

* add auto-gptq as an option

* reset requirements

* change assert and check auto-gptq

* add import warnings

* change test flash attn version

* remove example

* change requirements of flash_attn

* modify tests

* [skip ci] change requirements-test

* [gptq] faster gptq cuda kernel (hpcaitech#4494)

* [skip ci] add cuda kernels

* add license

* [skip ci] fix max_input_len

* format files & change test size

* [skip ci]

* [gptq] add gptq tensor parallel (hpcaitech#4538)

* add gptq tensor parallel

* add gptq tp

* delete print

* add test gptq check

* add test auto gptq check

* [gptq] combine gptq and kv cache manager (hpcaitech#4706)

* combine gptq and kv cache manager

* add init bits

* delete useless code

* add model path

* delete usless print and update test

* delete usless import

* move option gptq to shard config

* change replace linear to shardformer

* update bloom policy

* delete useless code

* fix import bug and delete uselss code

* change colossalai/gptq to colossalai/quant/gptq

* update import linear for tests

* delete useless code and mv gptq_kernel to kernel directory

* fix triton kernel

* add triton import
@CjhHa1
[inference] chatglm2 infer demo (hpcaitech#4724)
ce7ade3 
* add chatglm2

* add

* gather needed kernels

* fix some bugs

* finish context forward

* finish context stage

* fix

* add

* pause

* add

* fix bugs

* finish chatglm

* fix bug

* change some logic

* fix bugs

* change some logics

* add

* add

* add

* fix

* fix tests

* fix
@ver217
[release] update version (hpcaitech#4775)
4146f1c 
* [release] update version

* [doc] revert versions
@jamesthesnake
Merge branch 'hpcaitech:main' into jordan
accb491
@TongLi3701
initial commit: add colossal llama 2 (hpcaitech#4784)
74aa7d9
@chengeharrison @TongLi3701
[feature] ColossalEval: Evaluation Pipeline for LLMs (hpcaitech#4786)
ce77785 
* Add ColossalEval

* Delete evaluate in Chat

---------

Co-authored-by: Xu Yuanchen <[email protected]>
Co-authored-by: Tong Li <[email protected]>
@binmakeswell
[doc] add llama2 domain-specific solution news (hpcaitech#4789)
d512a4d 
* [doc] add llama2 domain-specific solution news
@flybird11111
[fix] fix weekly runing example (hpcaitech#4787)
26cd6d8 
* [fix] fix weekly runing example

* [fix] fix weekly runing example
@jamesthesnake
Merge pull request #172 from jamesthesnake/main
898313e 
here to update
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.