Skip to content

Conversation

@SofiaLiguori
Copy link
Contributor

@SofiaLiguori SofiaLiguori commented Jan 12, 2023

Patch release branch with commits 868dcf5d1405a8a0783ec826ec829274b9038b43 and 3f64184f4efa6b87fae6b970a697a297841e582c from examples-internal, see also https://github.com/graphcore/examples-internal/pull/417

Changes:

  • Add config for finetuning on POD16
  • Requirements changed to [email protected]_a
  • Adapt named_variable_buffers to new addons API
  • Readme update

Tested locally with sdk release

(3.1.0+1205_popart) sofial@neverland-poplar-31:~/workspace/dev/examples/nlp/gpt_j/popxl$ pytest
========================================================================= test session starts ==========================================================================
platform linux -- Python 3.8.10, pytest-6.2.5, py-1.11.0, pluggy-1.0.0 -- /nethome/sofial/workspace/venvs/poplar_sdk-ubuntu_20_04-3.1.0+1205-58b501c780/3.1.0+1205_popart/bin/python3
cachedir: .pytest_cache
rootdir: /nethome/sofial/workspace/dev/examples/nlp/gpt_j/popxl, configfile: pytest.ini, testpaths: tests
plugins: pythonpath-0.7.4
collected 14 items                                                                                                                                                     

tests/integration/execution/test_execution.py::TestPretraining::test_finetuning_mnli PASSED                                                                      [  7%]
tests/integration/execution/test_execution.py::TestPretraining::test_inference PASSED                                                                            [ 14%]
tests/integration/layers/test_attention_TP.py::test_attention_TP_cmp_huggingface PASSED                                                                          [ 21%]
tests/integration/layers/test_attention_TP.py::test_attention_to_hf PASSED                                                                                       [ 28%]
tests/integration/layers/test_decoder_block_TP.py::test_decoder_block_TP_cmp_huggingface PASSED                                                                  [ 35%]
tests/integration/layers/test_decoder_block_TP.py::test_decoder_to_hf PASSED                                                                                     [ 42%]
tests/integration/layers/test_feed_forward_TP.py::test_feed_forward_TP_cmp_huggingface PASSED                                                                    [ 50%]
tests/integration/layers/test_feed_forward_TP.py::test_ff_to_hf PASSED                                                                                           [ 57%]
tests/integration/layers/test_gptj_TP.py::test_gptj_TP_cmp_huggingface PASSED                                                                                    [ 64%]
tests/integration/layers/test_gptj_TP.py::test_gptj_to_hf PASSED                                                                                                 [ 71%]
tests/integration/layers/test_lm_TP.py::test_lm_TP_cmp_huggingface PASSED                                                                                        [ 78%]
tests/integration/layers/test_lm_TP.py::test_lm_to_hf PASSED                                                                                                     [ 85%]
tests/unit/test_dataloder.py::test_epochs PASSED                                                                                                                 [ 92%]
tests/unit/test_dataloder.py::test_dataloader_checkpoints PASSED                                                                                                 [100%]

@SofiaLiguori SofiaLiguori requested a review from a team as a code owner January 12, 2023 16:51
@CLAassistant
Copy link

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

@SofiaLiguori SofiaLiguori merged commit 03e04e8 into master Jan 12, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants