[tune](deps): Bump transformers from 4.3.2 to 4.5.1 in /python/requirements

[dependabot]

Bumps transformers from 4.3.2 to 4.5.1.

Release notes

Sourced from transformers's releases.

v4.5.1: Patch release

• Fix pipeline when used with private models (#11123)
• Fix loading an architecture in an other (#11207)

v4.5.0: BigBird, GPT Neo, Examples, Flax support

BigBird (@​vasudevgupta7)

Seven new models are released as part of the BigBird implementation: BigBirdModel, BigBirdForPreTraining, BigBirdForMaskedLM, BigBirdForCausalLM, BigBirdForSequenceClassification, BigBirdForMultipleChoice, BigBirdForQuestionAnswering in PyTorch.

BigBird is a sparse-attention based transformer which extends Transformer based models, such as BERT to much longer sequences. In addition to sparse attention, BigBird also applies global attention as well as random attention to the input sequence.

The BigBird model was proposed in Big Bird: Transformers for Longer Sequences by Manzil Zaheer, Guru Guruganesh, Avinava Dubey, Joshua Ainslie, Chris Alberti, Santiago Ontanon, Philip Pham, Anirudh Ravula, Qifan Wang, Li Yang, Amr Ahmed.

It is released with an accompanying blog post: Understanding BigBird's Block Sparse Attention

Compatible checkpoints can be found on the Hub: https://huggingface.co/models?filter=big_bird

• BigBird #10183 (@​vasudevgupta7)
• [BigBird] Fix big bird gpu test #10967 (@​patrickvonplaten)
• [Notebook] add BigBird trivia qa notebook #10995 (@​patrickvonplaten)
• [Docs] Add blog to BigBird docs #10997 (@​patrickvonplaten)

GPT Neo (@​patil-suraj)

Two new models are released as part of the GPT Neo implementation: GPTNeoModel, GPTNeoForCausalLM in PyTorch.

GPT⁠-⁠Neo is the code name for a family of transformer-based language models loosely styled around the GPT architecture. EleutherAI's primary goal is to replicate a GPT⁠-⁠3 DaVinci-sized model and open-source it to the public.

The implementation within Transformers is a GPT2-like causal language model trained on the Pile dataset.

Compatible checkpoints can be found on the Hub: https://huggingface.co/models?filter=gpt_neo

• GPT Neo #10848 (@​patil-suraj)
• GPT Neo few fixes #10968 (@​patil-suraj)
• GPT Neo configuration needs to be set to use GPT2 tokenizer #10992 (@​LysandreJik)
• [GPT Neo] fix example in config #10993 (@​patil-suraj)
• GPT Neo cleanup #10985 (@​patil-suraj )

Examples

Features have been added to some examples, and additional examples have been added.

Raw training loop examples

Based on the accelerate library, examples completely exposing the training loop are now part of the library. For easy customization if you want to try a new research idea!

• Expand a bit the presentation of examples #10799 (@​sgugger)
• Add examples/multiple-choice/run_swag_no_trainer.py #10934 (@​stancld)
• Update the example template for a no Trainer option #10865 (@​sgugger)

... (truncated)

Commits

• 4bae96e Release: V4.5.1
• 9c4070b Adds use_auth_token with pipelines (#11123)
• cd39c8e Replace error by warning when loading an architecture in another (#11207)
• 4906a29 Release v4.5.0
• 2a8115f [WIP] GPT Neo cleanup (#10985)
• 76800fb added new merged Trainer test (#11090)
• b219d6b added social thumbnail for docs (#11083)
• 6c1bee7 Link to new blog
• f7328de HF emoji unicode doesn't work in console (#11081)
• 6ab7d1a Add Readme for language modeling scripts with accelerate (#11073)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot]

Superseded by #17.