forked from poedator/transformers
    
        
        - 
                Notifications
    You must be signed in to change notification settings 
- Fork 0
Merge w/Official #5
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
          
     Merged
      
      
    
                
     Merged
            
            
          Conversation
  
    
      This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
      Learn more about bidirectional Unicode characters
    
  
  
    
    * Your commit message here * fix LlamaConfig docstring * run make fixup * fix formatting after review reformat of the file to prevent script issues * rerun make fixup after reformat
…#26663) * fix a typo in flax t5 attention * fix the typo in flax longt5 attention
`jnp.array` is a function, not a type: https://jax.readthedocs.io/en/latest/_autosummary/jax.numpy.array.html so it never makes sense to use `jnp.array` in a type annotation. Presumably the intent was to write `jnp.ndarray` aka `jax.Array`. Co-authored-by: Peter Hawkins <[email protected]>
* set encoder's PE as non-trainable * freeze flax * init sinusoids * add test for non-trainable embed positions * simplify TF encoder embed_pos * revert tf * clean up * add sinusoidal init for jax * make consistent sinusoidal function * fix dtype * add default dtype * use numpy for sinusoids. fix jax * add sinusoid init for TF * fix * use custom embedding * use specialized init for each impl * fix sinusoids init. add test for pytorch * fix TF dtype * simplify sinusoid init for flax and tf * add tests for TF * change default dtype to float32 * add sinusoid test for flax * Update src/transformers/models/whisper/modeling_flax_whisper.py Co-authored-by: Sanchit Gandhi <[email protected]> * Update src/transformers/models/whisper/modeling_tf_whisper.py Co-authored-by: Sanchit Gandhi <[email protected]> * move sinusoidal init to _init_weights --------- Co-authored-by: sanchit-gandhi <[email protected]> Co-authored-by: Sanchit Gandhi <[email protected]>
…prepare_input_for_generation in all models) (#25242) * In assisted decoding, pass model_kwargs to model's forward call Previously, assisted decoding would ignore any additional kwargs that it doesn't explicitly handle. This was inconsistent with other generation methods, which pass the model_kwargs through prepare_inputs_for_generation and forward the returned dict to the model's forward call. The prepare_inputs_for_generation method needs to be amended in all models, as previously it only kept the last input ID when a past_key_values was passed. * Improve variable names in _extend_attention_mask * Refactor extending token_type_ids into a function * Replace deepcopy with copy to optimize performance * Update new persimmon model with llama changes for assisted generation * Update new mistral model for assisted generation with prepare_inputs_for_generation * Update position_ids creation in falcon prepare_inputs_for_generation to support assisted generation
* feat: update callback doc to explain disabling callbacks using report_to * docs: update report_to docstring
* copied statement for test files --------- Co-authored-by: ydshieh <[email protected]>
* [Assistant Generation] Improve enc dec * save more * Fix logit processor checks * Clean * make style * fix deprecation * fix generation test * Apply suggestions from code review * fix biogpt * make style
* remove from utils * updated doc string * only in the model * Update src/transformers/models/swin/modeling_swin.py Co-authored-by: Yih-Dar <[email protected]> * Update src/transformers/models/swin/modeling_swin.py Co-authored-by: Yih-Dar <[email protected]> --------- Co-authored-by: Yih-Dar <[email protected]>
checkpoint path
Update docker files to use torch 2.1 Co-authored-by: ydshieh <[email protected]>
…t` (#26669) * [docstring] Fix docstring for `LlamaTokenizer` and `LlamaTokenizerFast` * [docstring] Fix docstring typo at `LlamaTokenizer` and `LlamaTokenizerFast`
* update check_docstrings * update docstring
* udpaet * update * Update docs/source/ja/autoclass_tutorial.md Co-authored-by: Steven Liu <[email protected]> * add codes workflows/build_pr_documentation.yml * Create preprocessing.md * added traning.md * Create Model_sharing.md * add quicktour.md * new * ll * Create benchmark.md * Create Tensorflow_model * add * add community.md * add create_a_model * create custom_model.md * create_custom_tools.md * create fast_tokenizers.md * create * add * Update docs/source/ja/_toctree.yml Co-authored-by: Steven Liu <[email protected]> * md * add * commit * add * h * Update docs/source/ja/peft.md Co-authored-by: Younes Belkada <[email protected]> * Update docs/source/ja/_toctree.yml Co-authored-by: Younes Belkada <[email protected]> * Update docs/source/ja/_toctree.yml Co-authored-by: Younes Belkada <[email protected]> * Suggested Update * add perf_train_gpu_one.md * added perf based MD files * Modify toctree.yml and Add transmartion to md codes * Add `serialization.md` and edit `_toctree.yml` * add task summary and tasks explained * Add and Modify files starting from T * Add testing.md * Create main_classes files * delete main_classes folder * Add toctree.yml * Update llm_tutorail.md * Update docs/source/ja/_toctree.yml Co-authored-by: Steven Liu <[email protected]> * Update misspelled filenames * Update docs/source/ja/_toctree.yml Co-authored-by: Steven Liu <[email protected]> * Update docs/source/ja/_toctree.yml * Update docs/source/ja/_toctree.yml * missplled file names inmrpovements * Update _toctree.yml * close tip block * close another tip block * Update docs/source/ja/quicktour.md Co-authored-by: Steven Liu <[email protected]> * Update docs/source/ja/pipeline_tutorial.md Co-authored-by: Steven Liu <[email protected]> * Update docs/source/ja/pipeline_tutorial.md Co-authored-by: Steven Liu <[email protected]> * Update docs/source/ja/preprocessing.md Co-authored-by: Steven Liu <[email protected]> * Update docs/source/ja/peft.md Co-authored-by: Steven Liu <[email protected]> * Update docs/source/ja/add_new_model.md Co-authored-by: Steven Liu <[email protected]> * Update docs/source/ja/testing.md Co-authored-by: Steven Liu <[email protected]> * Update docs/source/ja/task_summary.md Co-authored-by: Steven Liu <[email protected]> * Update docs/source/ja/tasks_explained.md Co-authored-by: Steven Liu <[email protected]> * Update glossary.md * Update docs/source/ja/transformers_agents.md Co-authored-by: Steven Liu <[email protected]> * Update docs/source/ja/llm_tutorial.md Co-authored-by: Steven Liu <[email protected]> * Update docs/source/ja/create_a_model.md Co-authored-by: Steven Liu <[email protected]> * Update docs/source/ja/torchscript.md Co-authored-by: Steven Liu <[email protected]> * Update docs/source/ja/benchmarks.md Co-authored-by: Steven Liu <[email protected]> * Update docs/source/ja/troubleshooting.md Co-authored-by: Steven Liu <[email protected]> * Update docs/source/ja/troubleshooting.md Co-authored-by: Steven Liu <[email protected]> * Update docs/source/ja/troubleshooting.md Co-authored-by: Steven Liu <[email protected]> * Update docs/source/ja/add_new_model.md Co-authored-by: Steven Liu <[email protected]> * Update perf_torch_compile.md * Update Year to default in en documentation * Final Update --------- Co-authored-by: Steven Liu <[email protected]> Co-authored-by: Younes Belkada <[email protected]>
…6161) * translate accelerate page * Update docs/source/zh/accelerate.md Co-authored-by: Arthur <[email protected]> --------- Co-authored-by: Steven Liu <[email protected]> Co-authored-by: Arthur <[email protected]>
* fix * fix * fix * fix * fix * fix * fix * fix * fix --------- Co-authored-by: ydshieh <[email protected]>
Add missing spaces in adjacent strings
* Logger level Co-authored-by: Sahil Bhosale <[email protected]> Co-authored-by: Adithya4720 <[email protected]> Co-authored-by: Sachin Singh <[email protected]> Co-authored-by: Riya Dhanduke <[email protected]> * More comprehensive documentation --------- Co-authored-by: Sahil Bhosale <[email protected]> Co-authored-by: Adithya4720 <[email protected]> Co-authored-by: Sachin Singh <[email protected]> Co-authored-by: Riya Dhanduke <[email protected]>
* fix --------- Co-authored-by: ydshieh <[email protected]>
* fix * fix * fix --------- Co-authored-by: ydshieh <[email protected]>
* Fix backward compatibility of Conversation I ran into a case where an external library was depending on the `new_user_input` field of Conversation. https://github.com/SeldonIO/MLServer/blob/release/1.4.x/runtimes/huggingface/mlserver_huggingface/codecs/utils.py#L37 This field was deprecated as part of the refactor, but if `transformers` wants to maintain backwards compatibility for now (which is mentioned in a few comments) then there's a good argument for supporting it. Some comments referred to it as an "internal" property, but it didn't start with `_` as is Python convention, so I think it's reasonable that other libraries were referencing it directly. It's not difficult to add it to the other supported backwards-compatible properties. In addition, the implementation of `past_user_inputs` didn't actually match the past behavior (it would contain the most recent message as well) so I updated that as well. * make style --------- Co-authored-by: Matt <[email protected]>
* llm prompting guide * updated code examples * an attempt to fix the code example tests * set seed in examples * added a doctest comment * added einops to the doc_test_job * string formatting * string formatting, again * added the toc to slow_documentation_tests.txt * minor list fix * string formatting + pipe renamed * Apply suggestions from code review Co-authored-by: Patrick von Platen <[email protected]> * replaced max_length with max_new_tokens and updated the outputs to match * minor formatting fix * removed einops from circleci config * Apply suggestions from code review Co-authored-by: Lysandre Debut <[email protected]> * removed einops and trust_remote_code parameter --------- Co-authored-by: Patrick von Platen <[email protected]> Co-authored-by: Lysandre Debut <[email protected]>
* Remove UniSpeechConfig * Remove , at the end otherwise check_docstring changes order * Auto add new docstring * Update docstring for UniSpeechConfig * Remove from check_docstrings * Remove UniSpeechSatConfig and UniSpeechSatForCTC from check_docstrings * Remove , at the end * Fix docstring * Update docstring for Wav2Vec2ForCTC * Update Wav2Vec2ForCTC docstring Co-authored-by: Yih-Dar <[email protected]> * fix style --------- Co-authored-by: Yih-Dar <[email protected]>
* [DOCS] Update docstrings for and tokenizer * [DOCS] add pad_token argument to whisper tokenizer docstring * [FIX] Reword pad_token description * [CHORE] Apply style formatting --------- Co-authored-by: jmcdonnell <[email protected]>
* [docstring] Remove 'BertGenerationConfig' from OBJECTS_TO_IGNORE * [docstring] Fix docstring for 'BertGenerationConfig' (#26638)
fix Co-authored-by: ydshieh <[email protected]>
fix incorrect docstring: encoder -> decoder
minor fixes
* docs(zh): translate custom_models.md * minor fix in customer_models Co-authored-by: Steven Liu <[email protected]> --------- Co-authored-by: Steven Liu <[email protected]>
* hindi translation of pipeline_tutorial.md * Update pipeline_tutorial.md * Update build_documentation.yml * Update build_pr_documentation.yml * Updated build_documentation.yml --------- Co-authored-by: Steven Liu <[email protected]>
Handle all unshared models types
…sion_transformer (#27072) Bump werkzeug in /examples/research_projects/decision_transformer Bumps [werkzeug](https://github.com/pallets/werkzeug) from 2.2.3 to 3.0.1. - [Release notes](https://github.com/pallets/werkzeug/releases) - [Changelog](https://github.com/pallets/werkzeug/blob/main/CHANGES.rst) - [Commits](pallets/werkzeug@2.2.3...3.0.1) --- updated-dependencies: - dependency-name: werkzeug dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…xmert (#26888) Bump urllib3 in /examples/research_projects/lxmert Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.17 to 1.26.18. - [Release notes](https://github.com/urllib3/urllib3/releases) - [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst) - [Commits](urllib3/urllib3@1.26.17...1.26.18) --- updated-dependencies: - dependency-name: urllib3 dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Working tests! * Fix sampler * Fix * Update src/transformers/trainer.py Co-authored-by: Arthur <[email protected]> * Fix check * Clean --------- Co-authored-by: Arthur <[email protected]>
* pin FA-2 to `2.1` * fix on modeling
* fix * update * revert * add dosctring * good to go * update * add a test
…27074) * clean * clean llama * fix more * make style * Apply suggestions from code review * Apply suggestions from code review * Update src/transformers/models/llama/modeling_llama.py * Update src/transformers/models/llama/modeling_llama.py * Apply suggestions from code review * finish * make style
* add_ xllamav2 arg * add test * style * add check * add doc * replace by use_exllama_v2 * fix tests * fix doc * style * better condition * fix logic * add deprecate msg
* docs(training_args): correct docstrings Correct docstrings of these methods in `TrainingArguments`: - `set_save` - `set_logging` * docs(training_args): adjust words in docstrings Co-authored-by: Steven Liu <[email protected]> * docs(trainer): correct a typo in comments --------- Co-authored-by: Steven Liu <[email protected]>
* Support runs/ * Upload runs folder as part of push to hub * Add a test * Add to test deps * Update with proposed solution from Slack * Ensure that repo gets deleted in tests
Added huggingface emoji instead of the markdown format as it was not displaying the required emoji in that format
* v4.35.dev.0 * nit t5fast match t5 slow
* add early stopping logits processor * black formmated * indent * follow method signature * actual logic * check for None * address comments on docstrings and method signature * add unit test under `LogitsProcessorTest` wip * unit test passing * black formatted * condition per sample * add to BarkModelIntegrationTests * wip BarkSemanticModelTest * rename and add to kwargs handling * not add to BarkSemanticModelTest * correct logic and assert last outputs tokens different in test * doc-builder style * read from kwargs as well * assert len of with less than that of without * ruff * add back seed and test case * add original impl default suggestion * doc-builder * rename and use softmax * switch back to LogitsProcessor and update docs wording * camelCase and spelling and saving compute * assert strictly less than * assert less than * expand test_generate_semantic_early_stop instead
* fix no split * style * remove comm * Update src/transformers/modeling_utils.py Co-authored-by: Arthur <[email protected]> * rename modules --------- Co-authored-by: Arthur <[email protected]>
* fix * more fixes * fix other models * fix long t5 * use `gradient_checkpointing_func` instead * fix copies * set `gradient_checkpointing_func` as a private attribute and retrieve previous behaviour * Update src/transformers/modeling_utils.py Co-authored-by: Arthur <[email protected]> * replace it with `is_gradient_checkpointing_set` * remove default * Update src/transformers/modeling_utils.py Co-authored-by: Arthur <[email protected]> * fixup --------- Co-authored-by: Arthur <[email protected]>
* fix detr device map * add comments
* [FA2 Bart] Add FA2 to all Bart-like * better * Refactor attention mask * remove all customized atteniton logic * format * mass rename * replace _expand_mask * replace _expand_mask * mass rename * add pt files * mass replace & rename * mass replace & rename * mass replace & rename * mass replace & rename * Update src/transformers/models/idefics/modeling_idefics.py * fix more * clean more * fix more * make style * fix again * finish * finish * finish * finish * finish * finish * finish * finish * finish * finish * Apply suggestions from code review * Apply suggestions from code review Co-authored-by: amyeroberts <[email protected]> * small fix mistral * finish * finish * finish * finish --------- Co-authored-by: amyeroberts <[email protected]>
* Create index.md * Create _toctree.yml * Updated index.md in telugu * Update _toctree.yml * Create quicktour.md * Update quicktour.md * Create index.md * Update quicktour.md * Update docs/source/te/quicktour.md Co-authored-by: Steven Liu <[email protected]> * Delete docs/source/hi/index.md * Update docs/source/te/quicktour.md Co-authored-by: Steven Liu <[email protected]> * Update docs/source/te/quicktour.md Co-authored-by: Steven Liu <[email protected]> * Update docs/source/te/quicktour.md Co-authored-by: Steven Liu <[email protected]> * Update docs/source/te/quicktour.md Co-authored-by: Steven Liu <[email protected]> * Update docs/source/te/quicktour.md Co-authored-by: Steven Liu <[email protected]> * Update docs/source/te/quicktour.md Co-authored-by: Steven Liu <[email protected]> * Update docs/source/te/quicktour.md Co-authored-by: Steven Liu <[email protected]> * Update docs/source/te/quicktour.md Co-authored-by: Steven Liu <[email protected]> * Update build_documentation.yml Added telugu [te] * Update build_pr_documentation.yml Added Telugu [te] * Update _toctree.yml * Create README_te.md Telugu translation for README.md * Update README_te.md Added Telugu translation for Readme.md * Update README_te.md * Update README_te.md * Update README_te.md * Update README_te.md * Update README.md * Update README_es.md * Update README_es.md * Update README_hd.md * Update README_ja.md * Update README_ko.md * Update README_pt-br.md * Update README_ru.md * Update README_zh-hans.md * Update README_zh-hant.md * Update README_te.md --------- Co-authored-by: Steven Liu <[email protected]>
* update translation * fix problems mentioned in reviews
fix docstring and type hint for resize
  
    Sign up for free
    to join this conversation on GitHub.
    Already have an account?
    Sign in to comment
  
      
  Add this suggestion to a batch that can be applied as a single commit.
  This suggestion is invalid because no changes were made to the code.
  Suggestions cannot be applied while the pull request is closed.
  Suggestions cannot be applied while viewing a subset of changes.
  Only one suggestion per line can be applied in a batch.
  Add this suggestion to a batch that can be applied as a single commit.
  Applying suggestions on deleted lines is not supported.
  You must change the existing code in this line in order to create a valid suggestion.
  Outdated suggestions cannot be applied.
  This suggestion has been applied or marked resolved.
  Suggestions cannot be applied from pending reviews.
  Suggestions cannot be applied on multi-line comments.
  Suggestions cannot be applied while the pull request is queued to merge.
  Suggestion cannot be applied right now. Please check back later.
  
    
  
    
What does this PR do?
Fixes # (issue)
Before submitting
Pull Request section?
to it if that's the case.
documentation guidelines, and
here are tips on formatting docstrings.
Who can review?
Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.