Skip to content

Conversation

@stas00
Copy link
Contributor

@stas00 stas00 commented Jul 30, 2023

  1. inference
  2. inference 4-bit
  3. finetuning example (image captioning)
  4. Finetuning notebook used for the colab (same using PEFT)
  • @leot13 with help from @younesbelkada and the script from @stas00 made this 4-bit fine-tuning colab notebook
  • The finetuning script is a similar PEFT fine-tuning example, but on the non-quantized model. Maybe the colab is enough though, as it is very similar

Do not merge until huggingface/transformers#24796 is merged

@review-notebook-app
Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

@stas00 stas00 changed the title [WIP] IDEFICS demos IDEFICS demos Aug 18, 2023
@stas00 stas00 requested a review from VictorSanh August 18, 2023 18:53
@stas00 stas00 merged commit 9a35d43 into main Aug 18, 2023
@stas00 stas00 deleted the idefics branch August 18, 2023 21:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants