Name Error: "Partial State" is not defind

[RAravindDS]

Parital State is not defined

• In your recent release: 4.29.0.dev.0 has some issues with the code. The function or method "Partial State" is not defined. Today - I am not able to train my model. I just downloaded 4.28.0 to resolve this issue. Can you kindly check ASAP?

• This error I am getting in the "Training arguments" method.

• The training arguments script does not define or import the "Partial State" method or function.

Solution:

• For now, install the previous stable version of transformers.

pip install transformers==4.28.0

[amyeroberts]

cc @muellerzr

[amyeroberts]

@RAravindDS Thanks for reporting. I suspect the issue is coming from the version of accelerate in your environment. Could you:

• Share the running environment info: copy-paste the output from running transformers-cli env in your terminal
  THEN
• Upgrade accelerate using pip install --upgrade accelerate
• Retry

[muellerzr]

As @amyeroberts mentions, please try following those steps. I'll also look at changing the min Accelerate needed/add a check.

[RAravindDS]

@amyeroberts I ran the code on Colab, and while training the LLM (LMV3), I got the error, Then I downloaded the previous version of the transformer, and it worked fine. 

[amyeroberts]

@RAravindDS Yes, this is because the PartialState import was added as a dependency on the transformers development branch yesterday. PartialState was added in the 0.17.0 release in accelerate, and so for the development branch of transformers, accelerate >= 0.17.0 is required.

Downgrading the transformers version removes the code which is importing PartialState.

[gli-mrunal]

I am using the following version of transformer, datasets and huggingface_hub.

I am running into the following error:

 NameError: name 'PartialState' is not defined.

How to resolve this issue to work with my versions of the transformer, datasets and huggingface_hub ?

[muellerzr]

@gli-mrunal please do pip install git+https://github.com/huggingface/accelerate to install the dev version, or pip install accelerate -U if you are not using multi-GPUs (such as in Colab).

[gli-mrunal]

[muellerzr]

@gli-mrunal sorry for the typo, there are two c's for accelerate :)

[RAravindDS]

Bro, you don't need to worry too much. Please downgrade the version. They are having stable version. Don't stress too much. Previous version working as usual. We changed all our requirements today. Hectic process :(

[gli-mrunal]

True. !pip install transformers==4.28.0 for previous version is easier solution. The newer version runs into dependency issues.