Skip to content

Commit 9c3dd8a

Browse files
Update the conversion script 3
1 parent 09dd7d4 commit 9c3dd8a

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

src/transformers/models/aria/convert_aria_weights_to_hf.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -107,6 +107,7 @@ def convert_aria_llama_to_hf(text_model_id, vision_model_id, output_hub_path, ol
107107
config.vision_config.attention_heads = 16
108108
config.pad_token_id = 2
109109
config.image_token_index = 9
110+
config.intermediate_size = config.moe_intermediate_size
110111
config.auto_map = {
111112
"AutoConfig": "modeling_aria.AriaConfig",
112113
"AutoModelForCausalLM": "modeling_aria.AriaForConditionalGeneration",

0 commit comments

Comments
 (0)