Skip to content

Conversation

@AlphaINF
Copy link

Previous version of OpenAI entrypoints didn't support adding lora adapter to a live server.
Now you can use my version to add an adapter path by some command:

curl -X GET your_host:your_port/add_lora \
    -H "Content-Type: application/json" \
    -d '{
        "lora_name": "your_new_lora_model_name",
        "lora_local_path": "your_new_lora_model_path"
    }'

After adding the model, you can use these model like another exist loras.

@simon-mo
Copy link
Collaborator

We will review #3308 as it also have a delete API for completeness.

@TangJiakai
Copy link

Could you please tell me when the online service feature for adding LoRA weights will be officially integrated?

@Jeffwan
Copy link
Contributor

Jeffwan commented Jul 9, 2024

We had a different version with more test and better coverage (chat/completion/embedding). Let me rebase to master and share with the community. @TangJiakai @simon-mo

@github-actions
Copy link

This pull request has been automatically marked as stale because it has not had any activity within 90 days. It will be automatically closed if no further activity occurs within 30 days. Leave a comment if you feel this pull request should remain open. Thank you!

@github-actions github-actions bot added the stale Over 90 days of inactivity label Oct 29, 2024
@mergify
Copy link

mergify bot commented Oct 29, 2024

This pull request has merge conflicts that must be resolved before it can be
merged. @AlphaINF please rebase it. https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

@github-actions github-actions bot added unstale Recieved activity after being labelled stale and removed stale Over 90 days of inactivity labels Nov 2, 2024
@AlphaINF AlphaINF closed this Nov 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

frontend needs-rebase unstale Recieved activity after being labelled stale

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants