Skip to content

[New Model]: Blip2 Support required #4739

@anisingh1

Description

@anisingh1

The model to consider.

https://huggingface.co/Salesforce/blip2-opt-2.7b

The closest model vllm already supports.

https://huggingface.co/liuhaotian/llava-v1.5-7b

What's your difficulty of supporting the model you want?

Support for Llava 1.5 was recently added. Blip2 has a different architecture which is currently not supported.

Metadata

Metadata

Assignees

No one assigned

    Labels

    new-modelRequests to new models

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions