Add JinaBert Model

[Jackmin801]

Model description

Jina AI has just released an open source embedding model that can handle 8k sequence on huggingface:

• https://huggingface.co/jinaai/jina-embeddings-v2-base-en
• https://huggingface.co/jinaai/jina-embeddings-v2-small-en

These models however, currently require the trust_remote_code flag as they reference a custom model implementation specified at https://huggingface.co/jinaai/jina-embedding-v2/tree/main. It should be relatively simple to upstream the model implementation as it is already implemented to work when trust_remote_code is passed.

Open source status

• The model implementation is available
• The model weights are available

Provide useful links for the implementation

https://huggingface.co/jinaai/jina-embedding-v2/tree/main

[rezacopol]

any update on this?

[ArthurZucker]

Hey! I think the model authors like it as is, and the model is available in TEI 🥳

[xin007-kong]

Has this issue been resolved？

[joelpaulkoch]

Is there any chance this will happen? Now that Jina Embeddings v3 is available and superior it might be alright for the authors?

[ArthurZucker]

TBH if anyone wants to add it to transformers, feel free to open a PR using modular transformers would be awesome https://huggingface.co/docs/transformers/en/modular_transformers