llm-smolvlm

SmolVLM for LLM

Installation

Install this plugin in the same environment as LLM.

llm install https://github.com/simonw/llm-smolvlm/archive/refs/heads/main.zip

Usage

Warning

This model does not yet support conversations - you can use it to send single prompts but the llm -c and llm chat modes will not take previous messages into account.

Run prompts against images like this - only URLs to images are supported at the moment.

llm -m smolvlm 'describe this image' -a https://static.simonwillison.net/static/2024/pelicans.jpg

Development

To set up this plugin locally, first checkout the code. Then create a new virtual environment:

cd llm-smolvlm
python -m venv venv
source venv/bin/activate

Now install the dependencies and test dependencies:

llm install -e '.[test]'

To run the tests:

python -m pytest