Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 56.3k 9.7k

2. oobabooga/text-generation-webui oobabooga/text-generation-webui Public

   LLM UI with advanced features, easy setup, and multiple backend support.

   Python 44.8k 5.8k

3. OpenBMB/MiniCPM-o OpenBMB/MiniCPM-o Public

   MiniCPM-V 4.5: A GPT-4o Level MLLM for Single Image, Multi Image and Video Understanding on Your Phone

   Python 20.1k 1.5k

4. huggingface/llm-vscode huggingface/llm-vscode Public

   LLM powered development for VSCode

   TypeScript 1.3k 144

5. mlc-ai/llm-perf-bench mlc-ai/llm-perf-bench Public

   Python 119 13

6. llm-vscode-inference-server llm-vscode-inference-server Public

   An endpoint server for efficiently serving quantized open-source LLMs for code.

   Python 56 10