llm-proxy

Here are 4 public repositories matching this topic...

thushan / olla

Lightweight & fast AI inference proxy for self-hosted LLMs backends like Ollama, LM Studio and others. Designed for speed, simplicity and local-first deployments.

golang ai proxy self-hosted llamacpp vllm llm-inference ollama llm-proxy lmstudio llm-router llm-routing self-hosted-ai

Updated Aug 9, 2025
Go

evgensoft / ai-proxy

Star

Proxy for many LLM-provider with OpenAI like request

llm-proxy ai-proxy

Updated May 4, 2025
Go

Motlify / gen-ai-proxy

Star

A self-hosted, open-source (Apache 2.0) proxy for LLM's with prometheus metrics

proxy-server llmops llm-proxy

Updated Jul 30, 2025
Go

nguyenvanduocit / aiproxy

Star

llm-proxy ai-proxy

Updated Aug 2, 2024
Go

Improve this page

Add a description, image, and links to the llm-proxy topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the llm-proxy topic, visit your repo's landing page and select "manage topics."

Learn more

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

llm-proxy

Here are 4 public repositories matching this topic...

thushan / olla

evgensoft / ai-proxy

Motlify / gen-ai-proxy

nguyenvanduocit / aiproxy

Improve this page

Add this topic to your repo