The smart edge and AI gateway for agents. Arch is a high-performance proxy server that handles the low-level work in building agents like applying guardrails, routing prompts to the right agent, and unifying access to LLMs. It is natively designed to handle prompts, is framework-agnostic, and helps you build agents faster.

A curated list of Awesome-LLM-Ensemble papers for the survey "Harnessing Multiple Large Language Models: A Survey on LLM Ensemble"

Lightweight & fast AI inference proxy for self-hosted LLMs like Ollama, LM Studio and others. Designed for speed, simplicity and local-first deployments.

Unified interface server for various LLM providers with OpenAI API format

Compose, train and test fast LLM routers