CoAI

Stale
GitHub TypeScript Apache-2.0

Description

Next Generation Multi-tenant AI One-Stop Solution with built-in admin and billing. Enterprise-grade unified LLM gateway supporting 200+ models and 35+ providers.

Key Features

  • Unified LLM gateway supporting 200+ models from 35+ providers including OpenAI, Anthropic, and Gemini
  • Enterprise-grade multi-tenant architecture with built-in admin dashboard and subscription billing system
  • Beautiful responsive UI compatible with PC/Pad/Mobile, supporting light/dark themes and i18n
  • Powerful channel management with priority settings, load balancing, and automatic failure retry
  • Supports text-to-image (DALL-E, Midjourney, Stable Diffusion) and full Markdown rendering including LaTeX
  • Model caching: identical request parameter hashes return cached results with no billing on cache hits

Use Cases

💡 Internal enterprise AI service platform with independent tenant and quota management per team
💡 AI startups quickly build multi-model aggregation APIs to offer SaaS services externally
💡 Educational institutions deploy unified AI platforms with multi-language and multi-model comparison
💡 Distribute LLM capabilities via OpenAI API-compatible format while running B2B and B2C businesses
💡 Web-search-augmented conversations via SearXNG, combined with OCR and file parsing for RAG applications

Tags

chatbot llm api tools framework

Categories

💬 Chat UI

Quick Start

1. Clone the repository and navigate to the project directory
2. Configure model provider API keys in the .env file
3. Run docker compose up to start the service
4. Access localhost:3000 to enter the admin dashboard
5. Configure model channels and billing rules in the admin panel
6. Register a user and start testing conversations
Visit GitHub Visit Website

Related Projects