Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
No tool list yet. Remote servers get one after the first health check.
Agent-install list of MCP video servers for reels, clips, and short video. Listing pages point at Hex Videos.
Newsletter
Occasional updates. Confirm by email.
Browse
Guides and advertise
Directories
Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, v
B README.md MCP server
Transport stdio
Status Local
Questions How do I install Bifrost? Copy the stdio config for Cursor, Claude Desktop, Claude Code, or VS Code on this page. It uses the publisher's install, not a PlugMCP proxy.
Does Bifrost need an API key? No required environment variable is listed on this record.
What transport does Bifrost use? Bifrost runs locally over stdio.
When was Bifrost last checked? Last checked 2026-11-08. - Enable AI models to use external tools (filesystem, web search, databases). - Intelligent response caching based on semantic similarity to reduce costs and latency. - Support for text, images, audio, and streaming, all behind a common interface.
From the publisher
Documentation Bifrost AI Gateway
The fastest way to build AI applications that never go down
Bifrost is a high-performance AI gateway that unifies access to 23+ providers (OpenAI, Anthropic, AWS Bedrock, Google Vertex, and more) through a single OpenAI-compatible API. Deploy in seconds with zero configuration and get automatic failover, load balancing, semantic caching, and enterprise-grade features.
Quick Start
Key features 01. - Enable AI models to use external tools (filesystem, web search, databases)02. - Intelligent response caching based on semantic similarity to reduce costs and latency03. - Support for text, images, audio, and streaming, all behind a common interface.04. - Extensible middleware architecture for analytics, monitoring, and custom logic05. - Usage tracking, rate limiting, and fine-grained access control06. - Single API for all providersWorldmonitor Real-time global intelligence dashboard. AI-powered news aggregation, geopolitical monitoring, and infrastructure tracking in a unified situational awareness interface OpenMetadata The Open Context Layer for Data and AI , OpenMetadata is the open platform for building trusted data context and business semantics for humans, AI assistants, and agents. Nightingale Open-source, self-hosted alerting for metrics, logs, and databases. Includes a built-in AI agent and MCP server. Openstatus Open-source status page, incident response and uptime monitoring GitHub Analytics MCP — Repo & Trend Research Repo statistics, trending lookups, code-search queries, and dev-trend aggregation. For AI agents that need to evaluate libraries, monitor competitor projects, or surface emerging open-source tools. Di Google Ads Meta Ads Google Ads MCP server + Meta Ads MCP (Facebook Ads MCP) + Google Analytics MCP (GA4) + Search Console in one hosted remote MCP for Claude, ChatGPT, Cursor & n8n: OAuth login, no API keys, approval-gat MCP Context Forge An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool call Radar The missing open-source Kubernetes UI with a built-in MCP server for AI agents. See what's broken, why, and what changed. Issues, Topology, event timeline, Helm, GitOps, live service traffic, and clus Options Analytics Real-time options analytics MCP server. 23 tools covering gamma/delta/vanna/charm exposure (GEX/DEX/VEX/CHEX), dealer positioning, 0DTE analytics, volatility surfaces, SVI parametrization, arbitrage d MCP Grafana MCP server for Grafana MCP Grafana MCP server for Grafana Dominion Observatory Behavioral trust scoring and MCP gateway proxy for 14,820+ MCP servers. Query real attestation data — interaction history, success rates, latency, uptime — before your agent executes sensitive operati Go from zero to production-ready AI gateway in under a minute.
Step 1: Start Bifrost Gateway
# Install and run locally
npx -y @maximhq/bifrost
# Or use Docker
docker run -p 8080:8080 maximhq/bifrost
Step 2: Configure via Web UI
# Open the built-in web interface
open http://localhost:8080
Step 3: Make your first API call
curl -X POST http://localhost:8080/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"model": "openai/gpt-4o-mini",
"messages": [{"role": "user", "content": "Hello, Bifrost!"}]
}'
That's it! Your AI gateway is running with a web interface for visual configuration, real-time monitoring, and analytics.
Enterprise Deployments Bifrost supports enterprise-grade, private deployments for teams running production AI systems at scale.
In addition to private networking, custom security controls, and governance, enterprise deployments unlock advanced capabilities including adaptive load balancing, clustering, guardrails, MCP gateway, and other features designed for enterprise-grade scale and reliability.
Key Features
Core Infrastructure
Unified Interface - Single OpenAI-compatible API for all providers
Multi-Provider Support - OpenAI, Anthropic, AWS Bedrock, Google Vertex, Azure, Cerebras, Cohere, Mistral, Ollama, Groq, and more
Automatic Fallbacks - Seamless failover between providers and models with zero downtime
Load Balancing - Intelligent request distribution across multiple API keys and providers
Advanced Features
Model Context Protocol (MCP) - Enable AI models to use external tools (filesystem, web search, databases)
Semantic Caching - Intelligent response caching based on semantic similarity to reduce costs and latency
Multimodal Support - Support for text, images, audio, and streaming, all behind a common interface.
Custom Plugins - Extensible middleware architecture for analytics, monitoring, and custom logic
Governance - Usage tracking, rate limiting, and fine-grained access control
Enterprise & Security
Budget Management - Hierarchical cost control with virtual keys, teams, and customer budgets
User Provisioning (OIDC) - OAuth 2.0 / OIDC login with background directory sync for teams, roles, and business units
Observability - Native Prometheus metrics, distributed tracing, and comprehensive logging
Secrets Management - Secure API key management with environment variables and deployment secrets
Developer Experience
Repository Structure Bifrost uses a modular architecture for maximum flexibility:
bifrost/
├── npx/ # NPX script for easy installation
├── core/ # Core functionality and shared components
│ ├── providers/ # Provider-specific implementations (OpenAI, Anthropic, etc.)
│ ├── schemas/ # Interfaces and structs used throughout Bifrost
│ └── bifrost.go # Main Bifrost implementation
├── framework/ # Framework components for data persistence
│ ├── configstore/ # Configuration storage backends
│ ├── logstore/ # Request logging storage backends
│ └── vectorstore/ # Vector storages
├── transports/ # HTTP gateway and other interface layers
│ └── bifrost-http/ # HTTP transport implementation
├── ui/ # Web interface for HTTP gateway
├── plugins/ # Extensible plugin system
│ ├── governance/ # Budget management and access control
│ ├── jsonparser/ # JSON parsing and manipulation utilities
│ ├── logging/ # Request logging and analytics
│ ├── maxim/ # Maxim's observability integration
│ ├── mocker/ # Mock responses for testing and development
│ ├── semanticcache/ # Intelligent response caching
│ └── telemetry/ # Monitoring and observability
├── docs/ # Documentation and guides
└── tests/ # Comprehensive test suites
Getting Started Options Choose the deployment method that fits your needs:
1. Gateway (HTTP API) Best for: Language-agnostic integration, microservices, and production deployments
# NPX - Get started in 30 seconds
npx -y @maximhq/bifrost
# Docker - Production ready
docker run -p 8080:8080 -v $(pwd)/data:/app/data maximhq/bifrost
Features: Web UI, real-time monitoring, multi-provider management, zero-config startup
2. Go SDK Best for: Direct Go integration with maximum performance and control
go get github.com/maximhq/bifrost/core
Features: Native Go APIs, embedded deployment, custom middleware integration
3. Drop-in Replacement Best for: Migrating existing applications with zero code changes
# OpenAI SDK
- base_url = "https://api.openai.com"
+ base_url = "http://localhost:8080/openai"
# Anthropic SDK
- base_url = "https://api.anthropic.com"
+ base_url = "http://localhost:8080/anthropic"
# Google GenAI SDK
- api_endpoint = "https://generativelanguage.googleapis.com"
+ api_endpoint = "http://localhost:8080/genai"
Performance Bifrost adds virtually zero overhead to your AI requests. In sustained 5,000 RPS benchmarks, the gateway added only 11 µs of overhead per request.
Key Performance Highlights:
Perfect Success Rate - 100% request success rate even at 5k RPS
Minimal Overhead - Less than 15 µs additional latency per request
Efficient Queuing - Sub-microsecond average wait times
Fast Key Selection - ~10 ns to pick weighted API keys
Documentation
Quick Start
Features
Integrations
Enterprise
Need Help?
Quick setup assistance and troubleshooting
Best practices and configuration tips
Community discussions and support
Real-time help with integrations
Contributing
Setting up the development environment
Code conventions and best practices
How to submit pull requests
Building and testing locally
License This project is licensed under the Apache 2.0 License - see the LICENSE file for details.