SUPPORTED ECOSYSTEM & MODEL CATALOG

Connect Any Provider, Framework, or Observability Pipeline

AgentMink provides unified proxy routing across all frontier providers, open-weights inference engines, developer frameworks, and webhook destinations with zero code refactoring.

PROVIDER

OpenAI

Full compatibility with GPT-4o, GPT-4o mini, o1, and o3-mini models via direct BYOK key execution with zero token markup.

Native Structured Outputs & Tools
Automated 503 Provider Failover
Operational (99.99%) Docs →
PROVIDER

Anthropic

Direct proxy access to Claude 3.5 Sonnet, Claude 3.5 Haiku, and Claude 3 Opus with sub-millisecond format translation.

Extended Context & Thinking Mode
Zero-Markup AES-GCM BYOK
Operational (99.99%) Docs →
PROVIDER

Google Gemini

High-throughput routing to Gemini 2.0 Flash, Gemini 1.5 Pro, and Flash-Lite models with cost-first arbitrage.

1M+ Token Context Window Routing
Ultra-Low Cost Processing
Operational (99.99%) Docs →
ULTRA-FAST

Groq LPU

Hardware-accelerated inference for Llama 3.3 70B, DeepSeek R1, and Mixtral delivering sub-50ms Time-To-First-Token.

Latency-First Automatic Dispatch
500+ Tokens/Sec Output Speed
Operational (99.99%) Docs →
PROVIDER

DeepSeek

DeepSeek-V3 and DeepSeek-R1 reasoning models routed dynamically for complex code generation and mathematical analysis.

Frontier Math & Code Performance
90% Lower Token Cost vs Frontier
Operational (99.99%) Docs →
PROVIDER

Mistral AI

Mistral Large 2, Codestral, and Pixtral endpoints accessible directly with automatic JSON format validation.

Multilingual & Code Specialization
European Data Residency Compatible
Operational (99.99%) Docs →
PROVIDER

Together AI

Access 100+ open-weights models including Llama-3, Qwen 2.5, and specialized fine-tunes through one unified endpoint.

Open-Source Model Catalog
Dynamic Cost Arbitrage Routing
Operational (99.99%) Docs →
ROUTER

OpenRouter

Secondary failover backend connecting to 200+ global model endpoints with real-time rate tracking.

6h Edge Pricing Matrix Sync
Automatic Model Fallback Pools
Operational (99.99%) Docs →
ENTERPRISE

AWS Bedrock

Enterprise VPC and IAM credential proxying for Claude, Amazon Titan, and Jurassic models deployed in private clouds.

SOC2 & HIPAA Compliant Tunnels
Dedicated Enterprise Gateways
Operational (99.99%) Docs →
FRAMEWORK

Vercel AI SDK

Drop-in compatibility with Next.js, Nuxt, and SvelteKit apps using createOpenAI({ baseURL }).

Server-Sent Events (SSE) Streaming
useChat() & useCompletion() Hooks
Verified Native Snippet →
FRAMEWORK

LangChain & LangGraph

Compatible with Python and TypeScript LangChain ChatOpenAI classes for multi-agent chains and state graphs.

Zero-Refactoring openai_api_base
Automatic Agent Loop Resilience
Verified Native Snippet →
FRAMEWORK

LlamaIndex

High-throughput RAG and document vector ingestion pipelines with cost-first extraction and quality-first synthesis.

RAG Pipeline Cost Arbitrage
Vector Query Failover Protection
Verified Native Snippet →
FRAMEWORK

CrewAI & AutoGen

Autonomous multi-agent orchestration frameworks protected by per-key spending caps and rate limit failover.

Runaway Loop Spending Guardrails
Per-Agent Strategy Specialization
Verified Native Snippet →
ALERTS

Slack Incident Webhooks

Instant alerts dispatched to your engineering Slack channels on spend cap thresholds, 5xx provider failovers, or quota spikes.

Spend Cap & Quota Warning Alerts
Zero-Config Incoming Webhooks
Operational (99.99%) Setup →
ALERTS

Discord Webhooks

Real-time community and developer notification channels for prompt volume anomalies and daily cost summary digests.

Daily Spending Summary Digests
Instant Error Anomaly Alerts
Operational (99.99%) Setup →
TELEMETRY

Custom HTTP Webhooks

Stream per-request telemetry payloads to your internal Datadog, Grafana, or logging microservices via secure POST endpoints.

HMAC-SHA256 Payload Signatures
Non-Blocking Edge Delivery
Operational (99.99%) Docs →
OPEN EXTENSIBILITY

Don’t See Your Custom or Self-Hosted Model?

AgentMink routes to any OpenAI-compatible API endpoint or self-hosted vLLM / Ollama instance. Configure private upstreams in your workspace settings.

Configure Custom Upstream →
START ROUTING

Connect Your First Provider in Under 2 Minutes

Sign up for a free developer account and start executing requests with automatic cost arbitrage, smart failover, and sub-50ms latency.