AI Providers
LLM Providers
Provider Comparison
| Provider | Example Models | Speed | Quality | Cost | Notes |
|---|---|---|---|---|---|
| OpenAI | GPT-4o, GPT-3.5-turbo | Fast | Excellent | $$ | Most popular, reliable |
| Anthropic | Claude 3.5, Haiku | Fast | Advanced | $$ | Safety-focused |
| Gemini | Gemini 2.0 Flash | Fast | Multimodal | $$ | Google’s latest |
| xAI | Grok Beta, Grok 2 | Very Fast | Good | $ | Real-time, less strict |
| Groq | Llama 3.3, 3.1 | Ultra Fast | Good | $ | Speed-focused |
| Custom | Any | ? | ? | ? | Bring your own! |
How to Set Up Each Provider
OpenAI (GPT)
OpenAI (GPT)
- Sign up for OpenAI
- Go to API Keys and create a new key
- Paste your key in the LLM API Key field
- Choose a model (GPT-4o, GPT-3.5-turbo, etc.)
- (Optional) Set a custom base URL for Azure/OpenAI-compatible endpoints
Anthropic (Claude)
Anthropic (Claude)
- Sign up for Anthropic
- Create an API key
- Paste your key in the LLM API Key field
- Choose a model (Claude 3.5 Sonnet, Haiku, etc.)
Google Gemini
Google Gemini
- Sign up for Google AI Studio
- Get your API key
- Paste your key in the LLM API Key field
- Choose a model (Gemini 2.0 Flash, 1.5 Pro, etc.)
- Set the base URL (auto-filled for Gemini)
xAI (Grok)
xAI (Grok)
- Sign up for xAI
- Get your API key
- Paste your key in the LLM API Key field
- Choose a model (Grok Beta, Grok 2, etc.)
- Set the base URL (auto-filled for xAI)
Groq (Llama)
Groq (Llama)
- Sign up for Groq
- Get your API key
- Paste your key in the LLM API Key field
- Choose a model (Llama 3.3 70B, 3.1 8B, etc.)
Custom Endpoint
Custom Endpoint
- Enter your custom API endpoint URL
- (Optional) Add an API key if required
- Specify the model name
Fallback Chains
Troubleshooting
Common Issues
Common Issues
- Invalid API key: Double-check your key and provider dashboard
- Model not available: Make sure your account has access to the selected model
- Timeouts or errors: Try a different provider or set up fallbacks
- Custom endpoint issues: Ensure your API matches the OpenAI API spec