Skip to content

Choose Your AI Model

ProviderModelsKey CommandBest For
AnthropicClaude Sonnet 4.6, Opus 4.6vault set anthropic_api_keyBest reasoning, tool use
OpenAIGPT-4o, GPT-5.3vault set openai_api_keyFast, widely available
GoogleGemini 2.0 Flash, Provault set gemini_api_keyLarge context window
xAIGrok 3, Grok 3 Minivault set xai_api_keyWeb search built-in
OllamaLlama 3, Mistral, Phi-3(no key needed)Free, private, offline
Any OpenAI-compatibleLM Studio, vLLM, Groq, Together, Fireworks, DeepSeekvault set openai_compat_api_keyCustom endpoints
Terminal window
# Cloud providers (pick one)
aibutler vault set anthropic_api_key sk-ant-...
aibutler vault set openai_api_key sk-...
aibutler vault set gemini_api_key AIza...
# Local (no key needed — just install Ollama)
# https://ollama.com
ollama pull llama3
aibutler run # auto-detects Ollama

Change model at any time in ~/.aibutler/config.yaml:

settings:
model: claude-sonnet-4-6 # or: gpt-4o, gemini-2.0-flash, llama3

Or switch in the REPL:

/model gpt-4o

AI Butler tracks every token and dollar spent:

Terminal window
aibutler cost status # Current spend
aibutler cost breakdown # Per-model breakdown
aibutler cost budget 50 # Set $50/month budget

Strategies: frugal (minimize cost), balanced (default), quality (maximize quality).

Run completely offline with local models:

settings:
offline_mode: true
model: llama3

No data leaves your machine. Zero cloud API calls.