Which LLM Should I Use With Aori?
One of Aori’s most powerful features is that it is model-agnostic. You “Bring Your Own Key,” which means you aren’t locked into a single provider’s ecosystem. But with so many options—Groq, OpenAI, Anthropic, DeepSeek, Ollama—how do you choose?
Here’s our guide to the best LLM setups for Aori v1.3.
Start Here: Groq (Free & Fast)
Section titled “Start Here: Groq (Free & Fast)”If you’re just getting started with Aori, there is no better choice than Groq.
Groq offers incredibly fast inference and a generous free tier that is perfect for daily agent use. It supports high-quality open-source models like Llama 3.3 70B, which is more than capable of handling Aori’s routines, memory extraction, and general chat.
Recommendation for new users: Start with Groq — it’s free, fast, and requires no credit card.
For the Best Quality: Anthropic Claude
Section titled “For the Best Quality: Anthropic Claude”When you need the absolute best in reasoning, nuance, and long-context performance, Anthropic’s Claude series is the gold standard.
- Claude 3.5 Sonnet: The ideal “power user” model. It excels at complex task planning and following intricate instructions.
- Claude 3.5 Haiku: A faster, more affordable alternative that still maintains high intelligence for daily tasks.
Anthropic typically offers a $5 credit on signup, which can go a long way with Aori.
For Broad Capability: OpenAI
Section titled “For Broad Capability: OpenAI”OpenAI remains a popular choice for its reliability and wide range of features, including native vision support.
- GPT-5.x (Flagship): The most capable model for highly complex agent tasks and deep reasoning.
- GPT-4o (Popular): A versatile, high-performance model that balances speed and intelligence perfectly.
- GPT-4o mini: An extremely cost-effective option for simple queries and high-volume tasks.
If you use Smart Routing in v1.3, Aori can automatically switch between these to save you money.
For Desktop Local Models: Ollama
Section titled “For Desktop Local Models: Ollama”If you want to run models from your own desktop machine, Ollama is the option to look at.
Ollama runs open-source models (like Llama 3.2 or Mistral) on your computer’s hardware. Aori Desktop connects to your running Ollama server. Aori does not bundle local models or provide mobile local inference in this launch.
For Cost Efficiency: DeepSeek
Section titled “For Cost Efficiency: DeepSeek”DeepSeek has quickly become a favorite for users who want flagship-level performance at a fraction of the cost. Their reasoning models are surprisingly strong, making them an excellent choice for heavy daily use on a budget.
Quick Reference Table
Section titled “Quick Reference Table”| Provider | Free Tier? | Speed | Quality | Best For |
|---|---|---|---|---|
| Groq | Yes | Extreme | High | Getting started, daily use |
| Anthropic | $5 Credit | Fast | Elite | Nuance, complex reasoning |
| OpenAI | $5 Credit | Fast | Elite | Flagship power (GPT-5.x), vision |
| DeepSeek | Yes | Medium | High | High-volume tasks, budget power |
| Ollama | Free local runtime | Variable | Good | Desktop local models |
| OpenRouter | No | Variable | Mixed | Accessing niche models |
The Verdict
Section titled “The Verdict”Don’t overthink it. Most users should start with Groq. It’s the easiest way to see what Aori can do without spending a dime.
As your needs grow—if you find yourself needing more nuanced reasoning or longer context windows—you can switch to Claude 3.5 Sonnet or GPT-5.x in seconds via Aori’s settings. Your memory and routines will follow you wherever you go.
— The Aori Team