Prerequisites
- Docker Desktop (v24+) or Docker Engine + Docker Compose v2
- Git
- 8 GB RAM minimum (16 GB recommended if using local models with Ollama)
Quick start
.env uses the Lite auth strategy for Studio or InsightHub, the default credentials are:
Cloud and custom models
Studio is where you register cloud LLMs (Anthropic, OpenAI, Groq, etc.): open Settings → Models Registry, add each model, and paste the API key — credentials are stored as secrets. Use Base URL when you point at OpenAI-compatible gateways, proxies, or self-hosted endpoints; you are not limited to a fixed list baked into.env.
(The optional Ollama workflow below still uses Compose for local pull-and-register — see Local models with Ollama.)
Local models with Ollama
The stack includes optional Ollama support for running inference locally (CPU-based):OLLAMA_MODELS:
- Models with
embedin the name → registered as Embeddings Models in Studio - All others → registered as chat models
Adding Ollama models without restarting
Useful commands
Next steps
First login
Log in to Studio and take the onboarding tour.