Inference

Inference selects which model connection the agent uses and lets you fine-tune its behavior with model parameters.

​

Model connection

The Model connection dropdown lists all connections registered in Settings → Model Connections. Select the one this agent should use — credentials are inherited from the connection; you do not re-enter API keys here. Each option shows the connection name, type, and model ID (e.g., GPT-4o Production — OpenAI with gpt-4o below). Different agents in the same workspace can use different connections. Common patterns:

• Use a powerful model (e.g., Claude Sonnet, GPT-4o) for complex reasoning agents
• Use a fast, cheap model (e.g., Groq Llama, Claude Haiku) for simple classification or routing agents
• Use a custom endpoint for local development and testing

​

Model parameters

Model parameters are optional key-value pairs passed to the LLM at inference time. They let you tune the model’s behavior per-agent without changing the connection itself. Common parameters:

​

Next steps

With a model connection selected, your agent is ready to run. From here you can optionally add: