# Local LLM

This guide will walk you through how to **set a default connection for your preferred LLM provider**. You'll also learn how to **disable the use of StackAI API keys across providers**, **deactivate specific LLM providers**, and manage other advanced configuration options.

Let’s start!

***

### 1. Creating a Default Connection

Navigate to **Settings** on the bottom left of your screen, underneath your avatar. Then, select **Feature Access** from the menu.

Under the **LLMs** section, search for **Local LLMs**—you can follow the same steps for any other provider as well. If needed, this is also where you can **disable specific LLM providers** to prevent your users from accessing them.

<figure><img src="/files/mlQSYTlMCpHClcuKLZJu" alt=""><figcaption></figcaption></figure>

<figure><img src="/files/805Rul0pXEXKMqkuBvHX" alt=""><figcaption></figcaption></figure>

Once you're in the tab for a specific LLM provider, you'll see a toggle to **enable or disable** the provider, as well as a **"New Connection"** button under Default Connection to define it as your primary connection.

<figure><img src="/files/ktcqKbs91WfsaSWNxlCD" alt=""><figcaption></figcaption></figure>

<figure><img src="/files/IoCTAghVmiVNZp3ll55A" alt=""><figcaption></figcaption></figure>

Once you click the button, you can create a connection that will serve as the **default for all LLMs from that provider** within your workspace. This is especially useful because your users **won’t need to manually enter an API key** to use those models.ally.

### 2. Using a Local LLM

<figure><img src="/files/wy6HQLSHcsmeUnYDprXB" alt=""><figcaption></figcaption></figure>

Once the connection is set up, you can **create a new project**, choose your **LLM provider**, select the **specific model** you want to use, and start **interacting with it immediately**.

<figure><img src="/files/PbzbejLj2iyOwHUIUlWE" alt=""><figcaption></figcaption></figure>

You won’t need to manually add the connection—your **default connection will appear automatically at the bottom**. If you prefer to use a different connection, you can **create it directly from that section** and select it for your project.

### 3. Connections Manager

All your connections are stored in the **Connections Manager** tab. You can also **create new connections** from there, and easily **select any of them** when adding an LLM node to your project.

<figure><img src="/files/hvAW6SIraWaXolHG9HZv" alt=""><figcaption></figcaption></figure>

You can choose to make your connections either **public** or **private**, and you’re free to change the **default connection** at any time. Simply go to the **Access Control** tab in your **Settings** to update this preference.

### 3. Disconnecting all StackAI’s API keys usage

If you'd like to prevent any unintended usage of LLMs without your API keys, you can **disable all StackAI API Keys**. This ensures that only LLMs configured to send data to your own servers are allowed. To do this, navigate to **Settings > Feature Access > Other > General LLM Configuration**.

<figure><img src="/files/dQH4fJpuI0FlMx8MW0IN" alt=""><figcaption></figcaption></figure>

<figure><img src="/files/JG9arOn8zRe3aDeX8pd5" alt=""><figcaption></figcaption></figure>


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs.stackai.com/workflow-builder/core-nodes/ai-agent-node/llm-hosting-and-governance/local-llm.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.