Exclude Models

You can exclude Large Language Models (LLMs) to determine which models are available for Glean Assistant and Glean Agents.

When you exclude a model:

• The model becomes unavailable for selection in the agent builder, Glean Assistant, or both, depending on your configuration.
• Any agents or steps within an agent that were using the excluded model automatically switch to the default model.

Exclude models based on your organization's key type

Glean supports two types of keys: Glean Universal Model Key and Customer Key (BYOK). Depending on the type of key your organization uses, the steps to exclude models and what you can exclude are different.

For both key types, you can exclude individual models with separate controls for Assistant and Agents.

Glean Universal Model Key

You can disable individual models and control whether they're available for Assistant, Agents, or across Glean.

To block a model across Glean:

1. Go to Admin Console → Platform → LLMs.
2. On the Models page, use the search bar, capability filter, or scroll to find the model you want to block.
3. Select the three-dot menu (...) next to the model creator, then click Manage models.
4. For the model you want to block, toggle the model off.
5. Click Save to apply your changes. This blocks the model across Glean.

To block a model for Assistant only:

1. Go to Admin Console → Assistant → Settings.
2. Navigate to the Blocked models in assistant section, then click Manage the blocklist.
3. Search for models to add or remove from the blocklist.
4. Click Save to apply your changes. This blocks the model for Assistant only.

To block a model for Agents only:

1. Go to Admin Console → Agents → Setup.
2. Navigate to the Blocked models in agents section, then click Manage the blocklist.
3. Search for models to add or remove from the blocklist.
4. Click Save to apply your changes. This blocks the model for Agents only.

Customer key (BYOK)

If your organization uses a Customer Key (BYOK), here's how to block models so that your Glean doesn't use them:

1. Go to Admin Console → Platform → LLMs.
2. Click Add LLM.
3. Select a LLM hosting provider.
4. In the Select all models that can be used in agents section, clear the checkbox next to the model you want to exclude.
5. Validate the connection.
6. Click Save. This blocks the model across Glean.

To block a model for Assistant only:

1. Go to Admin Console → Assistant → Settings.
2. Navigate to the Blocked models in assistant section, then click Manage the blocklist.
3. Search for models to add or remove from the blocklist.
4. Click Save to apply your changes. This blocks the model for Assistant only.

To block a model for Agents only:

1. Go to Admin Console → Agents → Setup.
2. Navigate to the Blocked models in agents section, then click Manage the blocklist.
3. Search for models to add or remove from the blocklist.
4. Click Save to apply your changes. This blocks the model for Agents only.

Exclude all premium models

If your organization uses a Glean Universal Model Key, you can exclude all premium models so that your Glean Agents and Glean Assistant can't use them. This may help your organization save costs related to using premium models.

To view a list of premium models, see the Premium tier under Supported models for Glean Agents in LLMs.

tip

Premium models have a $ Premium tag next to their names. This tag helps you identify premium models that incur higher costs so you can be mindful about which models you exclude.

Here are the steps to exclude all premium models:

1. Go to Admin Console → Platform → LLMs.
2. Click Advanced settings.
3. Toggle off the Allow using premium models switch.

This disables the use of premium models immediately in both the agent builder and in Glean Assistant.

Toggle on the Allow using premium models switch to allow premium model usage again.