Skip to main content

Exclude Models From Glean Agents

You can exclude Large Language Models (LLMs) to determine which models are available for your Glean Agents and Glean Assistant.

When you exclude a model or model family:

  • Depending on your configuration, the models are unavailable for selection in the agent builder or in Glean Assistant.
  • Any agents or steps within an agent that were using a previously included model will automatically start using the default assistant model.

Exclude models based on your organization's key type

Glean supports two types of keys: Glean Universal Model Key (formerly Glean Key) and Customer key (BYOK). Depending on the type of key your organization uses, the steps to exclude models and what you can exclude are different.

Key typeWhat you can exclude
Glean Universal Model KeyModel families for agents and Glean Assistant
Customer key (BYOK)Specific models for agents

Glean Universal Model Key: Exclude model families

If your organization uses a Glean Universal Model Key, you can exclude model families so that your agents or Glean Assistant can't use them. This means that you can exclude all models from a particular family.

First, navigate to the Model Hub for your LLM provider:

  1. Go to Admin Console → Platform → LLMs.
  2. In the Manage models for agents and assistant section, click Manage next to the model family you want to exclude.
  3. In the Agent model families or Assistant model families section, hover over the model family you want to exclude.
  4. Click the Exclude button.
  5. A pop-up appears to confirm the exclusion. Click Exclude to proceed.

This disables the use of the excluded models immediately in the agent builder or in Glean Assistant, depending on your configuration.

Customer key (BYOK): Exclude specific models

If your organization uses a Customer Key (BYOK), you can exclude specific models so that your agents can't use them.

To exclude specific models for agents:

  1. Go to Admin Console → Platform → LLMs.
  2. Click Add LLM.
  3. Select a LLM hosting provider.
  4. In the Select all models that can be used in agents section, clear the checkbox next to the model you want to exclude.
  5. Validate the connection.
  6. Click Save.

This disables the use of the excluded models immediately in the agent builder.

Glean Assistant uses the models you specify in Select the models for Assistant section. This section also provides a list of default models that Glean Assistant will use if you don't specify any models.

Exclude all premium models

Whether your organization uses a Glean Universal Model Key or a Customer Key (BYOK), you can exclude all premium models so that your agents and Glean Assistant can't use them. This may help your organization save costs related to using premium models.

To view a list of premium models, see the Premium tier under Supported models for Glean Agents in LLMs.

tip

Premium models have a $ Premium tag next to their names. This tag helps you identify premium models that incur higher costs so you can be mindful about which models you exclude.

Here are the steps to exclude all premium models:

  1. Go to Admin Console → Platform → LLMs.
  2. Click Advanced settings.
  3. Toggle off the Allow using premium models switch.

This disables the use of premium models immediately in both the agent builder and in Glean Assistant.

Toggle on the Allow using premium models switch to allow premium model usage again.