Bring Your Own Key (BYOK)

Overview

To enable Glean Generative AI features, you need to select an LLM provider and an associated account.

By default, generative AI features will use an underlying account key provided by Glean, however you can opt to use your own account key for the LLM provider of your choice (as long as the underlying provider is supported by Glean).

Glean currently supports the following LLM Providers:

• Anthropic
• OpenAI
• Azure OpenAI
• Google Vertex AI
• Amazon Bedrock

note

There are minimum throughput and capacity requirements that must be met when using your own key. Failure to meet these requirements may result in degraded performance for your users.

For more information, please see the Supported LLMs page.

---

Configure BYOK

1. Navigate to Admin console → Platform → LLMs.
2. Click Add LLM.
3. Select a hosting provider and configure its credentials.
4. Click Validate, select the models you want to make available, and click Save.

Follow the provider-specific instructions in the following tabs.

Anthropic

You will need an Anthropic API Key from the Anthropic Console to continue.

To use an Anthropic API key:

1. Select Anthropic as the hosting provider.
2. Paste your Anthropic API key into API key.
3. Optional: Enter a custom endpoint in Base URL.
4. Click Validate.
5. Select the models you want to make available and click Save.

Locating your Anthropic API Key

1. Click here to go to the API keys section of the Anthropic Console.
2. Click Create key.
3. Select a Workspace to create the key under and provide the key with a name, for example, glean-assistant. Click Add when done to reveal the API key.
4. Copy the API key displayed. You won't be able to view it again after clicking away.

OpenAI

You will need an OpenAI API Key and your OpenAI Organization ID to continue.

To use an OpenAI API key:

1. Select OpenAI from the dropdown.
2. Select the OpenAI LLM model to use from the dropdown. We recommend selecting the most recent frontier model from the list (for example, GPT-5.1).
3. Paste your OpenAI API Key into the OpenAI key field.
4. Paste your OpenAI Organization ID into the Organization ID field.
5. Click Submit to validate and save your key.

Locating your OpenAI API Key

1. Click here to go to the API keys section of the OpenAI Dashboard.
2. Click Create new secret key.
3. Provide the key with a name, for example, Glean, and click Create secret key.
4. Copy the API key displayed. You won't be able to view it again after clicking away.

1. Click here to go to the Organization settings of the OpenAI Dashboard.
2. Copy the value listed under Organization ID.

Azure OpenAI

You will need the following to continue:

• Azure OpenAI Key and Endpoint.
• Agentic GPT model deployment name (for example, GPT-5.1).
• Fast agentic GPT model deployment name (for example, GPT-5.1).
• Azure embeddings deployment name (for example, Ada-Embedding, text-embedding-ada-004).

To use your Azure OpenAI key:

1. Select Azure OpenAI from the dropdown in the Custom API Key section.
2. Paste your Azure OpenAI key into the Key 1 field.
3. Paste the endpoint URL into the Endpoint field (drop the https:// as it is not required).
4. For each of the models listed, paste the deployment name into the field.
5. Click Submit to validate and save your settings.

See: Retrieve key and endpoint (learn.microsoft.com)

1. From the Azure Portal, search for and navigate to the Azure OpenAI page.

2. On the left-side menu, select Model deployments then Manage Deployments

   

3. On the Deployments page, you will see a list of all existing model deployments and the Deployment name specified for each.

4. For each of the required models listed above, copy the Deployment name. This will be pasted into the Glean Admin UI.

   

5. If you are missing some of the required models, or have no deployments, you will need to create a new deployment for each required model.

   a. Click the Create new deployment button.

   b. Select the required model from the list.

   c. Specify a deployment name.

   d. Set the Content Filter to Default.

   e. For quota recommendations, see Supported models.

   f. Click Create to deploy the model.

Vertex AI

note

Vertex AI is only supported when your Glean instance is hosted on GCP's infrastructure.

1. Select Vertex AI from the dropdown in the Glean UI.
2. Select the Vertex AI model to use: Gemini or Claude.
3. Follow the prompts to complete the setup process.

Amazon Bedrock

note

Amazon Bedrock is only supported when your Glean instance is hosted on AWS's infrastructure.

1. Select Amazon Bedrock from the dropdown in the Glean UI.
2. Select the Claude LLM model to use.
3. Follow the prompts to complete the setup process.

Troubleshoot common issues

If validation fails when you submit your key, or you see errors after setup:

• Check your API key: Confirm the key is still active and hasn't been rotated or revoked in your provider's portal.
• Check deployment names (Azure OpenAI): Deployment names must match your Azure Portal exactly. See Use GPT models on Azure OpenAI for Azure-specific guidance.
• Check capacity: Your provider account must meet the minimum throughput requirements listed on the supported LLMs page. Insufficient quota can cause rate-limit errors.

For detailed error codes and resolution steps, see Troubleshoot LLM provider errors.

Estimate LLM usage costs

warning

The following data should be considered an estimate only. It is based on average usage across multiple Glean customers, however your actual usage may vary.

We recommend using Glean's LLM key if you have concerns around LLM usage costs.

The following costs per query can be used as a rough guide to help you estimate your LLM usage costs with Glean. All costs are in USD.

LLM Provider	Models Used	Aggregate Avg Cost per Glean Query
OpenAI	GPT-5.1 Ada Embeddings	$0.07
Azure OpenAI	GPT-5.1 Ada Embeddings	$0.07
Vertex AI - Gemini	Gemini Pro Custom Tools 3.1 Gemini Flash 3.0 Gecko Embeddings	$0.02
Vertex AI - Claude	Claude Sonnet 4.6 Gecko Embeddings	$0.04
Amazon Bedrock - Claude	Claude Sonnet 4.6 Titan Text Embeddings G1	$0.07