If you have received an email stating that “Endpoint XYZ is running into errors” with a distribution of HTTP status codes, this guide will help you understand what it means and how to address the issue.
The Glean Assistant calls the endpoint mentioned in the email to make requests to your LLM provider (Azure, OpenAI, Google Vertex AI, or Amazon Bedrock). You are receiving the alert because the endpoint has been returning errors. Glean does not have administrative access to your LLM provider, so we need your help to resolve these issues.
These status codes usually indicate an authentication issue with the endpoint. Please check that your account with your LLM provider is still active and the Admin > Setup > Assistant > LLM Provider settings are correct.
This status code indicates that the endpoint might be underprovisioned for your traffic. Please refer to Glean Assistant LLM Providers to check if you are appropriately provisioned. Contact a Glean representative if you believe you are provisioned correctly but are still receiving 429 errors.