Connect to Databricks

Required permissions for setup

The user setting up this data source must be a Databricks Account Admin or have credentials for an existing Service Principal granted the Account Admin role. Note: If you already have a Service Principal and OAuth Secret, you can skip their creation steps.

Determine the URL of your Databricks instance

  1. Sign into Databricks as an Account Admin by visiting the link corresponding to your cloud provider:
  2. Wait until the page loads with the parameter account_id, then copy the entire URL and paste it into the Account URL field within Glean.

Generate a new service principal

  1. While logged in as an Account Admin, navigate to the “User management” page in Databricks and click on the “Service principals” tab.
  2. Click “Add service principal” and enter “Glean” into the Name field before pressing “Add” to continue.
  3. Go to the service principal created.
  4. Navigate to the “Roles” tab and make sure the “Account Admin” role is toggled on before continuing.

Add an OAuth secret to your new service principal

  1. Go to the “Principal information” tab, and under “OAuth secrets”, click “Generate secret” and set the lifetime to 720 days.
  2. Click “Generate” then copy and paste the Secret field value into the OAuth Secret field within Glean.
  3. Copy the Client ID field value and paste it into the OAuth Client ID field within Glean.

(For Azure Databricks Workspaces only) Enter your workspace URLs

  1. Navigate back to the “Workspaces” tab in Databricks
  2. For each workspace listed on this page:
    • Click “Add additional workspace” within Glean
    • In Databricks, click on a workspace name to view the workspace configuration details
    • Copy the workspace name and paste it into the Workspace name field within Glean.
    • Next, copy the URL value under the URL field and paste it into the Workspace URL field within Glean.
Click Save in Glean. You’re all set!