Supported Crawling Restrictions for SharePoint

Overview

Restriction Type	Greenlist	Redlist	Details
Time-based Restrictions	✅	❌	Restrict crawling to include/exclude content created/modified/viewed after a certain date.
Identity-based Restrictions	✅	❌	Restrict crawling to include/exclude content created/modified/viewed by specific users or a specific group (plus public content).
Content-based Restrictions	✅	❌	Restrict crawling to include/exclude specific content, documents, messages, or objects.

Restriction	Greenlist	Redlist	Details
Date	✅	❌	Restrict crawling to only content created/modified/viewed after a specific date.
Site	✅	✅	Restrict crawling to include/exclude specific SharePoint sites.

Sites should be provided in URL format without a trailing forward slash. For example:

https://<domain>.sharepoint.com/sites/<siteName>

For Group restrictions when using Azure AD/Entra ID, the Object ID of the AD Group should be provided, NOT the Group name. For example:

7c77a355-c78c-6362-a195-d2428d285107

Date

This restriction cannot currently be applied in the Admin UI.
Time-based restrictions do NOT speed up crawling as content is often not returned from vendor APIs ordered by date.
Some vendor APIs stop returning viewed dates ~4-5 months in the past for specific types of content.

Entra ID Group

This restriction cannot currently be applied in the Admin UI.
Public content, depsite being accessible to all users in SharePoint, will only be viewable in Glean to users in this group.

Site

Every subsite must be explicitly specified. You cannot specify a site collection or parent-site and have the crawler include/exclude all subsites.

Method	Supported	Details
Admin UI	✅	Restrictions can be applied in the Admin UI under the connector settings.
Glean Support	✅	Restrictions can be applied by Glean support on request.

Not all restrictions can be applied in the Admin UI. Please contact Glean support to apply the restriction if it is missing from the UI.