Crawl strategy

The Glean crawling system retrieves and indexes content from source applications. It balances two goals: minimizing the time between a change in the source and its appearance in Glean, and keeping API call volumes within limits that prevent source application overload.

Crawl types

Full, incremental, activity, identity, and people data crawls — what each does and when Glean runs it.

Refresh rates

Default crawl frequencies by connector, organized by category.

Deletion handling

How Glean detects and removes deleted content, including webhook-based and full-crawl cleanup.