Web Connector 25.4
Web Connector Help

# Block Resource Downloads

You can configure Web Connector so that it does not download certain resources, such as scripts or advertisements. This can result in fewer HTTP requests, reduce the amount of time required for a synchronize task, and prevent unwanted content from contaminating your text index.

Resources include stylesheets, JavaScript files, images, and other items that are used to construct a page. You can block resources from being downloaded by regular expression or by using block lists.

To block page resources

- Set the configuration parameters ResourceUrlCantHaveRegex and ResourceUrlMustHaveRegex. These block resources where the URL of the resource matches, or does not match, a regular expression. For example, you could exclude all resources that do not originate from your own domain:

      ResourceUrlMustHaveRegex=https://www\.example\.com.*

- Set the configuration parameter BlockingFiltersDirectory to the path of a directory that contains filter lists. You can use filter lists from https://easylist.to, or create your own in the same format. The filter lists are used to block undesirable content.

Copyright 2025 Open Text
Version 25.4 | Last updated October 2025

Send documentation feedback

Close

Send documentation feedback

To send feedback using your default email client, open an email window.

Otherwise, send your feedback and the information below to MFI-swpdl.idoldocsfeedback@opentext.com.

We appreciate your feedback!

Product: Knowledge Discovery Web Connector 25.4

Topic Title: Block Resource Downloads