Web Connector 25.4
Web Connector Help

# RobotProtocolEnableCache

A Boolean value that specifies whether to cache downloaded robot protocol data (`robots.txt`), and use the cache to improve connector performance.

The cached data is shared across synchronize cycles and between tasks.

Type: | Boolean
Default: | True
Required: | No
Configuration Section: | TaskName or FetchTasks
Example: | `RobotProtocolEnableCache=FALSE`
See Also: | FollowRobotProtocol RobotProtocolCacheDirectory

Copyright 2025 Open Text
Version 25.4 | Last updated October 2025

Send documentation feedback

Close

Send documentation feedback

To send feedback using your default email client, open an email window.

Otherwise, send your feedback and the information below to MFI-swpdl.idoldocsfeedback@opentext.com.

We appreciate your feedback!

Product: Knowledge Discovery Web Connector 25.4

Topic Title: RobotProtocolEnableCache