RobotProtocolEnableCache

A Boolean value that specifies whether to cache downloaded robot protocol data (robots.txt), and use the cache to improve connector performance.

The cached data is shared across synchronize cycles and between tasks.

Type: Boolean
Default: True
Required: No
Configuration Section: TaskName or FetchTasks
Example: RobotProtocolEnableCache=FALSE
See Also:

FollowRobotProtocol

RobotProtocolCacheDirectory