Open topic with navigation

# FollowRobotProtocol

If enabled, the connector follows Robot protocol. Use the parameter `FollowRobotMeta` to determine whether the connector follows the Robot META tags.

If the robot’s protocol disallows your spider access to the Web site or to certain areas of the Web Site, disable this parameter so your spider ignores the robot’s protocol.

Type: | Boolean
Default: | True
Required: | No
Configuration Section: | TaskName or Default
Example: | `FollowRobotProtocol=False`
See Also: |

© Copyright 2019 Micro Focus or one of its affiliates | Send documentation feedback Close Send documentation feedback To open the configured email client on this computer, open an email window. Otherwise, copy the information below to a web mail client, and send this email to swpdl.idoldocsfeedback@microfocus.com. We appreciate your feedback! Product: Topic Title: Help Topic: Feedback:

_FT_HTML5_bannerTitle.htm