Open topic with navigation

# DistributeByReference

Set `DistributeByReference` to `True` if you want HPE DIH to index data based on the reference of the documents being indexed or replaced in. This option applies to DREADD, DREADDDATA and DREREPLACE index actions. To use distribute by reference mode, you must configure standard field processing options to specify the reference field to use to distribute documents. For details, see the IDOL Server Online Help and IDOL Server Administration Guide.

NOTE:

You can use this distribution mode only when MirrorMode is set to `False`. HPE DIH will not start if you attempt to configure this distribution mode when MirrorMode is set to `True`.

Reference-based indexing improves the efficiency of data distribution, and reduces the network traffic and load on the child servers. In this mode, HPE DIH uses the document reference to spread the load evenly between all configured servers. With reference-based indexing, HPE DIH sends only the documents that the child server must index, whereas in plain non-mirror mode, HPE DIH sends all index actions to all servers and the child servers calculate the documents to index.

If you enable this option, you cannot alter the number of child servers that HPE DIH indexes to.

When `DistributeByReference` is set to `True`, DIH always distributes documents according to the reference. If a child server goes down, it queues the documents for that child server, and indexes them when the server becomes available. Unlike simple non-mirror mode, it does not redistribute the documents to available servers.

NOTE:

Reference-based indexing can prevent deduplication of documents with different references, so use reference-based indexing only with a `KillDuplicates=REFERENCE` or `KillDuplicates=NONE` setting in the `[Server]` section of the IDOL configuration file.

If you have chained HPE DIHs in distribute by reference mode, documents might not be distributed evenly by the child servers. Documents are evenly distributed only if the number of child servers at each level are coprime (that is, they have no common factors).

For example, if you have a parent HPE DIH that has two HPE DIH children, each of which has three IDOL server children, documents are distributed properly if all the HPE DIHs are in distribute by reference mode. However, if the parent HPE DIH is distributing by reference to two HPE DIH children, each of which distributes by reference to four IDOL server children, documents are not evenly distributed.

Type: | Boolean
Default: | False
Required: | No
Configuration Section: | Server
Example: | `DistributeByReference=True`
See Also: | Field Processing Configuration Parameters

© 2017 Hewlett Packard Enterprise Development LP | Send documentation feedback to HPE Close Send documentation feedback To open the configured email client on this computer, open an email window. Otherwise, copy the information below to a web mail client, and send this email to AutonomyTPFeedback@hpe.com. We appreciate your feedback! Product: Topic Title: Help Topic: Feedback:

_HP_HTML5_bannerTitle.htm