Distributed Index Handler 25.4
Distributed Index Handler Help

# KillDuplicates

This parameter is identical to the `KillDuplicates` parameter of the DREADD indexing action.

This parameter determines how the Content component handles duplicate documents. It allows you to prevent the same document or document content from being stored in Content more than once.

Type one of the following options. You can post-fix any of these options with =2, to apply the `KillDuplicates` process to all Content databases (rather than only the database into which the current IDX or XML file is being indexed):

`NONE` | Duplicate documents are allowed in Content and are not replaced or deleted.
`REFERENCE` | If the document being indexed has the same `DREREFERENCE` field value as a document that already exists in the Content component, Content deletes the existing document and replaces it with the new document.
`REFERENCEMATCHN` | If the content of the document being indexed is more than `N` percent similar to the content of a document that already exists in the Content component database, Content deletes the existing document and replaces it with the new document.
`FieldName` | If the document being indexed contains a `FieldName` Reference field with the same value as the `FieldName` Reference field in a document that already exists in the Content component, Content deletes the existing document and replaces it with the new document. To specify multiple Reference fields, separate the fields with a plus sign (+) or a space. Content deletes documents containing any of the specified fields with identical content. Fields are identified as Reference fields by field processes in the Content configuration file. If you use a `FieldName` Reference field to eliminate duplicate documents, Content automatically reads any fields listed alongside this field for the PropertyFieldCSVs parameter in the field process, and also uses these fields to eliminate duplicate documents. If you want to define multiple reference fields but do not want them all to be used for document elimination, you must set up multiple field processes (refer to the Knowledge Discovery Administration Guide).

If you do not set `KillDuplicates`, it defaults to the option specified for `KillDuplicates` in the Content configuration file `[Server]` section.

Actions: | DREEXPORTREMOTE
Type: | String
Default: |
Example: | `KillDuplicates=REFERENCE`
See Also: | KeepExisting

Copyright 2025 Open Text
Version 25.4 | Last updated October 2025

Send documentation feedback

Close

Send documentation feedback

To send feedback using your default email client, open an email window.

Otherwise, send your feedback and the information below to MFI-swpdl.idoldocsfeedback@opentext.com.

We appreciate your feedback!

Product: Knowledge Discovery Distributed Index Handler 25.4

Topic Title: KillDuplicates