Connector Framework Server 25.1
Connector Framework Server Help

# filter_nist_rds

The function `filter_nist_rds` calculates the checksum of the file associated with a document. If the checksum is present in a NIST RDS hash set, the function adds the fields `AUTN_NIST_RDS_LIST`, `AUTN_NO_FILTER`, and `AUTN_NO_EXTRACT` to the document.

The NIST RDS hash sets contain the checksums of millions of files that originate from operating systems and application software, so you can use this function to filter out documents that represent those files.

NOTE: Before using this function you must populate a datastore with the NIST RDS hash set(s). For information about how to do this, see Identify Files in a NIST RDS Hash Set.

## Syntax

    filter_nist_rds(document, section)

## Arguments

Argument | Description
--- | ---
`document` | (LuaDocument) The document to check.
`section` | (string) The name of a section in the CFS configuration file that contains the task settings to use.

## Examples

The following example discards any document where the associated file matches an entry in a NIST RDS hash set.

    function handler(document)
        filter_nist_rds(document, "NistRdsFilterSection")
        return not document:hasField("AUTN_NIST_RDS_LIST")
    end

The task might be configured, in the CFS configuration file, as follows.

    [NistRdsFilterSection]
    NistRdsStoreType=BTREE

Copyright 2024 Open Text
Version 25.1 | Last updated January 2025

Send documentation feedback

Close

Send documentation feedback

To send feedback using your default email client, open an email window.

Otherwise, send your feedback and the information below to MFI-swpdl.idoldocsfeedback@opentext.com.

We appreciate your feedback!

Product: Knowledge Discovery Connector Framework Server 25.1

Topic Title: filter_nist_rds