Named Entity Recognition Grammars Package 25.2
Named Entity Recognition Grammars User Guide

# Customize Checksum Validation

During post-processing, Named Entity Recognition attempts to validate a match by calculating a checksum. If validation fails, the match is discarded. You can customize this behavior by setting environment variables that are read by the post-processing script.

To stop rejecting Named Entity Recognition matches that fail checksum validation, set the environment variable `IDOL_PII_CHECKSUM_VALIDATION_STRICT` to `FALSE`. Instead, the script applies a score penalty, and add an `INVALID_CHECKSUM` component to the match.

NOTE: This environment variable has the same name in all grammar sets. That is, it is `IDOL_PII_CHECKSUM_VALIDATION_STRICT` for the PII, PHI, PCI, and GOV grammar post-processing script.

You can configure the score penalty by setting the environment variable `IDOL_PII_CHECKSUM_VALIDATION_FAIL_PENALTY` to a value between 0.0 and 1.0. When validation fails, Named Entity Recognition multiplies the score by this value. The default value is 0.9.

Copyright 2025 Open Text
Version 25.2 | Last updated April 2025

Send documentation feedback

Close

Send documentation feedback

To send feedback using your default email client, open an email window.

Otherwise, send your feedback and the information below to MFI-swpdl.idoldocsfeedback@opentext.com.

We appreciate your feedback!

Product: Named Entity Recognition Grammars Package 25.2

Topic Title: Customize Checksum Validation