NiFi Ingest 24.1

# Track Documents through the Ingestion Pipeline

The Apache NiFi framework stores information about FlowFiles as they move through your ingestion pipeline. You can use the "Data Provenance" feature to see what happened to a document.

To configure searching by IDOL document reference or identifier

1. Stop the NiFi instance.
2. Open the configuration file `./conf/nifi.properties`.

3. Set or review the following properties:

   - `nifi.provenance.repository.indexed.attributes`

     Set this property to `idol.reference, idol.doc.identifier` so that you can search for documents by their IDOL document reference or identifier.

   - You can also specify the maximum amount of storage to use for storing provenance data, and the maximum amount of time to keep the data for.
4. Save and close the configuration file.
5. Start the NiFi instance.

To track a document

1. Open the NiFi user interface.

2. Click followed by Data Provenance.

   The NiFi Data Provenance dialog box opens.

3. Click .

4. Type a document reference (in the idol.reference box) or identifier (in the idol.doc.identifier box) and click SEARCH.

   NOTE: Type the exact reference or identifier. Alternatively, you can use the `*` wildcard to represent any number of characters. However, if you use the `*` wildcard, the backslash character (`\`) becomes a special character and must be escaped. For example:

   - `C:\Some\Path\document.txt` - (a wildcard is not used)
   - `C:\\Some\\Path\\*` - (a wildcard is used , so escape the backslashes in the path. This matches all references that start with `C:\Some\Path\`)

   If the value you want to search for includes a literal asterisk (`*`), escape the asterisk with a backslash (`\`).

   The NiFi Data Provenance dialog box displays events related to the selected document(s).

For more information about data provenance features, refer to the Apache NiFi documentation.

Copyright 2018-2023 Open Text
Version 24.1 | Last updated December 2023

Send documentation feedback

Close

Send documentation feedback

To send feedback using your default email client, open an email window.

Otherwise, send your feedback and the information below to MFI-swpdl.idoldocsfeedback@opentext.com.

We appreciate your feedback!

Product: IDOL NiFi Ingest 24.1

Topic Title: Track Documents through the Ingestion Pipeline