NiFi Ingest 26.1
NiFi Ingest

# Introduction

This section describes, step-by-step, how to build a simple ingestion pipeline that includes extraction, filtering, and indexing. This matches the steps performed by CFS with the out-of-the-box configuration.

The following image shows the completed pipeline.

The pipeline includes the following steps:

- File System Connector. The File System Connector retrieves data from a local or network file system. The connector produces a NiFi FlowFile to represent each file that is retrieved from the file system.
- Extraction. Extracts files from containers. For example, if a FlowFile represents a zip archive, File Content Extraction extracts the contents of the archive.
- Filtering. Filtering extracts the text from a file and adds it to the document content. The text can then be indexed, which means that Knowledge Discovery does not need to process the data in its original format.
- Field Standardization. Field standardization modifies documents so that they have a consistent structure and consistent field names. You can use field standardization so that documents which originated from different connectors use the same fields to store the same type of information.
- Remove Document Part. This step removes the binary content or file reference from a FlowFile. Removing file references allows NiFi to delete temporary files.
- Indexing. Documents are indexed into a Content component.

Copyright 2018-2025 Open Text
Version 26.1 | Last updated January 2026

Send documentation feedback

Close

Send documentation feedback

To send feedback using your default email client, open an email window.

Otherwise, send your feedback and the information below to MFI-swpdl.idoldocsfeedback@opentext.com.

We appreciate your feedback!

Product: Knowledge Discovery NiFi Ingest 26.1

Topic Title: Introduction