NiFi Ingest 25.2
NiFi Ingest

# Add Subfile Extraction

The first step in this example ingestion pipeline is subfile extraction. This extracts individual files from containers (such as zip files or other types of archives) so that they can be processed by other processors.

To add subfile extraction

1. Add a funnel, by dragging the funnel icon from the components toolbar to the canvas.

2. Create a connection between the GetFileSystem connector and the funnel. Hover the mouse over the connector until you see the connection icon - - and then drag the icon to the funnel.

   The Create Connection dialog box opens.

3. In the Relationships area, select the success check box, because we want to extract documents that were successfully retrieved. Then, click Add.

   The connection appears on the canvas. NiFi automatically adds a queue between the connector and the funnel.

4. Add a processor, by dragging the processor icon from the components toolbar to the canvas.

   The Add Processor dialog box opens.

5. Select the KeyViewExtractFiles processor and click ADD.

   The processor is added to the canvas.

6. Create a connection from the funnel to the KeyViewExtractFiles processor. Hover the mouse over the funnel until you see the connection icon - - and then drag the icon to the KeyViewExtractFiles processor.

   The Create Connection dialog box opens.

7. Click the Settings tab.

8. Drag the PriorityAttributePrioritizer from the Available Prioritizers area to the Selected Prioritizers area. This configures the queue such that File Content Extraction will process subfiles before extracting new containers. For more information about this configuration, see Extract Subfiles Recursively.

9. Click Add.

   The connection is created.

   In its default configuration, the KeyViewExtractFiles processor creates new documents for extracted subfiles, and routes them to the "subfile" relationship. These subfiles might also be containers, for example a zip file can contain another zip file. To extract files recursively, route this relationship back to the funnel as described in the next step.

10. Create a connection from the KeyViewExtractFiles processor to the funnel. Hover the mouse over the processor until you see the connection icon - - and then drag the icon to the funnel.

    The Create Connection dialog box opens.

11. In the Relationships area, select the subfile check box and click ADD.

    The connection appears on the canvas. By default, the queue name ("subfile") matches the relationship(s) that you selected.

12. Right-click the KeyViewExtractFiles processor and click Configure.

    The Configure Processor dialog box opens.

13. Click the Properties tab.
14. In the properties list, set the IDOL License Service property to the name of the IDOL License Service that you created in Create a License Service.

15. In the properties list, set the KeyView Filter Service property to the name of the service that you created in Add a KeyView Service.

    To find out more about this processor and the properties that you can set, see the documentation for the KeyViewExtractFiles processor.

16. Click Apply.

Copyright 2018-2025 Open Text
Version 25.2 | Last updated April 2025

Send documentation feedback

Close

Send documentation feedback

To send feedback using your default email client, open an email window.

Otherwise, send your feedback and the information below to MFI-swpdl.idoldocsfeedback@opentext.com.

We appreciate your feedback!

Product: Knowledge Discovery NiFi Ingest 25.2

Topic Title: Add Subfile Extraction