IDOL NiFi Ingest Connectors support some properties which you can use to customize the behavior of the processor. These properties are supported by all connectors.
Property Name | Description | Default |
---|---|---|
adv:ConnectionValidation
|
A Boolean value that specifies whether the connector validates its connection to the repository using any connection details or credentials you have provided. When this feature is enabled the connector provides a warning if the connection is not successful. | True |
adv:FlowFileEmbedFiles
|
A Boolean value that specifies whether to include binary file content in FlowFiles, rather than including only file paths. For example, if you set this property to Setting this property to |
False |
adv:IngestBatchSize
|
The number of documents to create before releasing a batch of documents to the outgoing queue. This property only applies to processors, such as GetFileSystem, that perform the synchronize action and have names beginning with "Get". |
100 |
adv:IngestSharedPath
|
The directory in which the connector saves files that were downloaded from the data repository. You can specify the same directory for multiple connectors, because each processor creates a subfolder within the specified path. If you run a NiFi cluster, the files retrieved by a connector must be available to all of the nodes in the cluster. You can either configure an ingest shared path (by setting this property to a directory that is accessible from every node in the cluster), or embed the files in the FlowFiles (by setting |
|
adv:PurgeDatastore
|
A Boolean value that specifies whether to purge (clear) the datastore after each scheduled synchronize cycle. By default, a connector stores information about the items it has retrieved from a repository so that it does not need to retrieve them again unless they are modified. If you set this property to NOTE: If you set this property to This property only applies to processors, such as GetFileSystem, that perform the synchronize action and have names beginning with "Get". |
False |
adv:TaskMaxDuration
|
The maximum amount of time that the processor should run for. If the time limit is reached the connector stops until the next scheduled task begins. Specify the duration with time units, for example 2 hours or 30 min. | |
adv:Threads
|
The number of threads to use. By default a connector uses up to five threads for synchronization. The connector might be able to synchronize with the repository in less time if you increase the value, but this places additional load on the repository because it must respond to more frequent requests. This property applies to all types of connector processors. |
5 |
ATTR:name
|
Adds a FlowFile attribute, with the specified name , to every FlowFile produced by the connector. |
|
META:fieldname
|
Adds a metadata field to every document produced by the connector. The field has the name fieldname and the value of the property. For example, to add a field named SecurityType to every document, set a property named META:SecurityType . |
To set an advanced property
Right-click the processor and click Configure.
The Configure Processor dialog box opens.
Click Add .
The Add Property dialog box opens.
To remove an advanced property, find it in the properties list and click the delete icon .
|