Agent activity
Connect lets you view various processing activities performed by the installed agents. You can review the state of processing and gain insight for any issues that have been encountered.
NOTE: If you have created API-based custom actions, these actions are not tracked on the agent activity page.
In addition to basic information about each activity, you can see the source or dataset the activity was performed against, the cluster for the agent that performed the activity, the number of documents (extracted attachments are not included in the count) or tables processed, and the status of the activity. If the activity, such as a hold or collection from a workspace, spans multiple datasets, the activity can be expanded in the list to view information about the individual datasets involved in the activity.
Status | Icon | Description |
---|---|---|
Waiting On Agent | none | For activities that are comprised of multiple tasks, the agent is in between steps and waiting for the next step to start. |
In progress | progress bar |
The agent is currently running and processing items. The progress bar indicates how far along the run is. When in progress, the processing can be canceled. To cancel an in-progress agent activity
|
Completed |
|
The agent run has completed processing, without errors. |
Completed with ingestion errors |
|
The agent run has completed indexing, but errors occurred. For example, if an agent fails to connect to a source for a duration of five (5) minutes when attempting to perform a scan or action, an error will display, as well as on the Agent Clusters page. Click the link to view the Activity error details. TIP: In this scenario, you can go to the dataset and initiate another scan. |
Completed with processing errors |
|
The agent run has completed processing, but errors occurred. For example, if a malformed item is encountered during a scan and cannot be added to the index or we have scanned an item but the action (such as text extraction) cannot be taken, an error will display, as well as on the Agent Clusters page. Click the link to view the Activity error details. |
Completed with errors |
|
The agent run has completed, but both ingestion and processing errors occurred. The error also displays on the Agent Clusters page. Click the link to view the Activity error details. |
Canceled |
|
The agent run was manually canceled. TIP: An active collection or deletion run can be canceled from the Manage Datasets and Agent Activity pages in Connect, as well as from the Data Sources page and the workspace Collection card in Manage. |
Pending | none | The agent is currently processing. |
From the agent activity list, click a source (structured data) or dataset (unstructured data) name to go to the Manage Sources or Manage Datasets page with the source or dataset highlighted and the detail panel open. Click an agent cluster name to go to the Agent Clusters page with the cluster highlighted and the detail panel open. For an activity that completed with errors, click the "completed with errors" link to view the Activity error details. For a scan activity that "completed with errors" or "completed with ingestion errors", you can retry the activity.
You can view detailed information in the agent activity detail panel (). In addition to what is available in the activity list, you can see the following activity information in the detail panel.
-
View the details of the selected agent activity, including the dataset and source against which the activity was initiated, job run ID, the user that initiated the activity, the agent cluster responsible for the activity, and the activity start time and status.
The user defined for Initiated By is either the name of the Fusion user, system, or scheduled.
-
The ACTIVITY defines the tasks that were performed as part of the activity. Each task includes the name of the agent that performed that task, the number of documents processed, the time the task started, and the status of the task.
Large tasks are typically be broken down into multiple workunits and potentially distributed to several agents (within the cluster) to be performed in parallel, for greater efficiency. For these tasks, expand the task to view the agent that performed each workunit, the number of documents processed, the time the workunit began processing, and the status.
Click the agent name to go to the Agent Clusters page with the agent highlighted and the detail panel open.
If an activity, task, or workunit completed with errors, click the "completed with errors" link to view the Agent activity.
-
For activities on unstructured datasets, click VIEW CONTENTS to go to the Research page in Analyze to view the list of documents against which the activity was performed. On the Research page, the Job run ID for the activity shows in the VIEWING CONTENT OF box above the filter panel.
Activity | Task | Initiator |
---|---|---|
Collection | Prepare for Collect | Identify items that are not yet collected. |
Collection | Collect items. User initiated request for a workbook. | |
Delete | Prepare for Delete | Identify items that can be deleted. |
Delete | Delete items from a source. User initiated request for a workbook. | |
File Analysis | Prepare for File Analysis | Identify items for requested file analysis action. |
File Analysis |
Analyze, store content, OCR, or extract grammar values. User initiated request for a workbook. System initiated when a scan involves item/parent document exist in overlapping datasets with different processing types (full scan analyzed, full scan metadata, store content). |
|
Hold | Collect | Collect items not already collected to prepare for a hold. |
Hold | Place items on hold. User initiated request for a workbook. | |
Inventory | Inventory | Identify tables within a structured data source. System initiated upon structured data source creation. User initiated inventory request for a structured data source. |
Log Collection | Log Collection | Collect and prepare agent logs to be available for download. User initiated. |
Scan | Scan | Identify and count the data items for a dataset. |
Ingestion | Process the data items according to the criteria defined for a dataset. System initiated upon creation of a dataset. User initiated scan request for an unstructured data dataset. | |
Send to Target | Prepare for Collect | Identify items that need to be collected before being sent to a target. This occurs when the defined target for an item is managed by a different agent cluster than the source for that item. |
Collect | Collect items not already collected to prepare for sending to a target. | |
Send to Target | Send items to a target. User initiated request for a workbook. |
Filter activity events
Use the filter panel to refine the list of datasets associated with agent activity events. As you add criteria to the filter, the list of datasets dynamically updates. The criteria you specifically select are shown at the top of the filter panel. Click the next to the selected criterion to remove it from the filter. Click the clear all icon (
) to remove all of the selected criteria and return to the full list of datasets.
If you make no selections in the filter panel, all activity events for all datasets are returned. When you select filter criteria, the dataset list is limited based only on what is selected. When multiple selections are made within a single filter category (agent Status, Dataset Type, and so on), the item can match any of the criteria in that category. When selections are made across multiple filter categories, the dataset must match all the categories selected.
Filter criterion | Description |
---|---|
Hide empty completed activities |
Select whether to hide rows in the agent activity list for completed agent runs that resulted in no documents being processed. Click the toggle to select ( Default: toggle is set to "on" position and completed activity with zero documents processed are not displayed in the list. |
Status |
Select the desired agent status to include in the filter. If you select multiple status', datasets with any of the selected agent status' and matching the remaining filter criteria are returned. |
Date Range | Define specific start (From) and end (To) dates for the filter. The dates selected are included in the filter. |
Agent Clusters | Select one or more agent clusters to include in the filter. If you select multiple clusters, datasets associated with any of the selected clusters and matching the remaining filter criteria are returned. |
Datasets | Select one or more datasets to include in the filter. If you select multiple datasets, any of the selected datasets that match the remaining filter criteria are returned. |
Sources | Select one or more sources to include in the filter. If you select multiple sources, any of the selected sources that match the remaining filter criteria are returned. |
Source Types | Select the desired source types to include in the filter. If you select multiple types, sources of any of the selected types and matching the remaining filter criteria are returned. |
Activity error details
During processing, errors may occur and you will need to investigate. You can use the error details accessible on the Agent Activity page to narrow down the issue. When an activity completes with errors, you can click the "Completed with errors" link to view the activity error details. The activity error details include the error message, error type, agent that performed the action, job/workunit ID, count, and date and time the error occurred. The job/workunit ID value is the dataset name followed by an underscore and the workunit ID. The count is the number of items in the workunit.
The error message reflects the error reported in the Fusion log files. You can use the workunit ID and the time stamp to assist in locating the appropriate log file and error the agent identified. Click the copy icon () to copy the error message to use as needed.
Retry scan activity
For scan activities that failed with ingestion errors you can trigger the activity to rerun an additional time—only one retry per failed scan activity is allowed. When you retry a scan activity that "completed with errors" or "completed with ingestion errors", Fusion runs the scan activity again for only the data that failed.
NOTE: You can retry activities that are of the type "scan" and status "completed with errors" and "completed with ingestion errors".
On the Agent Activity page, click or hover over the row for the desired scan activity that completed with ingestion errors and then click the retry icon ().
TIP: You can also click in the row for the desired scan activity, open the detail panel () and then click RETRY.
The retry action begins.