Data Discovery & Risk Insights 24.4.0 Help Center

# Agent activity

Connect lets you view various processing activities performed by the installed agents. You can review the state of processing and gain insight for any issues that have been encountered.

NOTE: If you have created API-based custom actions, these actions are not tracked on the agent activity page.

In addition to basic information about each activity, you can see the source or dataset the activity was performed against, the cluster for the agent that performed the activity, the number of documents (extracted attachments are not included in the count) or tables processed, and the status of the activity. If the activity, such as a hold or collection from a workspace, spans multiple datasets, the activity can be expanded in the list to view information about the individual datasets involved in the activity.

Agent activity status definitions

Status | Icon | Description
--- | --- | ---
Waiting On Agent | none | For activities that are comprised of multiple tasks, the agent is in between steps and waiting for the next step to start.
In progress | progress bar | The agent is currently running and processing items. The progress bar indicates how far along the run is. When in progress, the processing can be canceled. To cancel an in-progress agent activity In the agent activity list, click or hover over the row for the desired agent activity and then click the associated cancel icon (). TIP: You can also click the row for the desired agent, click the open detail panel icon (), and then click CANCEL. In the confirmation dialog, click YES to confirm the action. The activity is canceled and the status updates when the cancellation is completed.
Completed |  | The agent run has completed processing, without errors.
Completed with ingestion errors |  | The agent run has completed indexing, but errors occurred. For example, if an agent fails to connect to a source for a duration of five (5) minutes when attempting to perform a scan or action, an error will display, as well as on the Agent Clusters page. Click the link to view the Activity error details. TIP: In this scenario, you can go to the dataset and initiate another scan.
Completed with processing errors |  | The agent run has completed processing, but errors occurred. For example, if a malformed item is encountered during a scan and cannot be added to the index or we have scanned an item but the action (such as text extraction) cannot be taken, an error will display, as well as on the Agent Clusters page. Click the link to view the Activity error details.
Completed with errors |  | The agent run has completed, but both ingestion and processing errors occurred. The error also displays on the Agent Clusters page. Click the link to view the Activity error details.
Canceled |  | The agent run was manually canceled. TIP: An active collection or deletion run can be canceled from the Manage Datasets and Agent Activity pages in Connect, as well as from the Data Sources page and the workspace Collection card in Manage.
Pending | none | The agent is currently processing.

From the agent activity list, click a source (structured data) or dataset (unstructured data) name to go to the Manage Sources or Manage Datasets page with the source or dataset highlighted and the detail panel open. Click an agent cluster name to go to the Agent Clusters page with the cluster highlighted and the detail panel open. For an activity that completed with errors, click the "completed with errors", "completed with ingestion errors", or "completed with processing errors" link to view the Activity error details. For a scan activity that "completed with errors" or "completed with ingestion errors", you can retry the activity.

If needed, you can cancel an in-progress file analysis activity. Processing is completed for any data items already in progress; the action is canceled for all remaining data items. File analysis actions include system file analysis actions such as a re-scan as a result of a grammar change to dataset or a dataset processing change from metadata-only to analyzed scan, as well as File Analysis actions taken from the ACTIVITY tab of a workbook detail panel.

To cancel an in-progress file analysis activity

1. In the agent activity list, click the row for the file analysis action you want to cancel.

2. Do one of the following.

   - If the action can be canceled, the cancel icon () displays in the right column.

     Click the cancel icon ().

   - Open the detail panel (). If the action can be canceled, a CANCEL button displays at the top of the panel.

     Click CANCEL.

3. The cancel request is made and the action will be canceled.

You can view detailed information in the agent activity detail panel (). In addition to what is available in the activity list, you can see the following activity information in the detail panel.

- View the details of the selected agent activity, including the dataset and source against which the activity was initiated, job run ID, the user that initiated the activity, the agent cluster responsible for the activity, and the activity start time and status.

  The user defined for Initiated By is either the name of the OpenText Core Data Discovery & Risk Insights user, system, or scheduled.

- The ACTIVITY defines the tasks that were performed as part of the activity. Each task includes the name of the agent that performed that task, the number of documents processed, the time the task started, and the status of the task. If applicable, you can also see the number of documents no longer at the source location (documents have been deleted from the source since the last scan).

  Large tasks are typically broken down into multiple work units and potentially distributed to several agents (within the cluster) to be performed in parallel, for greater efficiency. For these tasks, review the Work unit summary chart for an overview. Click VIEW DETAIL to open a pop-up window with the work unit details.

  In the work unit detail window, you can do the following.

  - Filter by agent.

  - Sort by work unit id, by duration (amount of time taken to completed the work unit for the task), or by last updated.

  - View work units that are currently processing, have errors, are completed, are ready (waiting for the agent to be available), are preparing, or have been canceled.

    If errors occur during processing, these errors will display on the ERRORS tab while processing continues.

  - Click the agent name to go to the Agent Clusters page with the agent highlighted and the detail panel open.

  - If an activity, task, or work unit completed with errors, click the "completed with errors" link to view the Activity error details.

- For activities on unstructured datasets, click VIEW CONTENTS to go to the Research page in Analyze to view the list of documents against which the activity was performed. On the Research page, the Job run ID for the activity shows in the VIEWING CONTENT OF box above the filter panel.

Reported agent activity types

Activity | Task | Initiator
--- | --- | ---
Collection | Prepare for Collect | Identify items that are not yet collected.
Collection | Collect items. User initiated request for a workbook.
Delete | Prepare for Delete | Identify items that can be deleted.
Delete | Delete items from a source. User initiated request for a workbook.
File Analysis | Prepare for File Analysis | Identify items for requested file analysis action.
File Analysis | Analyze, store content, OCR, or extract grammar values. User initiated request for a workbook. System initiated when a scan involves item/parent document exist in overlapping datasets with different processing types (full scan analyzed, full scan metadata, store content).
Hold | Collect | Collect items not already collected to prepare for a hold.
Hold | Place items on hold. User initiated request for a workbook.
Inventory | Inventory | Identify tables within a structured data source. System initiated upon structured data source creation. User initiated inventory request for a structured data source.
Log Collection | Log Collection | Collect and prepare agent logs to be available for download. User initiated.
Scan | Scan | Identify and count the data items for a dataset.
Ingestion | Process the data items according to the criteria defined for a dataset. System initiated upon creation of a dataset. User initiated scan request for an unstructured data dataset.
Send to Target | Prepare for Collect | Identify items that need to be collected before being sent to a target. This occurs when the defined target for an item is managed by a different agent cluster than the source for that item.
Collect | Collect items not already collected to prepare for sending to a target.
Send to Target | Send items to a target. User initiated request for a workbook.

## Filter activity events

Use the filter panel to refine the list of datasets associated with agent activity events. As you add criteria to the filter, the list of datasets dynamically updates. The criteria you specifically select are shown at the top of the filter panel. Click the next to the selected criterion to remove it from the filter. Click the clear all icon () to remove all of the selected criteria and return to the full list of datasets.

If you make no selections in the filter panel, all activity events for all datasets are returned. When you select filter criteria, the dataset list is limited based only on what is selected. When multiple selections are made within a single filter category (agent Status, Dataset Type, and so on), the item can match any of the criteria in that category. When selections are made across multiple filter categories, the dataset must match all the categories selected.

Filter criteria

Filter criterion | Description
--- | ---
Hide empty completed activities | Select whether to hide rows in the agent activity list for completed agent runs that resulted in no documents being processed. Click the toggle to select () or deselect () the option. Default: toggle is set to "on" position and completed activity with zero documents processed are not displayed in the list.
Status | Select the desired agent status to include in the filter. If you select multiple status', datasets with any of the selected agent status' and matching the remaining filter criteria are returned.
Date Range | Define specific start (From) and end (To) dates for the filter. The dates selected are included in the filter.
Agent Clusters | Select one or more agent clusters to include in the filter. If you select multiple clusters, datasets associated with any of the selected clusters and matching the remaining filter criteria are returned.
Datasets | Select one or more datasets to include in the filter. If you select multiple datasets, any of the selected datasets that match the remaining filter criteria are returned.
Sources | Select one or more sources to include in the filter. If you select multiple sources, any of the selected sources that match the remaining filter criteria are returned.
Source Types | Select the desired source types to include in the filter. If you select multiple types, sources of any of the selected types and matching the remaining filter criteria are returned.

## Activity error details

During processing, errors may occur and you will need to investigate. You can use the error details accessible on the Agent Activity page to narrow down the issue. When an activity completes with errors, you can click the "Completed with errors", "Completed with ingestion errors", or "Completed with processing errors" link to view the activity error details. The activity error details include the error message, error type, agent that performed the action, job/work unit ID, count, and date and time the error occurred. The job/work unit ID value is the dataset name followed by an underscore and the work unit ID. The count is the number of items in the work unit.

If the error list includes both ingestion and processing errors, use the ERROR TYPE filter above the error list to show either the ingestion errors or the processing errors. To export the list of errors to a CSV, click EXPORT PROCESSING ERRORS TO CSV or EXPORT INGESTION ERRORS TO CSV, as appropriate for the errors currently displayed.

The error message reflects the error reported in the OpenText Core Data Discovery & Risk Insights log files. You can use the work unit ID and the time stamp to assist in locating the appropriate log file and error the agent identified. Click the copy icon () to copy the error message to use as needed.

## Retry scan activity

For scan activities that failed with errors or ingestion errors you can trigger the activity to rerun an additional time—only one retry per failed scan activity is allowed. When you retry a scan activity that "completed with errors" or "completed with ingestion errors", the scan activity runs again for only the data that failed.

NOTE: You can retry activities that are of the type "scan" and status "completed with errors" and "completed with ingestion errors".

To retry a scan activity

On the Agent Activity page, click or hover over the row for the desired scan activity that completed with ingestion errors and then click the retry icon ().

TIP: You can also click in the row for the desired scan activity, open the detail panel () and then click RETRY.

The retry action begins.

Copyright 2019-2024 Open Text
Version 24.4.0 | Last updated October 2024
Connect
Marketplace
Learn
Support portal
Documentation
Contact
Submit or view service request