The connector can operate in the following modes:
synchronize action is running. Any entries that are streamed when the synchronize action is not running are not retrieved. In this mode, the synchronize action does not stop unless you set the TaskMaxDuration configuration parameter, run the StopFetch action, or stop the connector.Historical Mode. The connector retrieves historical data from Gnip. In this mode, the synchronize action finishes when all of the data you request has been ingested. Historical jobs can take a long time to complete, but you can stop them by sending a StopFetch action to the connector, and resume them by sending another synchronize action.
You can choose the time period to retrieve data for by specifying either fixed or relative start and end dates. Relative dates are relative to the time when the synchronize action starts. For example, each time you synchronize with Gnip you could choose to retrieve historical data for the last week. Gnip Connector does not send remove commands to your ingestion server for entries that no longer fall within the time period, but if you want your IDOL index to contain only entries from the last 7 days you can configure IDOL Server to expire documents.
|
|