Token Declarations

The Token Declarations section specifies the tokens that will be parsed from each input record. Each token has a name and a type. Depending on the type, some tokens (such as TimeStamp) have a format, as well. XML FlexConnectors also have a path expression and a context node, which are described in Parser Properties for an XML FlexConnector.

In addition to assigning parsed tokens to events, you can also assign built-in tokens, which are described in Event Mapping.

Parameter	Description
token.count	This property specifies the number of tokens that each line of the file contains. For example, token.count=7 indicates there are seven tokens. Token declarations are numbered from 0 to token.count-1.
token[x].name	This property specifies a user-defined name for the token, this can be a friendly name used to identify the token. For example, token[0].name=Time_of_the_event would set the name of the token of index 0 to Time_of_the_event. Use this friendly name to identify how to map it to the event object.
token[x].type	This property specifies the data type of the object. It is important to set the correct type so the mapping to the event object can be correctly performed. For a list of supported types, see Token Types.
token[x].format	This property modifies the type of the token, for example, when using the TimeStamp type, the format defines the actual format of the timestamp. See Date and Time Format Symbols.