TokenWithPunctuation
Set TokenWithPunctuation
to True
to treat all punctuation characters as part of a word token, rather than treating them as word boundaries. This option is equivalent to setting TangibleCharacters to all punctuation characters.
This parameter has no effect when MatchWholeWord is set to False
.
NOTE: You can override the value of this parameter for specific actions by setting the TokenWithPunctuation action parameter.
Type: | Boolean |
Default: | False |
Required: | No |
Configuration Section: |
Eduction |
Example: | TokenWithPunctuation=True
|
See Also: | MatchWholeWord
TangibleCharacters |
For more information on using TokenWithPunctuation
to configure all punctuation marks as tangible characters,