Answer Server 24.4
IDOL Answer Server Help

# ChunkSize

The maximum number of tokens of the full tokenized question and context that is provided to the generative model. If the total number of tokens is larger, IDOL sends the input context in multiple chunks and combines the results from each chunk.

This parameter has an effect only when Type is set to `GenerativeLLM`.

Type: | String
Default: | 512
Required: | No
Configuration Section: | MyLLMModule
Example: | `ChunkSize=120`
See Also: | Type

Copyright 2016-2024 Open Text
Version 24.4 | Last updated September 2024

Send documentation feedback

Close

Send documentation feedback

To send feedback using your default email client, open an email window.

Otherwise, send your feedback and the information below to MFI-swpdl.idoldocsfeedback@opentext.com.

We appreciate your feedback!

Product: IDOL Answer Server 24.4

Topic Title: ChunkSize