Query Manipulation Server 24.3

# ChunkSize

The maximum number of tokens of the full tokenized text that is provided to the generative model. If the total number of tokens is larger, QMS sends the input context in multiple chunks and combines the results from each chunk.

This parameter has an effect only when Type is set to `GenerativeLLM`.

Type: | String
Default: | 512
Required: | No
Configuration Section: | MyGenerativeModel
Example: | `ChunkSize=120`
See Also: | Type

Copyright 2024 Open Text
Version 24.3 | Last updated June 2024

Send documentation feedback

Close

Send documentation feedback

To send feedback using your default email client, open an email window.

Otherwise, send your feedback and the information below to MFI-swpdl.idoldocsfeedback@opentext.com.

We appreciate your feedback!

Product: IDOL Query Manipulation Server 24.3

Topic Title: ChunkSize