Query Manipulation Server 24.3

# GreedySearch

Set `GreedySearch` to `False` to use an alternative algorithm for generating text.

By default, the generative model uses a greedy search algorithm to determine the output tokens. In this approach, the model chooses the token with the highest probability as the next output token.

You can set `GreedySearch` to `False` to use a multinomial sampling algorithm instead, which chooses the next token randomly based on a probability distribution over the entire vocabulary of the model. This option can sometimes give better results for longer sequences. However, the results vary for a particular input because the algorithm contains an element of randomness.

This parameter has an effect only when Type is set to `GenerativeLLM`.

Type: | Boolean
Default: | True
Required: | No
Configuration Section: | MyLLMModule
Example: | `GreedySerach=False`
See Also: | Type

Copyright 2024 Open Text
Version 24.3 | Last updated June 2024

Send documentation feedback

Close

Send documentation feedback

To send feedback using your default email client, open an email window.

Otherwise, send your feedback and the information below to MFI-swpdl.idoldocsfeedback@opentext.com.

We appreciate your feedback!

Product: IDOL Query Manipulation Server 24.3

Topic Title: GreedySearch