Luca Beurer-Kellner: ETH Zürich, Creator, Language Model Query Language,
TheSequence
JULY 19, 2023
argmax, sampling or e.g. beam search). (2) 2) What kind of (multi-part) prompt you use to call the model, and (3) what kind of constraints and formatting requirements you have on the model’s response. Decoding is generally known to improve overall output quality for the price of more model calls.
Let's personalize your content