The randomness of LLM outputs is controlled by a parameter known as "temperature." A higher temperature increases randomness, while a lower temperature produces “more deterministic” outputs.
Share this post
Zero Temperature Randomness in LLMs
Share this post
The randomness of LLM outputs is controlled by a parameter known as "temperature." A higher temperature increases randomness, while a lower temperature produces “more deterministic” outputs.