Temperature is a model setting that determines how creative a model’s response is. Much like the Top P setting, it determines diversity. A lower temperature instructs the model to deviate less from its data, while a higher temperature allows the model to extrapolate more information and deviate from its data. It ranges from 0 to 1, with 0.7 as a default.
For agents meant to deliver accurate information, a lower temperature provides more consistent and predictable results. For agents meant to brainstorm ideas and emulate creativity, a higher temperature provides more variation and new ideas.