@cwebber even if it was set to be deterministic, it still wouldn’t reliably produce correct output.

@cwebber the methods used to prepare the data are similar (preprocessing, encoding, tokenization). If you turned the temperature on an LLM to 0 then it can be used to deterministically output the word with the highest probability at every step. People aren’t talking about that in this case, though.