We define determinism as a model behaving predictably, while also producing useful supporting metadata, like confidence scores from specialized DNNs/CNNs, not just text tokens generated as "scores".
So for the same kind of task, you can expect the same kind of output every time, without randomly breaking structured output or having to constantly change generation hyperparams.
Love to see it. Cheers!
reply