Meaning of hyperparameter | Babel Free

Definitions

1. A parameter of a prior (as distinguished from inferred parameters of the model for the underlying system under analysis).
2. A parameter whose value is set before the learning process begins.

Equivalents

Examples

“this model⟳ has four hyperparameters”

“The exact interpretation of these hyperparameters becomes clearer once you have⟳ seen their role in the posterior and, hence, we defer a deeper discussion of prior elicitation until the next section.”

“The ideal learning algorithm just takes a dataset and outputs a function, without requiring hand tuning of hyperparameters.”

““Model⟳ behaviour is not determined by architecture, hyperparameters, or optimizer choices,” he said, referring to the technical difficulties of training a language model⟳. “It’s determined by your dataset, nothing else. […]””

CEFR level