Meaning of hyperparameter | Babel Free

Definitions

1. A parameter of a prior (as distinguished from inferred parameters of the model for the underlying system under analysis).
2. A parameter whose value is set before the learning process begins.

Equivalents

Examples

“this model has four hyperparameters”

“The exact interpretation of these hyperparameters becomes clearer once you have seen their role in the posterior and, hence, we defer a deeper discussion of prior elicitation until the next section.”

“The ideal learning algorithm just takes a dataset and outputs a function, without requiring hand tuning of hyperparameters.”

““Model behaviour is not determined by architecture, hyperparameters, or optimizer choices,” he said, referring to the technical difficulties of training a language model. “It’s determined by your dataset, nothing else. […]””

CEFR level